00:00:00.001 Started by upstream project "autotest-per-patch" build number 121340 00:00:00.001 originally caused by: 00:00:00.001 Started by user sys_sgci 00:00:00.068 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.256 The recommended git tool is: git 00:00:00.256 using credential 00000000-0000-0000-0000-000000000002 00:00:00.258 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.270 Fetching changes from the remote Git repository 00:00:00.271 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.286 Using shallow fetch with depth 1 00:00:00.286 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.286 > git --version # timeout=10 00:00:00.300 > git --version # 'git version 2.39.2' 00:00:00.300 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.300 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.300 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:05.734 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:05.746 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:05.760 Checking out Revision f964f6d3463483adf05cc5c086f2abd292e05f1d (FETCH_HEAD) 00:00:05.760 > git config core.sparsecheckout # timeout=10 00:00:05.774 > git read-tree -mu HEAD # timeout=10 00:00:05.792 > git checkout -f f964f6d3463483adf05cc5c086f2abd292e05f1d # timeout=5 00:00:05.817 Commit message: "ansible/roles/custom_facts: Drop nvme features" 00:00:05.817 > git rev-list --no-walk f964f6d3463483adf05cc5c086f2abd292e05f1d # timeout=10 00:00:05.917 [Pipeline] Start of Pipeline 00:00:05.930 [Pipeline] library 00:00:05.932 Loading library shm_lib@master 00:00:05.932 Library shm_lib@master is cached. Copying from home. 00:00:05.944 [Pipeline] node 00:00:05.956 Running on WFP34 in /var/jenkins/workspace/nvmf-phy-autotest 00:00:05.957 [Pipeline] { 00:00:05.966 [Pipeline] catchError 00:00:05.967 [Pipeline] { 00:00:05.979 [Pipeline] wrap 00:00:05.989 [Pipeline] { 00:00:05.996 [Pipeline] stage 00:00:05.997 [Pipeline] { (Prologue) 00:00:06.195 [Pipeline] sh 00:00:06.478 + logger -p user.info -t JENKINS-CI 00:00:06.495 [Pipeline] echo 00:00:06.496 Node: WFP34 00:00:06.502 [Pipeline] sh 00:00:06.797 [Pipeline] setCustomBuildProperty 00:00:06.811 [Pipeline] echo 00:00:06.812 Cleanup processes 00:00:06.817 [Pipeline] sh 00:00:07.100 + sudo pgrep -af /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:00:07.100 1314916 sudo pgrep -af /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:00:07.114 [Pipeline] sh 00:00:07.400 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:00:07.400 ++ grep -v 'sudo pgrep' 00:00:07.400 ++ awk '{print $1}' 00:00:07.400 + sudo kill -9 00:00:07.400 + true 00:00:07.416 [Pipeline] cleanWs 00:00:07.426 [WS-CLEANUP] Deleting project workspace... 00:00:07.426 [WS-CLEANUP] Deferred wipeout is used... 00:00:07.433 [WS-CLEANUP] done 00:00:07.437 [Pipeline] setCustomBuildProperty 00:00:07.452 [Pipeline] sh 00:00:07.756 + sudo git config --global --replace-all safe.directory '*' 00:00:07.813 [Pipeline] nodesByLabel 00:00:07.815 Found a total of 1 nodes with the 'sorcerer' label 00:00:07.825 [Pipeline] httpRequest 00:00:07.831 HttpMethod: GET 00:00:07.831 URL: http://10.211.164.96/packages/jbp_f964f6d3463483adf05cc5c086f2abd292e05f1d.tar.gz 00:00:07.838 Sending request to url: http://10.211.164.96/packages/jbp_f964f6d3463483adf05cc5c086f2abd292e05f1d.tar.gz 00:00:07.849 Response Code: HTTP/1.1 200 OK 00:00:07.850 Success: Status code 200 is in the accepted range: 200,404 00:00:07.850 Saving response body to /var/jenkins/workspace/nvmf-phy-autotest/jbp_f964f6d3463483adf05cc5c086f2abd292e05f1d.tar.gz 00:00:13.804 [Pipeline] sh 00:00:14.090 + tar --no-same-owner -xf jbp_f964f6d3463483adf05cc5c086f2abd292e05f1d.tar.gz 00:00:14.111 [Pipeline] httpRequest 00:00:14.116 HttpMethod: GET 00:00:14.117 URL: http://10.211.164.96/packages/spdk_6651b13f785a407c9e2f93ac35ba429108401909.tar.gz 00:00:14.117 Sending request to url: http://10.211.164.96/packages/spdk_6651b13f785a407c9e2f93ac35ba429108401909.tar.gz 00:00:14.142 Response Code: HTTP/1.1 200 OK 00:00:14.142 Success: Status code 200 is in the accepted range: 200,404 00:00:14.143 Saving response body to /var/jenkins/workspace/nvmf-phy-autotest/spdk_6651b13f785a407c9e2f93ac35ba429108401909.tar.gz 00:02:11.674 [Pipeline] sh 00:02:11.963 + tar --no-same-owner -xf spdk_6651b13f785a407c9e2f93ac35ba429108401909.tar.gz 00:02:14.510 [Pipeline] sh 00:02:14.793 + git -C spdk log --oneline -n5 00:02:14.794 6651b13f7 test/scheduler: Enable load_balancing test back 00:02:14.794 c3fd276bb test/scheduler: Stop using cgroups 00:02:14.794 8571999d8 test/scheduler: Stop moving all processes between cgroups 00:02:14.794 06472fb6d lib/idxd: fix batch size in kernel IDXD 00:02:14.794 44dcf4fb9 pkgdep/idxd: Add dependency for accel-config used in kernel IDXD 00:02:14.812 [Pipeline] } 00:02:14.829 [Pipeline] // stage 00:02:14.838 [Pipeline] stage 00:02:14.840 [Pipeline] { (Prepare) 00:02:14.858 [Pipeline] writeFile 00:02:14.876 [Pipeline] sh 00:02:15.190 + logger -p user.info -t JENKINS-CI 00:02:15.203 [Pipeline] sh 00:02:15.486 + logger -p user.info -t JENKINS-CI 00:02:15.499 [Pipeline] sh 00:02:15.781 + cat autorun-spdk.conf 00:02:15.781 SPDK_RUN_FUNCTIONAL_TEST=1 00:02:15.781 SPDK_TEST_NVMF=1 00:02:15.781 SPDK_TEST_NVME_CLI=1 00:02:15.781 SPDK_TEST_NVMF_NICS=mlx5 00:02:15.781 SPDK_RUN_UBSAN=1 00:02:15.781 NET_TYPE=phy 00:02:15.787 RUN_NIGHTLY=0 00:02:15.792 [Pipeline] readFile 00:02:15.812 [Pipeline] withEnv 00:02:15.813 [Pipeline] { 00:02:15.822 [Pipeline] sh 00:02:16.099 + set -ex 00:02:16.099 + [[ -f /var/jenkins/workspace/nvmf-phy-autotest/autorun-spdk.conf ]] 00:02:16.099 + source /var/jenkins/workspace/nvmf-phy-autotest/autorun-spdk.conf 00:02:16.099 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:02:16.099 ++ SPDK_TEST_NVMF=1 00:02:16.099 ++ SPDK_TEST_NVME_CLI=1 00:02:16.099 ++ SPDK_TEST_NVMF_NICS=mlx5 00:02:16.099 ++ SPDK_RUN_UBSAN=1 00:02:16.099 ++ NET_TYPE=phy 00:02:16.099 ++ RUN_NIGHTLY=0 00:02:16.099 + case $SPDK_TEST_NVMF_NICS in 00:02:16.099 + DRIVERS=mlx5_ib 00:02:16.099 + [[ -n mlx5_ib ]] 00:02:16.099 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:02:16.099 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:02:22.668 rmmod: ERROR: Module irdma is not currently loaded 00:02:22.668 rmmod: ERROR: Module i40iw is not currently loaded 00:02:22.668 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:02:22.668 + true 00:02:22.668 + for D in $DRIVERS 00:02:22.668 + sudo modprobe mlx5_ib 00:02:22.668 + exit 0 00:02:22.677 [Pipeline] } 00:02:22.696 [Pipeline] // withEnv 00:02:22.702 [Pipeline] } 00:02:22.719 [Pipeline] // stage 00:02:22.729 [Pipeline] catchError 00:02:22.730 [Pipeline] { 00:02:22.744 [Pipeline] timeout 00:02:22.744 Timeout set to expire in 40 min 00:02:22.746 [Pipeline] { 00:02:22.762 [Pipeline] stage 00:02:22.764 [Pipeline] { (Tests) 00:02:22.781 [Pipeline] sh 00:02:23.066 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-phy-autotest 00:02:23.066 ++ readlink -f /var/jenkins/workspace/nvmf-phy-autotest 00:02:23.066 + DIR_ROOT=/var/jenkins/workspace/nvmf-phy-autotest 00:02:23.066 + [[ -n /var/jenkins/workspace/nvmf-phy-autotest ]] 00:02:23.066 + DIR_SPDK=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:02:23.066 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-phy-autotest/output 00:02:23.066 + [[ -d /var/jenkins/workspace/nvmf-phy-autotest/spdk ]] 00:02:23.066 + [[ ! -d /var/jenkins/workspace/nvmf-phy-autotest/output ]] 00:02:23.066 + mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/output 00:02:23.066 + [[ -d /var/jenkins/workspace/nvmf-phy-autotest/output ]] 00:02:23.066 + cd /var/jenkins/workspace/nvmf-phy-autotest 00:02:23.066 + source /etc/os-release 00:02:23.066 ++ NAME='Fedora Linux' 00:02:23.066 ++ VERSION='38 (Cloud Edition)' 00:02:23.066 ++ ID=fedora 00:02:23.066 ++ VERSION_ID=38 00:02:23.066 ++ VERSION_CODENAME= 00:02:23.066 ++ PLATFORM_ID=platform:f38 00:02:23.066 ++ PRETTY_NAME='Fedora Linux 38 (Cloud Edition)' 00:02:23.066 ++ ANSI_COLOR='0;38;2;60;110;180' 00:02:23.066 ++ LOGO=fedora-logo-icon 00:02:23.066 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:38 00:02:23.066 ++ HOME_URL=https://fedoraproject.org/ 00:02:23.066 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f38/system-administrators-guide/ 00:02:23.066 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:02:23.066 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:02:23.066 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:02:23.066 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=38 00:02:23.066 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:02:23.066 ++ REDHAT_SUPPORT_PRODUCT_VERSION=38 00:02:23.066 ++ SUPPORT_END=2024-05-14 00:02:23.066 ++ VARIANT='Cloud Edition' 00:02:23.066 ++ VARIANT_ID=cloud 00:02:23.066 + uname -a 00:02:23.066 Linux spdk-wfp-34 6.7.0-68.fc38.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jan 15 00:59:40 UTC 2024 x86_64 GNU/Linux 00:02:23.066 + sudo /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh status 00:02:25.603 Hugepages 00:02:25.603 node hugesize free / total 00:02:25.603 node0 1048576kB 0 / 0 00:02:25.603 node0 2048kB 0 / 0 00:02:25.603 node1 1048576kB 0 / 0 00:02:25.603 node1 2048kB 0 / 0 00:02:25.603 00:02:25.603 Type BDF Vendor Device NUMA Driver Device Block devices 00:02:25.603 I/OAT 0000:00:04.0 8086 2021 0 ioatdma - - 00:02:25.603 I/OAT 0000:00:04.1 8086 2021 0 ioatdma - - 00:02:25.603 I/OAT 0000:00:04.2 8086 2021 0 ioatdma - - 00:02:25.603 I/OAT 0000:00:04.3 8086 2021 0 ioatdma - - 00:02:25.603 I/OAT 0000:00:04.4 8086 2021 0 ioatdma - - 00:02:25.863 I/OAT 0000:00:04.5 8086 2021 0 ioatdma - - 00:02:25.863 I/OAT 0000:00:04.6 8086 2021 0 ioatdma - - 00:02:25.863 I/OAT 0000:00:04.7 8086 2021 0 ioatdma - - 00:02:25.863 NVMe 0000:5f:00.0 8086 0a54 0 nvme nvme0 nvme0n1 00:02:25.863 I/OAT 0000:80:04.0 8086 2021 1 ioatdma - - 00:02:25.863 I/OAT 0000:80:04.1 8086 2021 1 ioatdma - - 00:02:25.863 I/OAT 0000:80:04.2 8086 2021 1 ioatdma - - 00:02:25.863 I/OAT 0000:80:04.3 8086 2021 1 ioatdma - - 00:02:25.863 I/OAT 0000:80:04.4 8086 2021 1 ioatdma - - 00:02:25.863 I/OAT 0000:80:04.5 8086 2021 1 ioatdma - - 00:02:25.863 I/OAT 0000:80:04.6 8086 2021 1 ioatdma - - 00:02:25.863 I/OAT 0000:80:04.7 8086 2021 1 ioatdma - - 00:02:25.863 + rm -f /tmp/spdk-ld-path 00:02:25.863 + source autorun-spdk.conf 00:02:25.863 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:02:25.863 ++ SPDK_TEST_NVMF=1 00:02:25.863 ++ SPDK_TEST_NVME_CLI=1 00:02:25.863 ++ SPDK_TEST_NVMF_NICS=mlx5 00:02:25.863 ++ SPDK_RUN_UBSAN=1 00:02:25.863 ++ NET_TYPE=phy 00:02:25.863 ++ RUN_NIGHTLY=0 00:02:25.863 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:02:25.863 + [[ -n '' ]] 00:02:25.863 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:02:25.863 + for M in /var/spdk/build-*-manifest.txt 00:02:25.863 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:02:25.863 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-phy-autotest/output/ 00:02:25.863 + for M in /var/spdk/build-*-manifest.txt 00:02:25.863 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:02:25.863 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-phy-autotest/output/ 00:02:25.863 ++ uname 00:02:25.863 + [[ Linux == \L\i\n\u\x ]] 00:02:25.863 + sudo dmesg -T 00:02:26.123 + sudo dmesg --clear 00:02:26.123 + dmesg_pid=1316428 00:02:26.123 + [[ Fedora Linux == FreeBSD ]] 00:02:26.123 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:02:26.123 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:02:26.123 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:02:26.123 + [[ -x /usr/src/fio-static/fio ]] 00:02:26.123 + sudo dmesg -Tw 00:02:26.123 + export FIO_BIN=/usr/src/fio-static/fio 00:02:26.123 + FIO_BIN=/usr/src/fio-static/fio 00:02:26.123 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:02:26.123 + [[ ! -v VFIO_QEMU_BIN ]] 00:02:26.123 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:02:26.123 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:02:26.123 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:02:26.123 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:02:26.123 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:02:26.123 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:02:26.123 + spdk/autorun.sh /var/jenkins/workspace/nvmf-phy-autotest/autorun-spdk.conf 00:02:26.123 Test configuration: 00:02:26.123 SPDK_RUN_FUNCTIONAL_TEST=1 00:02:26.123 SPDK_TEST_NVMF=1 00:02:26.123 SPDK_TEST_NVME_CLI=1 00:02:26.123 SPDK_TEST_NVMF_NICS=mlx5 00:02:26.123 SPDK_RUN_UBSAN=1 00:02:26.123 NET_TYPE=phy 00:02:26.123 RUN_NIGHTLY=0 02:21:59 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:02:26.123 02:21:59 -- scripts/common.sh@508 -- $ [[ -e /bin/wpdk_common.sh ]] 00:02:26.123 02:21:59 -- scripts/common.sh@516 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:02:26.123 02:21:59 -- scripts/common.sh@517 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:02:26.123 02:21:59 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:26.123 02:21:59 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:26.124 02:21:59 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:26.124 02:21:59 -- paths/export.sh@5 -- $ export PATH 00:02:26.124 02:21:59 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:26.124 02:21:59 -- common/autobuild_common.sh@434 -- $ out=/var/jenkins/workspace/nvmf-phy-autotest/spdk/../output 00:02:26.124 02:21:59 -- common/autobuild_common.sh@435 -- $ date +%s 00:02:26.124 02:21:59 -- common/autobuild_common.sh@435 -- $ mktemp -dt spdk_1714177319.XXXXXX 00:02:26.124 02:21:59 -- common/autobuild_common.sh@435 -- $ SPDK_WORKSPACE=/tmp/spdk_1714177319.r7CRAs 00:02:26.124 02:21:59 -- common/autobuild_common.sh@437 -- $ [[ -n '' ]] 00:02:26.124 02:21:59 -- common/autobuild_common.sh@441 -- $ '[' -n '' ']' 00:02:26.124 02:21:59 -- common/autobuild_common.sh@444 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/' 00:02:26.124 02:21:59 -- common/autobuild_common.sh@448 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/xnvme --exclude /tmp' 00:02:26.124 02:21:59 -- common/autobuild_common.sh@450 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:02:26.124 02:21:59 -- common/autobuild_common.sh@451 -- $ get_config_params 00:02:26.124 02:21:59 -- common/autotest_common.sh@385 -- $ xtrace_disable 00:02:26.124 02:21:59 -- common/autotest_common.sh@10 -- $ set +x 00:02:26.124 02:21:59 -- common/autobuild_common.sh@451 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:02:26.124 02:21:59 -- common/autobuild_common.sh@453 -- $ start_monitor_resources 00:02:26.124 02:21:59 -- pm/common@17 -- $ local monitor 00:02:26.124 02:21:59 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:02:26.124 02:21:59 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=1316462 00:02:26.124 02:21:59 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:02:26.124 02:21:59 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=1316464 00:02:26.124 02:21:59 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:02:26.124 02:21:59 -- pm/common@21 -- $ date +%s 00:02:26.124 02:21:59 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=1316466 00:02:26.124 02:21:59 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:02:26.124 02:21:59 -- pm/common@21 -- $ date +%s 00:02:26.124 02:21:59 -- pm/common@21 -- $ date +%s 00:02:26.124 02:21:59 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=1316469 00:02:26.124 02:21:59 -- pm/common@26 -- $ sleep 1 00:02:26.124 02:21:59 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1714177319 00:02:26.124 02:21:59 -- pm/common@21 -- $ date +%s 00:02:26.124 02:21:59 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1714177319 00:02:26.124 02:21:59 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1714177319 00:02:26.124 02:21:59 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1714177319 00:02:26.124 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1714177319_collect-cpu-load.pm.log 00:02:26.124 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1714177319_collect-cpu-temp.pm.log 00:02:26.124 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1714177319_collect-vmstat.pm.log 00:02:26.124 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1714177319_collect-bmc-pm.bmc.pm.log 00:02:27.059 02:22:00 -- common/autobuild_common.sh@454 -- $ trap stop_monitor_resources EXIT 00:02:27.059 02:22:00 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:02:27.059 02:22:00 -- spdk/autobuild.sh@12 -- $ umask 022 00:02:27.059 02:22:00 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:02:27.059 02:22:00 -- spdk/autobuild.sh@16 -- $ date -u 00:02:27.059 Sat Apr 27 12:22:00 AM UTC 2024 00:02:27.059 02:22:00 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:02:27.059 v24.05-pre-451-g6651b13f7 00:02:27.059 02:22:00 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:02:27.059 02:22:00 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:02:27.059 02:22:00 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:02:27.059 02:22:00 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:02:27.059 02:22:00 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:02:27.059 02:22:00 -- common/autotest_common.sh@10 -- $ set +x 00:02:27.317 ************************************ 00:02:27.317 START TEST ubsan 00:02:27.317 ************************************ 00:02:27.317 02:22:00 -- common/autotest_common.sh@1111 -- $ echo 'using ubsan' 00:02:27.317 using ubsan 00:02:27.317 00:02:27.317 real 0m0.001s 00:02:27.317 user 0m0.000s 00:02:27.317 sys 0m0.001s 00:02:27.317 02:22:00 -- common/autotest_common.sh@1112 -- $ xtrace_disable 00:02:27.317 02:22:00 -- common/autotest_common.sh@10 -- $ set +x 00:02:27.317 ************************************ 00:02:27.317 END TEST ubsan 00:02:27.317 ************************************ 00:02:27.317 02:22:00 -- spdk/autobuild.sh@27 -- $ '[' -n '' ']' 00:02:27.317 02:22:00 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:02:27.317 02:22:00 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:02:27.317 02:22:00 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:02:27.317 02:22:00 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:02:27.317 02:22:00 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:02:27.317 02:22:00 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:02:27.317 02:22:00 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:02:27.317 02:22:00 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-shared 00:02:27.576 Using default SPDK env in /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk 00:02:27.576 Using default DPDK in /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build 00:02:27.835 Using 'verbs' RDMA provider 00:02:40.986 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-phy-autotest/spdk/.spdk-isal.log)...done. 00:02:53.237 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-phy-autotest/spdk/.spdk-isal-crypto.log)...done. 00:02:53.237 Creating mk/config.mk...done. 00:02:53.237 Creating mk/cc.flags.mk...done. 00:02:53.237 Type 'make' to build. 00:02:53.237 02:22:26 -- spdk/autobuild.sh@69 -- $ run_test make make -j72 00:02:53.237 02:22:26 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:02:53.237 02:22:26 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:02:53.237 02:22:26 -- common/autotest_common.sh@10 -- $ set +x 00:02:53.237 ************************************ 00:02:53.237 START TEST make 00:02:53.237 ************************************ 00:02:53.237 02:22:26 -- common/autotest_common.sh@1111 -- $ make -j72 00:02:53.496 make[1]: Nothing to be done for 'all'. 00:03:01.630 The Meson build system 00:03:01.630 Version: 1.3.1 00:03:01.630 Source dir: /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk 00:03:01.630 Build dir: /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build-tmp 00:03:01.630 Build type: native build 00:03:01.630 Program cat found: YES (/usr/bin/cat) 00:03:01.630 Project name: DPDK 00:03:01.630 Project version: 23.11.0 00:03:01.630 C compiler for the host machine: cc (gcc 13.2.1 "cc (GCC) 13.2.1 20231011 (Red Hat 13.2.1-4)") 00:03:01.630 C linker for the host machine: cc ld.bfd 2.39-16 00:03:01.630 Host machine cpu family: x86_64 00:03:01.630 Host machine cpu: x86_64 00:03:01.630 Message: ## Building in Developer Mode ## 00:03:01.630 Program pkg-config found: YES (/usr/bin/pkg-config) 00:03:01.630 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/buildtools/check-symbols.sh) 00:03:01.630 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/buildtools/options-ibverbs-static.sh) 00:03:01.630 Program python3 found: YES (/usr/bin/python3) 00:03:01.630 Program cat found: YES (/usr/bin/cat) 00:03:01.630 Compiler for C supports arguments -march=native: YES 00:03:01.630 Checking for size of "void *" : 8 00:03:01.630 Checking for size of "void *" : 8 (cached) 00:03:01.630 Library m found: YES 00:03:01.630 Library numa found: YES 00:03:01.630 Has header "numaif.h" : YES 00:03:01.630 Library fdt found: NO 00:03:01.630 Library execinfo found: NO 00:03:01.630 Has header "execinfo.h" : YES 00:03:01.630 Found pkg-config: YES (/usr/bin/pkg-config) 1.8.0 00:03:01.630 Run-time dependency libarchive found: NO (tried pkgconfig) 00:03:01.630 Run-time dependency libbsd found: NO (tried pkgconfig) 00:03:01.630 Run-time dependency jansson found: NO (tried pkgconfig) 00:03:01.630 Run-time dependency openssl found: YES 3.0.9 00:03:01.630 Run-time dependency libpcap found: YES 1.10.4 00:03:01.630 Has header "pcap.h" with dependency libpcap: YES 00:03:01.630 Compiler for C supports arguments -Wcast-qual: YES 00:03:01.630 Compiler for C supports arguments -Wdeprecated: YES 00:03:01.630 Compiler for C supports arguments -Wformat: YES 00:03:01.630 Compiler for C supports arguments -Wformat-nonliteral: NO 00:03:01.630 Compiler for C supports arguments -Wformat-security: NO 00:03:01.630 Compiler for C supports arguments -Wmissing-declarations: YES 00:03:01.630 Compiler for C supports arguments -Wmissing-prototypes: YES 00:03:01.630 Compiler for C supports arguments -Wnested-externs: YES 00:03:01.630 Compiler for C supports arguments -Wold-style-definition: YES 00:03:01.630 Compiler for C supports arguments -Wpointer-arith: YES 00:03:01.630 Compiler for C supports arguments -Wsign-compare: YES 00:03:01.630 Compiler for C supports arguments -Wstrict-prototypes: YES 00:03:01.630 Compiler for C supports arguments -Wundef: YES 00:03:01.630 Compiler for C supports arguments -Wwrite-strings: YES 00:03:01.630 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:03:01.630 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:03:01.630 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:03:01.630 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:03:01.630 Program objdump found: YES (/usr/bin/objdump) 00:03:01.630 Compiler for C supports arguments -mavx512f: YES 00:03:01.630 Checking if "AVX512 checking" compiles: YES 00:03:01.630 Fetching value of define "__SSE4_2__" : 1 00:03:01.630 Fetching value of define "__AES__" : 1 00:03:01.630 Fetching value of define "__AVX__" : 1 00:03:01.630 Fetching value of define "__AVX2__" : 1 00:03:01.630 Fetching value of define "__AVX512BW__" : 1 00:03:01.630 Fetching value of define "__AVX512CD__" : 1 00:03:01.630 Fetching value of define "__AVX512DQ__" : 1 00:03:01.630 Fetching value of define "__AVX512F__" : 1 00:03:01.630 Fetching value of define "__AVX512VL__" : 1 00:03:01.630 Fetching value of define "__PCLMUL__" : 1 00:03:01.630 Fetching value of define "__RDRND__" : 1 00:03:01.630 Fetching value of define "__RDSEED__" : 1 00:03:01.630 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:03:01.630 Fetching value of define "__znver1__" : (undefined) 00:03:01.630 Fetching value of define "__znver2__" : (undefined) 00:03:01.630 Fetching value of define "__znver3__" : (undefined) 00:03:01.630 Fetching value of define "__znver4__" : (undefined) 00:03:01.630 Compiler for C supports arguments -Wno-format-truncation: YES 00:03:01.630 Message: lib/log: Defining dependency "log" 00:03:01.630 Message: lib/kvargs: Defining dependency "kvargs" 00:03:01.630 Message: lib/telemetry: Defining dependency "telemetry" 00:03:01.630 Checking for function "getentropy" : NO 00:03:01.630 Message: lib/eal: Defining dependency "eal" 00:03:01.630 Message: lib/ring: Defining dependency "ring" 00:03:01.630 Message: lib/rcu: Defining dependency "rcu" 00:03:01.630 Message: lib/mempool: Defining dependency "mempool" 00:03:01.630 Message: lib/mbuf: Defining dependency "mbuf" 00:03:01.630 Fetching value of define "__PCLMUL__" : 1 (cached) 00:03:01.630 Fetching value of define "__AVX512F__" : 1 (cached) 00:03:01.630 Fetching value of define "__AVX512BW__" : 1 (cached) 00:03:01.630 Fetching value of define "__AVX512DQ__" : 1 (cached) 00:03:01.630 Fetching value of define "__AVX512VL__" : 1 (cached) 00:03:01.630 Fetching value of define "__VPCLMULQDQ__" : (undefined) (cached) 00:03:01.630 Compiler for C supports arguments -mpclmul: YES 00:03:01.630 Compiler for C supports arguments -maes: YES 00:03:01.630 Compiler for C supports arguments -mavx512f: YES (cached) 00:03:01.630 Compiler for C supports arguments -mavx512bw: YES 00:03:01.630 Compiler for C supports arguments -mavx512dq: YES 00:03:01.630 Compiler for C supports arguments -mavx512vl: YES 00:03:01.630 Compiler for C supports arguments -mvpclmulqdq: YES 00:03:01.630 Compiler for C supports arguments -mavx2: YES 00:03:01.630 Compiler for C supports arguments -mavx: YES 00:03:01.630 Message: lib/net: Defining dependency "net" 00:03:01.630 Message: lib/meter: Defining dependency "meter" 00:03:01.630 Message: lib/ethdev: Defining dependency "ethdev" 00:03:01.630 Message: lib/pci: Defining dependency "pci" 00:03:01.630 Message: lib/cmdline: Defining dependency "cmdline" 00:03:01.630 Message: lib/hash: Defining dependency "hash" 00:03:01.630 Message: lib/timer: Defining dependency "timer" 00:03:01.630 Message: lib/compressdev: Defining dependency "compressdev" 00:03:01.630 Message: lib/cryptodev: Defining dependency "cryptodev" 00:03:01.630 Message: lib/dmadev: Defining dependency "dmadev" 00:03:01.630 Compiler for C supports arguments -Wno-cast-qual: YES 00:03:01.630 Message: lib/power: Defining dependency "power" 00:03:01.630 Message: lib/reorder: Defining dependency "reorder" 00:03:01.630 Message: lib/security: Defining dependency "security" 00:03:01.630 Has header "linux/userfaultfd.h" : YES 00:03:01.630 Has header "linux/vduse.h" : YES 00:03:01.630 Message: lib/vhost: Defining dependency "vhost" 00:03:01.630 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:03:01.630 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:03:01.630 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:03:01.630 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:03:01.630 Message: Disabling raw/* drivers: missing internal dependency "rawdev" 00:03:01.630 Message: Disabling regex/* drivers: missing internal dependency "regexdev" 00:03:01.630 Message: Disabling ml/* drivers: missing internal dependency "mldev" 00:03:01.630 Message: Disabling event/* drivers: missing internal dependency "eventdev" 00:03:01.630 Message: Disabling baseband/* drivers: missing internal dependency "bbdev" 00:03:01.630 Message: Disabling gpu/* drivers: missing internal dependency "gpudev" 00:03:01.630 Program doxygen found: YES (/usr/bin/doxygen) 00:03:01.630 Configuring doxy-api-html.conf using configuration 00:03:01.630 Configuring doxy-api-man.conf using configuration 00:03:01.630 Program mandb found: YES (/usr/bin/mandb) 00:03:01.630 Program sphinx-build found: NO 00:03:01.630 Configuring rte_build_config.h using configuration 00:03:01.630 Message: 00:03:01.630 ================= 00:03:01.630 Applications Enabled 00:03:01.630 ================= 00:03:01.630 00:03:01.630 apps: 00:03:01.630 00:03:01.630 00:03:01.630 Message: 00:03:01.630 ================= 00:03:01.630 Libraries Enabled 00:03:01.630 ================= 00:03:01.630 00:03:01.630 libs: 00:03:01.630 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:03:01.630 net, meter, ethdev, pci, cmdline, hash, timer, compressdev, 00:03:01.630 cryptodev, dmadev, power, reorder, security, vhost, 00:03:01.630 00:03:01.630 Message: 00:03:01.630 =============== 00:03:01.630 Drivers Enabled 00:03:01.630 =============== 00:03:01.630 00:03:01.630 common: 00:03:01.630 00:03:01.630 bus: 00:03:01.630 pci, vdev, 00:03:01.630 mempool: 00:03:01.630 ring, 00:03:01.630 dma: 00:03:01.630 00:03:01.630 net: 00:03:01.630 00:03:01.630 crypto: 00:03:01.630 00:03:01.630 compress: 00:03:01.630 00:03:01.630 vdpa: 00:03:01.630 00:03:01.630 00:03:01.630 Message: 00:03:01.630 ================= 00:03:01.630 Content Skipped 00:03:01.630 ================= 00:03:01.630 00:03:01.630 apps: 00:03:01.630 dumpcap: explicitly disabled via build config 00:03:01.630 graph: explicitly disabled via build config 00:03:01.630 pdump: explicitly disabled via build config 00:03:01.630 proc-info: explicitly disabled via build config 00:03:01.630 test-acl: explicitly disabled via build config 00:03:01.630 test-bbdev: explicitly disabled via build config 00:03:01.630 test-cmdline: explicitly disabled via build config 00:03:01.630 test-compress-perf: explicitly disabled via build config 00:03:01.630 test-crypto-perf: explicitly disabled via build config 00:03:01.630 test-dma-perf: explicitly disabled via build config 00:03:01.630 test-eventdev: explicitly disabled via build config 00:03:01.630 test-fib: explicitly disabled via build config 00:03:01.630 test-flow-perf: explicitly disabled via build config 00:03:01.630 test-gpudev: explicitly disabled via build config 00:03:01.630 test-mldev: explicitly disabled via build config 00:03:01.630 test-pipeline: explicitly disabled via build config 00:03:01.630 test-pmd: explicitly disabled via build config 00:03:01.630 test-regex: explicitly disabled via build config 00:03:01.630 test-sad: explicitly disabled via build config 00:03:01.630 test-security-perf: explicitly disabled via build config 00:03:01.630 00:03:01.630 libs: 00:03:01.630 metrics: explicitly disabled via build config 00:03:01.630 acl: explicitly disabled via build config 00:03:01.630 bbdev: explicitly disabled via build config 00:03:01.630 bitratestats: explicitly disabled via build config 00:03:01.630 bpf: explicitly disabled via build config 00:03:01.630 cfgfile: explicitly disabled via build config 00:03:01.630 distributor: explicitly disabled via build config 00:03:01.630 efd: explicitly disabled via build config 00:03:01.630 eventdev: explicitly disabled via build config 00:03:01.630 dispatcher: explicitly disabled via build config 00:03:01.630 gpudev: explicitly disabled via build config 00:03:01.630 gro: explicitly disabled via build config 00:03:01.630 gso: explicitly disabled via build config 00:03:01.630 ip_frag: explicitly disabled via build config 00:03:01.630 jobstats: explicitly disabled via build config 00:03:01.630 latencystats: explicitly disabled via build config 00:03:01.630 lpm: explicitly disabled via build config 00:03:01.630 member: explicitly disabled via build config 00:03:01.630 pcapng: explicitly disabled via build config 00:03:01.630 rawdev: explicitly disabled via build config 00:03:01.630 regexdev: explicitly disabled via build config 00:03:01.630 mldev: explicitly disabled via build config 00:03:01.630 rib: explicitly disabled via build config 00:03:01.630 sched: explicitly disabled via build config 00:03:01.630 stack: explicitly disabled via build config 00:03:01.630 ipsec: explicitly disabled via build config 00:03:01.630 pdcp: explicitly disabled via build config 00:03:01.630 fib: explicitly disabled via build config 00:03:01.630 port: explicitly disabled via build config 00:03:01.630 pdump: explicitly disabled via build config 00:03:01.630 table: explicitly disabled via build config 00:03:01.630 pipeline: explicitly disabled via build config 00:03:01.630 graph: explicitly disabled via build config 00:03:01.630 node: explicitly disabled via build config 00:03:01.630 00:03:01.631 drivers: 00:03:01.631 common/cpt: not in enabled drivers build config 00:03:01.631 common/dpaax: not in enabled drivers build config 00:03:01.631 common/iavf: not in enabled drivers build config 00:03:01.631 common/idpf: not in enabled drivers build config 00:03:01.631 common/mvep: not in enabled drivers build config 00:03:01.631 common/octeontx: not in enabled drivers build config 00:03:01.631 bus/auxiliary: not in enabled drivers build config 00:03:01.631 bus/cdx: not in enabled drivers build config 00:03:01.631 bus/dpaa: not in enabled drivers build config 00:03:01.631 bus/fslmc: not in enabled drivers build config 00:03:01.631 bus/ifpga: not in enabled drivers build config 00:03:01.631 bus/platform: not in enabled drivers build config 00:03:01.631 bus/vmbus: not in enabled drivers build config 00:03:01.631 common/cnxk: not in enabled drivers build config 00:03:01.631 common/mlx5: not in enabled drivers build config 00:03:01.631 common/nfp: not in enabled drivers build config 00:03:01.631 common/qat: not in enabled drivers build config 00:03:01.631 common/sfc_efx: not in enabled drivers build config 00:03:01.631 mempool/bucket: not in enabled drivers build config 00:03:01.631 mempool/cnxk: not in enabled drivers build config 00:03:01.631 mempool/dpaa: not in enabled drivers build config 00:03:01.631 mempool/dpaa2: not in enabled drivers build config 00:03:01.631 mempool/octeontx: not in enabled drivers build config 00:03:01.631 mempool/stack: not in enabled drivers build config 00:03:01.631 dma/cnxk: not in enabled drivers build config 00:03:01.631 dma/dpaa: not in enabled drivers build config 00:03:01.631 dma/dpaa2: not in enabled drivers build config 00:03:01.631 dma/hisilicon: not in enabled drivers build config 00:03:01.631 dma/idxd: not in enabled drivers build config 00:03:01.631 dma/ioat: not in enabled drivers build config 00:03:01.631 dma/skeleton: not in enabled drivers build config 00:03:01.631 net/af_packet: not in enabled drivers build config 00:03:01.631 net/af_xdp: not in enabled drivers build config 00:03:01.631 net/ark: not in enabled drivers build config 00:03:01.631 net/atlantic: not in enabled drivers build config 00:03:01.631 net/avp: not in enabled drivers build config 00:03:01.631 net/axgbe: not in enabled drivers build config 00:03:01.631 net/bnx2x: not in enabled drivers build config 00:03:01.631 net/bnxt: not in enabled drivers build config 00:03:01.631 net/bonding: not in enabled drivers build config 00:03:01.631 net/cnxk: not in enabled drivers build config 00:03:01.631 net/cpfl: not in enabled drivers build config 00:03:01.631 net/cxgbe: not in enabled drivers build config 00:03:01.631 net/dpaa: not in enabled drivers build config 00:03:01.631 net/dpaa2: not in enabled drivers build config 00:03:01.631 net/e1000: not in enabled drivers build config 00:03:01.631 net/ena: not in enabled drivers build config 00:03:01.631 net/enetc: not in enabled drivers build config 00:03:01.631 net/enetfec: not in enabled drivers build config 00:03:01.631 net/enic: not in enabled drivers build config 00:03:01.631 net/failsafe: not in enabled drivers build config 00:03:01.631 net/fm10k: not in enabled drivers build config 00:03:01.631 net/gve: not in enabled drivers build config 00:03:01.631 net/hinic: not in enabled drivers build config 00:03:01.631 net/hns3: not in enabled drivers build config 00:03:01.631 net/i40e: not in enabled drivers build config 00:03:01.631 net/iavf: not in enabled drivers build config 00:03:01.631 net/ice: not in enabled drivers build config 00:03:01.631 net/idpf: not in enabled drivers build config 00:03:01.631 net/igc: not in enabled drivers build config 00:03:01.631 net/ionic: not in enabled drivers build config 00:03:01.631 net/ipn3ke: not in enabled drivers build config 00:03:01.631 net/ixgbe: not in enabled drivers build config 00:03:01.631 net/mana: not in enabled drivers build config 00:03:01.631 net/memif: not in enabled drivers build config 00:03:01.631 net/mlx4: not in enabled drivers build config 00:03:01.631 net/mlx5: not in enabled drivers build config 00:03:01.631 net/mvneta: not in enabled drivers build config 00:03:01.631 net/mvpp2: not in enabled drivers build config 00:03:01.631 net/netvsc: not in enabled drivers build config 00:03:01.631 net/nfb: not in enabled drivers build config 00:03:01.631 net/nfp: not in enabled drivers build config 00:03:01.631 net/ngbe: not in enabled drivers build config 00:03:01.631 net/null: not in enabled drivers build config 00:03:01.631 net/octeontx: not in enabled drivers build config 00:03:01.631 net/octeon_ep: not in enabled drivers build config 00:03:01.631 net/pcap: not in enabled drivers build config 00:03:01.631 net/pfe: not in enabled drivers build config 00:03:01.631 net/qede: not in enabled drivers build config 00:03:01.631 net/ring: not in enabled drivers build config 00:03:01.631 net/sfc: not in enabled drivers build config 00:03:01.631 net/softnic: not in enabled drivers build config 00:03:01.631 net/tap: not in enabled drivers build config 00:03:01.631 net/thunderx: not in enabled drivers build config 00:03:01.631 net/txgbe: not in enabled drivers build config 00:03:01.631 net/vdev_netvsc: not in enabled drivers build config 00:03:01.631 net/vhost: not in enabled drivers build config 00:03:01.631 net/virtio: not in enabled drivers build config 00:03:01.631 net/vmxnet3: not in enabled drivers build config 00:03:01.631 raw/*: missing internal dependency, "rawdev" 00:03:01.631 crypto/armv8: not in enabled drivers build config 00:03:01.631 crypto/bcmfs: not in enabled drivers build config 00:03:01.631 crypto/caam_jr: not in enabled drivers build config 00:03:01.631 crypto/ccp: not in enabled drivers build config 00:03:01.631 crypto/cnxk: not in enabled drivers build config 00:03:01.631 crypto/dpaa_sec: not in enabled drivers build config 00:03:01.631 crypto/dpaa2_sec: not in enabled drivers build config 00:03:01.631 crypto/ipsec_mb: not in enabled drivers build config 00:03:01.631 crypto/mlx5: not in enabled drivers build config 00:03:01.631 crypto/mvsam: not in enabled drivers build config 00:03:01.631 crypto/nitrox: not in enabled drivers build config 00:03:01.631 crypto/null: not in enabled drivers build config 00:03:01.631 crypto/octeontx: not in enabled drivers build config 00:03:01.631 crypto/openssl: not in enabled drivers build config 00:03:01.631 crypto/scheduler: not in enabled drivers build config 00:03:01.631 crypto/uadk: not in enabled drivers build config 00:03:01.631 crypto/virtio: not in enabled drivers build config 00:03:01.631 compress/isal: not in enabled drivers build config 00:03:01.631 compress/mlx5: not in enabled drivers build config 00:03:01.631 compress/octeontx: not in enabled drivers build config 00:03:01.631 compress/zlib: not in enabled drivers build config 00:03:01.631 regex/*: missing internal dependency, "regexdev" 00:03:01.631 ml/*: missing internal dependency, "mldev" 00:03:01.631 vdpa/ifc: not in enabled drivers build config 00:03:01.631 vdpa/mlx5: not in enabled drivers build config 00:03:01.631 vdpa/nfp: not in enabled drivers build config 00:03:01.631 vdpa/sfc: not in enabled drivers build config 00:03:01.631 event/*: missing internal dependency, "eventdev" 00:03:01.631 baseband/*: missing internal dependency, "bbdev" 00:03:01.631 gpu/*: missing internal dependency, "gpudev" 00:03:01.631 00:03:01.631 00:03:01.890 Build targets in project: 85 00:03:01.890 00:03:01.890 DPDK 23.11.0 00:03:01.890 00:03:01.890 User defined options 00:03:01.890 buildtype : debug 00:03:01.890 default_library : shared 00:03:01.890 libdir : lib 00:03:01.890 prefix : /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build 00:03:01.890 c_args : -Wno-stringop-overflow -fcommon -Wno-stringop-overread -Wno-array-bounds -fPIC -Werror 00:03:01.890 c_link_args : 00:03:01.890 cpu_instruction_set: native 00:03:01.890 disable_apps : test-acl,test-bbdev,test-crypto-perf,test-fib,test-pipeline,test-gpudev,test-flow-perf,pdump,dumpcap,test-sad,test-cmdline,test-eventdev,proc-info,test,test-dma-perf,test-pmd,test-mldev,test-compress-perf,test-security-perf,graph,test-regex 00:03:01.890 disable_libs : pipeline,member,eventdev,efd,bbdev,cfgfile,rib,sched,mldev,metrics,lpm,latencystats,pdump,pdcp,bpf,ipsec,fib,ip_frag,table,port,stack,gro,jobstats,regexdev,rawdev,pcapng,dispatcher,node,bitratestats,acl,gpudev,distributor,graph,gso 00:03:01.890 enable_docs : false 00:03:01.890 enable_drivers : bus,bus/pci,bus/vdev,mempool/ring 00:03:01.890 enable_kmods : false 00:03:01.890 tests : false 00:03:01.890 00:03:01.890 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:03:02.468 ninja: Entering directory `/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build-tmp' 00:03:02.468 [1/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:03:02.468 [2/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:03:02.468 [3/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:03:02.468 [4/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:03:02.468 [5/265] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:03:02.468 [6/265] Linking static target lib/librte_kvargs.a 00:03:02.468 [7/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:03:02.468 [8/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:03:02.468 [9/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:03:02.468 [10/265] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:03:02.468 [11/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:03:02.468 [12/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:03:02.468 [13/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:03:02.727 [14/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:03:02.727 [15/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:03:02.727 [16/265] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:03:02.727 [17/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:03:02.727 [18/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:03:02.727 [19/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:03:02.727 [20/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:03:02.727 [21/265] Compiling C object lib/librte_log.a.p/log_log.c.o 00:03:02.727 [22/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:03:02.727 [23/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:03:02.727 [24/265] Linking static target lib/librte_log.a 00:03:02.727 [25/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:03:02.989 [26/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:03:02.989 [27/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:03:02.989 [28/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:03:02.989 [29/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:03:02.989 [30/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:03:02.989 [31/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:03:02.989 [32/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:03:02.989 [33/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:03:02.989 [34/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:03:02.989 [35/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:03:02.989 [36/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:03:02.989 [37/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:03:02.989 [38/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:03:02.989 [39/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:03:02.989 [40/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:03:02.989 [41/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:03:02.989 [42/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:03:02.989 [43/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:03:02.989 [44/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:03:02.989 [45/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:03:02.989 [46/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:03:02.989 [47/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:03:02.989 [48/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:03:02.989 [49/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:03:02.989 [50/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:03:02.989 [51/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:03:02.989 [52/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:03:02.989 [53/265] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:03:02.989 [54/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:03:02.989 [55/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:03:02.989 [56/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:03:02.989 [57/265] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:03:02.989 [58/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:03:02.989 [59/265] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:03:02.989 [60/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:03:02.989 [61/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:03:02.989 [62/265] Linking static target lib/librte_ring.a 00:03:03.251 [63/265] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:03:03.251 [64/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:03:03.251 [65/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:03:03.251 [66/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:03:03.251 [67/265] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:03:03.251 [68/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:03:03.251 [69/265] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:03:03.251 [70/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:03:03.251 [71/265] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:03:03.251 [72/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:03:03.251 [73/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:03:03.251 [74/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:03:03.251 [75/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:03:03.251 [76/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:03:03.251 [77/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:03:03.251 [78/265] Linking static target lib/librte_pci.a 00:03:03.251 [79/265] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:03:03.251 [80/265] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:03:03.251 [81/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:03:03.251 [82/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:03:03.251 [83/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:03:03.251 [84/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:03:03.251 [85/265] Linking static target lib/librte_telemetry.a 00:03:03.251 [86/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:03:03.251 [87/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:03:03.251 [88/265] Linking static target lib/net/libnet_crc_avx512_lib.a 00:03:03.251 [89/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:03:03.251 [90/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:03:03.251 [91/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:03:03.251 [92/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:03:03.251 [93/265] Linking static target lib/librte_meter.a 00:03:03.251 [94/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:03:03.251 [95/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:03:03.251 [96/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:03:03.251 [97/265] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:03:03.251 [98/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:03:03.251 [99/265] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:03:03.251 [100/265] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:03:03.251 [101/265] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:03:03.251 [102/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:03:03.251 [103/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:03:03.251 [104/265] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:03:03.251 [105/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:03:03.251 [106/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:03:03.251 [107/265] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:03:03.251 [108/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:03:03.251 [109/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:03:03.251 [110/265] Linking static target lib/librte_rcu.a 00:03:03.251 [111/265] Linking static target lib/librte_mempool.a 00:03:03.251 [112/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:03:03.251 [113/265] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:03:03.251 [114/265] Linking static target lib/librte_eal.a 00:03:03.251 [115/265] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:03:03.251 [116/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:03:03.251 [117/265] Linking static target lib/librte_net.a 00:03:03.251 [118/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:03:03.251 [119/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:03:03.511 [120/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:03:03.511 [121/265] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:03:03.511 [122/265] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:03:03.511 [123/265] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:03:03.511 [124/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:03:03.511 [125/265] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:03:03.511 [126/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:03:03.511 [127/265] Linking static target lib/librte_mbuf.a 00:03:03.511 [128/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:03:03.511 [129/265] Linking static target lib/librte_cmdline.a 00:03:03.511 [130/265] Linking target lib/librte_log.so.24.0 00:03:03.511 [131/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:03:03.511 [132/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:03:03.511 [133/265] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:03:03.511 [134/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:03:03.511 [135/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:03:03.769 [136/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:03:03.769 [137/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:03:03.769 [138/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:03:03.769 [139/265] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:03:03.769 [140/265] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:03:03.769 [141/265] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:03:03.769 [142/265] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:03:03.769 [143/265] Linking static target lib/librte_timer.a 00:03:03.769 [144/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:03:03.769 [145/265] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:03:03.769 [146/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:03:03.769 [147/265] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:03:03.769 [148/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:03:03.769 [149/265] Linking static target lib/librte_compressdev.a 00:03:03.769 [150/265] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:03:03.769 [151/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:03:03.769 [152/265] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:03:03.769 [153/265] Linking static target lib/librte_dmadev.a 00:03:03.769 [154/265] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:03:03.769 [155/265] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:03:03.769 [156/265] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:03:03.769 [157/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:03:03.769 [158/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:03:03.769 [159/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:03:03.769 [160/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:03:03.769 [161/265] Linking static target drivers/libtmp_rte_bus_vdev.a 00:03:03.769 [162/265] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:03:03.769 [163/265] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:03:03.769 [164/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:03:03.769 [165/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:03:03.769 [166/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:03:03.769 [167/265] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:03:03.769 [168/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:03:03.769 [169/265] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:03:03.769 [170/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:03:03.769 [171/265] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:03:03.769 [172/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:03:03.769 [173/265] Linking static target drivers/libtmp_rte_mempool_ring.a 00:03:03.769 [174/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:03:03.769 [175/265] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:03:03.769 [176/265] Linking static target drivers/libtmp_rte_bus_pci.a 00:03:03.769 [177/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:03:03.769 [178/265] Linking target lib/librte_telemetry.so.24.0 00:03:03.769 [179/265] Linking target lib/librte_kvargs.so.24.0 00:03:03.769 [180/265] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:03:03.769 [181/265] Linking static target lib/librte_power.a 00:03:03.769 [182/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:03:03.769 [183/265] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:03:03.769 [184/265] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:03:03.769 [185/265] Linking static target lib/librte_reorder.a 00:03:04.027 [186/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:03:04.027 [187/265] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:03:04.027 [188/265] Linking static target lib/librte_security.a 00:03:04.027 [189/265] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:03:04.027 [190/265] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:03:04.027 [191/265] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:03:04.027 [192/265] Linking static target lib/librte_hash.a 00:03:04.027 [193/265] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:03:04.027 [194/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:03:04.027 [195/265] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:03:04.027 [196/265] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:03:04.027 [197/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:03:04.027 [198/265] Linking static target drivers/librte_bus_vdev.a 00:03:04.027 [199/265] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:03:04.027 [200/265] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:03:04.027 [201/265] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:03:04.027 [202/265] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:03:04.027 [203/265] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:03:04.027 [204/265] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:03:04.027 [205/265] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:03:04.027 [206/265] Linking static target drivers/librte_bus_pci.a 00:03:04.027 [207/265] Linking static target drivers/librte_mempool_ring.a 00:03:04.027 [208/265] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:03:04.027 [209/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:03:04.286 [210/265] Linking static target lib/librte_cryptodev.a 00:03:04.286 [211/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:03:04.286 [212/265] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:03:04.286 [213/265] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:03:04.286 [214/265] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:03:04.286 [215/265] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:03:04.286 [216/265] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:03:04.544 [217/265] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:03:04.544 [218/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:03:04.544 [219/265] Linking static target lib/librte_ethdev.a 00:03:04.544 [220/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:03:04.802 [221/265] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:03:04.802 [222/265] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:03:04.802 [223/265] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:03:04.802 [224/265] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:03:05.736 [225/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:03:05.736 [226/265] Linking static target lib/librte_vhost.a 00:03:06.303 [227/265] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:03:08.202 [228/265] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:03:14.773 [229/265] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:03:15.032 [230/265] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:03:15.290 [231/265] Linking target lib/librte_eal.so.24.0 00:03:15.290 [232/265] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:03:15.290 [233/265] Linking target lib/librte_pci.so.24.0 00:03:15.290 [234/265] Linking target lib/librte_ring.so.24.0 00:03:15.290 [235/265] Linking target lib/librte_meter.so.24.0 00:03:15.290 [236/265] Linking target lib/librte_timer.so.24.0 00:03:15.290 [237/265] Linking target drivers/librte_bus_vdev.so.24.0 00:03:15.290 [238/265] Linking target lib/librte_dmadev.so.24.0 00:03:15.550 [239/265] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:03:15.550 [240/265] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:03:15.550 [241/265] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:03:15.550 [242/265] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:03:15.550 [243/265] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:03:15.550 [244/265] Linking target drivers/librte_bus_pci.so.24.0 00:03:15.550 [245/265] Linking target lib/librte_mempool.so.24.0 00:03:15.550 [246/265] Linking target lib/librte_rcu.so.24.0 00:03:15.809 [247/265] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:03:15.809 [248/265] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:03:15.809 [249/265] Linking target drivers/librte_mempool_ring.so.24.0 00:03:15.809 [250/265] Linking target lib/librte_mbuf.so.24.0 00:03:16.068 [251/265] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:03:16.068 [252/265] Linking target lib/librte_cryptodev.so.24.0 00:03:16.068 [253/265] Linking target lib/librte_net.so.24.0 00:03:16.068 [254/265] Linking target lib/librte_compressdev.so.24.0 00:03:16.068 [255/265] Linking target lib/librte_reorder.so.24.0 00:03:16.068 [256/265] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:03:16.068 [257/265] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:03:16.326 [258/265] Linking target lib/librte_security.so.24.0 00:03:16.326 [259/265] Linking target lib/librte_hash.so.24.0 00:03:16.326 [260/265] Linking target lib/librte_cmdline.so.24.0 00:03:16.326 [261/265] Linking target lib/librte_ethdev.so.24.0 00:03:16.326 [262/265] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:03:16.326 [263/265] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:03:16.326 [264/265] Linking target lib/librte_power.so.24.0 00:03:16.326 [265/265] Linking target lib/librte_vhost.so.24.0 00:03:16.326 INFO: autodetecting backend as ninja 00:03:16.326 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build-tmp -j 72 00:03:17.739 CC lib/log/log.o 00:03:17.739 CC lib/log/log_flags.o 00:03:17.739 CC lib/log/log_deprecated.o 00:03:17.739 CC lib/ut/ut.o 00:03:17.739 CC lib/ut_mock/mock.o 00:03:17.739 LIB libspdk_ut.a 00:03:17.739 LIB libspdk_log.a 00:03:17.739 LIB libspdk_ut_mock.a 00:03:17.739 SO libspdk_ut.so.2.0 00:03:17.739 SO libspdk_log.so.7.0 00:03:17.739 SO libspdk_ut_mock.so.6.0 00:03:17.739 SYMLINK libspdk_ut.so 00:03:17.739 SYMLINK libspdk_ut_mock.so 00:03:17.739 SYMLINK libspdk_log.so 00:03:17.997 CC lib/util/base64.o 00:03:17.997 CC lib/util/bit_array.o 00:03:17.997 CC lib/util/cpuset.o 00:03:17.997 CC lib/util/crc32.o 00:03:17.997 CC lib/util/crc16.o 00:03:17.997 CC lib/util/crc32c.o 00:03:17.997 CC lib/util/crc64.o 00:03:17.997 CC lib/util/crc32_ieee.o 00:03:17.997 CC lib/util/dif.o 00:03:17.997 CC lib/util/fd.o 00:03:17.997 CC lib/ioat/ioat.o 00:03:17.997 CC lib/util/file.o 00:03:17.997 CC lib/util/hexlify.o 00:03:17.997 CC lib/util/math.o 00:03:17.997 CC lib/util/iov.o 00:03:17.997 CC lib/util/strerror_tls.o 00:03:17.997 CC lib/util/pipe.o 00:03:17.997 CC lib/util/string.o 00:03:17.997 CXX lib/trace_parser/trace.o 00:03:17.997 CC lib/util/uuid.o 00:03:17.997 CC lib/util/fd_group.o 00:03:17.997 CC lib/util/xor.o 00:03:17.997 CC lib/util/zipf.o 00:03:17.997 CC lib/dma/dma.o 00:03:18.256 LIB libspdk_dma.a 00:03:18.256 CC lib/vfio_user/host/vfio_user.o 00:03:18.256 CC lib/vfio_user/host/vfio_user_pci.o 00:03:18.256 SO libspdk_dma.so.4.0 00:03:18.256 LIB libspdk_ioat.a 00:03:18.514 SO libspdk_ioat.so.7.0 00:03:18.514 SYMLINK libspdk_dma.so 00:03:18.514 SYMLINK libspdk_ioat.so 00:03:18.514 LIB libspdk_vfio_user.a 00:03:18.514 LIB libspdk_util.a 00:03:18.514 SO libspdk_vfio_user.so.5.0 00:03:18.514 SO libspdk_util.so.9.0 00:03:18.772 SYMLINK libspdk_vfio_user.so 00:03:18.772 SYMLINK libspdk_util.so 00:03:18.772 LIB libspdk_trace_parser.a 00:03:18.772 SO libspdk_trace_parser.so.5.0 00:03:19.030 SYMLINK libspdk_trace_parser.so 00:03:19.030 CC lib/json/json_parse.o 00:03:19.030 CC lib/json/json_write.o 00:03:19.030 CC lib/json/json_util.o 00:03:19.030 CC lib/idxd/idxd.o 00:03:19.030 CC lib/idxd/idxd_user.o 00:03:19.030 CC lib/rdma/common.o 00:03:19.030 CC lib/conf/conf.o 00:03:19.030 CC lib/env_dpdk/env.o 00:03:19.030 CC lib/rdma/rdma_verbs.o 00:03:19.030 CC lib/vmd/vmd.o 00:03:19.030 CC lib/env_dpdk/memory.o 00:03:19.030 CC lib/vmd/led.o 00:03:19.030 CC lib/env_dpdk/pci.o 00:03:19.030 CC lib/env_dpdk/init.o 00:03:19.030 CC lib/env_dpdk/threads.o 00:03:19.030 CC lib/env_dpdk/pci_virtio.o 00:03:19.030 CC lib/env_dpdk/pci_ioat.o 00:03:19.030 CC lib/env_dpdk/pci_vmd.o 00:03:19.030 CC lib/env_dpdk/pci_idxd.o 00:03:19.030 CC lib/env_dpdk/pci_event.o 00:03:19.030 CC lib/env_dpdk/sigbus_handler.o 00:03:19.030 CC lib/env_dpdk/pci_dpdk.o 00:03:19.030 CC lib/env_dpdk/pci_dpdk_2207.o 00:03:19.030 CC lib/env_dpdk/pci_dpdk_2211.o 00:03:19.289 LIB libspdk_conf.a 00:03:19.289 LIB libspdk_json.a 00:03:19.289 LIB libspdk_rdma.a 00:03:19.289 SO libspdk_conf.so.6.0 00:03:19.547 SO libspdk_rdma.so.6.0 00:03:19.547 SO libspdk_json.so.6.0 00:03:19.547 SYMLINK libspdk_conf.so 00:03:19.547 SYMLINK libspdk_rdma.so 00:03:19.547 SYMLINK libspdk_json.so 00:03:19.547 LIB libspdk_idxd.a 00:03:19.547 SO libspdk_idxd.so.12.0 00:03:19.547 LIB libspdk_vmd.a 00:03:19.547 SYMLINK libspdk_idxd.so 00:03:19.805 SO libspdk_vmd.so.6.0 00:03:19.805 SYMLINK libspdk_vmd.so 00:03:19.805 CC lib/jsonrpc/jsonrpc_server.o 00:03:19.805 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:03:19.805 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:03:19.805 CC lib/jsonrpc/jsonrpc_client.o 00:03:20.063 LIB libspdk_jsonrpc.a 00:03:20.063 SO libspdk_jsonrpc.so.6.0 00:03:20.063 SYMLINK libspdk_jsonrpc.so 00:03:20.063 LIB libspdk_env_dpdk.a 00:03:20.323 SO libspdk_env_dpdk.so.14.0 00:03:20.323 SYMLINK libspdk_env_dpdk.so 00:03:20.582 CC lib/rpc/rpc.o 00:03:20.582 LIB libspdk_rpc.a 00:03:20.582 SO libspdk_rpc.so.6.0 00:03:20.841 SYMLINK libspdk_rpc.so 00:03:21.100 CC lib/trace/trace.o 00:03:21.100 CC lib/trace/trace_flags.o 00:03:21.100 CC lib/trace/trace_rpc.o 00:03:21.100 CC lib/notify/notify_rpc.o 00:03:21.100 CC lib/notify/notify.o 00:03:21.100 CC lib/keyring/keyring.o 00:03:21.100 CC lib/keyring/keyring_rpc.o 00:03:21.358 LIB libspdk_notify.a 00:03:21.358 LIB libspdk_trace.a 00:03:21.358 SO libspdk_notify.so.6.0 00:03:21.358 LIB libspdk_keyring.a 00:03:21.358 SO libspdk_trace.so.10.0 00:03:21.358 SYMLINK libspdk_notify.so 00:03:21.358 SO libspdk_keyring.so.1.0 00:03:21.358 SYMLINK libspdk_trace.so 00:03:21.358 SYMLINK libspdk_keyring.so 00:03:21.617 CC lib/sock/sock.o 00:03:21.617 CC lib/sock/sock_rpc.o 00:03:21.617 CC lib/thread/thread.o 00:03:21.875 CC lib/thread/iobuf.o 00:03:22.134 LIB libspdk_sock.a 00:03:22.134 SO libspdk_sock.so.9.0 00:03:22.134 SYMLINK libspdk_sock.so 00:03:22.393 CC lib/nvme/nvme_fabric.o 00:03:22.393 CC lib/nvme/nvme_ctrlr_cmd.o 00:03:22.393 CC lib/nvme/nvme_ctrlr.o 00:03:22.393 CC lib/nvme/nvme_ns_cmd.o 00:03:22.393 CC lib/nvme/nvme_ns.o 00:03:22.393 CC lib/nvme/nvme_pcie_common.o 00:03:22.393 CC lib/nvme/nvme_pcie.o 00:03:22.393 CC lib/nvme/nvme_qpair.o 00:03:22.393 CC lib/nvme/nvme.o 00:03:22.393 CC lib/nvme/nvme_transport.o 00:03:22.393 CC lib/nvme/nvme_quirks.o 00:03:22.393 CC lib/nvme/nvme_discovery.o 00:03:22.393 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:03:22.393 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:03:22.393 CC lib/nvme/nvme_tcp.o 00:03:22.393 CC lib/nvme/nvme_opal.o 00:03:22.393 CC lib/nvme/nvme_poll_group.o 00:03:22.393 CC lib/nvme/nvme_io_msg.o 00:03:22.393 CC lib/nvme/nvme_stubs.o 00:03:22.393 CC lib/nvme/nvme_zns.o 00:03:22.393 CC lib/nvme/nvme_auth.o 00:03:22.393 CC lib/nvme/nvme_cuse.o 00:03:22.393 CC lib/nvme/nvme_rdma.o 00:03:22.959 LIB libspdk_thread.a 00:03:22.959 SO libspdk_thread.so.10.0 00:03:22.959 SYMLINK libspdk_thread.so 00:03:23.217 CC lib/accel/accel_rpc.o 00:03:23.217 CC lib/accel/accel.o 00:03:23.217 CC lib/accel/accel_sw.o 00:03:23.217 CC lib/blob/request.o 00:03:23.217 CC lib/blob/blobstore.o 00:03:23.217 CC lib/blob/blob_bs_dev.o 00:03:23.217 CC lib/blob/zeroes.o 00:03:23.217 CC lib/init/subsystem_rpc.o 00:03:23.217 CC lib/init/json_config.o 00:03:23.217 CC lib/init/subsystem.o 00:03:23.217 CC lib/init/rpc.o 00:03:23.217 CC lib/virtio/virtio_vfio_user.o 00:03:23.217 CC lib/virtio/virtio.o 00:03:23.217 CC lib/virtio/virtio_vhost_user.o 00:03:23.217 CC lib/virtio/virtio_pci.o 00:03:23.474 LIB libspdk_init.a 00:03:23.474 SO libspdk_init.so.5.0 00:03:23.474 LIB libspdk_virtio.a 00:03:23.732 SYMLINK libspdk_init.so 00:03:23.732 SO libspdk_virtio.so.7.0 00:03:23.732 SYMLINK libspdk_virtio.so 00:03:23.990 CC lib/event/app.o 00:03:23.990 CC lib/event/reactor.o 00:03:23.990 CC lib/event/app_rpc.o 00:03:23.990 CC lib/event/log_rpc.o 00:03:23.990 CC lib/event/scheduler_static.o 00:03:23.990 LIB libspdk_accel.a 00:03:23.990 SO libspdk_accel.so.15.0 00:03:23.990 LIB libspdk_nvme.a 00:03:24.249 SYMLINK libspdk_accel.so 00:03:24.249 SO libspdk_nvme.so.13.0 00:03:24.249 LIB libspdk_event.a 00:03:24.249 SO libspdk_event.so.13.0 00:03:24.508 SYMLINK libspdk_event.so 00:03:24.508 CC lib/bdev/bdev.o 00:03:24.508 CC lib/bdev/bdev_rpc.o 00:03:24.508 CC lib/bdev/bdev_zone.o 00:03:24.508 CC lib/bdev/part.o 00:03:24.508 CC lib/bdev/scsi_nvme.o 00:03:24.508 SYMLINK libspdk_nvme.so 00:03:25.443 LIB libspdk_blob.a 00:03:25.443 SO libspdk_blob.so.11.0 00:03:25.443 SYMLINK libspdk_blob.so 00:03:25.702 CC lib/lvol/lvol.o 00:03:25.702 CC lib/blobfs/blobfs.o 00:03:25.702 CC lib/blobfs/tree.o 00:03:26.268 LIB libspdk_bdev.a 00:03:26.268 SO libspdk_bdev.so.15.0 00:03:26.269 LIB libspdk_blobfs.a 00:03:26.526 SO libspdk_blobfs.so.10.0 00:03:26.526 LIB libspdk_lvol.a 00:03:26.526 SYMLINK libspdk_bdev.so 00:03:26.526 SO libspdk_lvol.so.10.0 00:03:26.526 SYMLINK libspdk_blobfs.so 00:03:26.526 SYMLINK libspdk_lvol.so 00:03:26.785 CC lib/ublk/ublk_rpc.o 00:03:26.785 CC lib/ublk/ublk.o 00:03:26.785 CC lib/nbd/nbd.o 00:03:26.785 CC lib/nbd/nbd_rpc.o 00:03:26.785 CC lib/scsi/dev.o 00:03:26.785 CC lib/scsi/lun.o 00:03:26.785 CC lib/scsi/port.o 00:03:26.785 CC lib/scsi/scsi.o 00:03:26.785 CC lib/nvmf/ctrlr.o 00:03:26.785 CC lib/scsi/scsi_pr.o 00:03:26.785 CC lib/scsi/scsi_rpc.o 00:03:26.785 CC lib/scsi/scsi_bdev.o 00:03:26.785 CC lib/scsi/task.o 00:03:26.785 CC lib/nvmf/ctrlr_discovery.o 00:03:26.785 CC lib/nvmf/ctrlr_bdev.o 00:03:26.785 CC lib/nvmf/subsystem.o 00:03:26.785 CC lib/nvmf/nvmf.o 00:03:26.785 CC lib/nvmf/nvmf_rpc.o 00:03:26.785 CC lib/nvmf/transport.o 00:03:26.785 CC lib/nvmf/tcp.o 00:03:26.785 CC lib/nvmf/rdma.o 00:03:26.785 CC lib/ftl/ftl_init.o 00:03:26.785 CC lib/ftl/ftl_core.o 00:03:26.785 CC lib/ftl/ftl_layout.o 00:03:26.785 CC lib/ftl/ftl_debug.o 00:03:26.785 CC lib/ftl/ftl_io.o 00:03:26.785 CC lib/ftl/ftl_sb.o 00:03:26.785 CC lib/ftl/ftl_l2p.o 00:03:26.785 CC lib/ftl/ftl_l2p_flat.o 00:03:26.785 CC lib/ftl/ftl_nv_cache.o 00:03:26.785 CC lib/ftl/ftl_band.o 00:03:26.785 CC lib/ftl/ftl_band_ops.o 00:03:26.785 CC lib/ftl/ftl_writer.o 00:03:26.785 CC lib/ftl/ftl_rq.o 00:03:26.785 CC lib/ftl/ftl_reloc.o 00:03:26.785 CC lib/ftl/ftl_l2p_cache.o 00:03:26.785 CC lib/ftl/ftl_p2l.o 00:03:26.785 CC lib/ftl/mngt/ftl_mngt.o 00:03:26.785 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:03:26.785 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:03:26.785 CC lib/ftl/mngt/ftl_mngt_startup.o 00:03:26.785 CC lib/ftl/mngt/ftl_mngt_misc.o 00:03:26.785 CC lib/ftl/mngt/ftl_mngt_md.o 00:03:26.785 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:03:26.785 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:03:26.785 CC lib/ftl/mngt/ftl_mngt_band.o 00:03:26.785 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:03:26.785 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:03:26.785 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:03:26.785 CC lib/ftl/utils/ftl_conf.o 00:03:26.785 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:03:26.785 CC lib/ftl/utils/ftl_mempool.o 00:03:26.785 CC lib/ftl/utils/ftl_md.o 00:03:26.785 CC lib/ftl/utils/ftl_bitmap.o 00:03:26.785 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:03:26.785 CC lib/ftl/utils/ftl_property.o 00:03:26.785 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:03:26.785 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:03:26.785 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:03:26.785 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:03:26.785 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:03:26.785 CC lib/ftl/upgrade/ftl_sb_v3.o 00:03:26.785 CC lib/ftl/upgrade/ftl_sb_v5.o 00:03:26.785 CC lib/ftl/nvc/ftl_nvc_dev.o 00:03:26.785 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:03:26.785 CC lib/ftl/base/ftl_base_dev.o 00:03:26.785 CC lib/ftl/base/ftl_base_bdev.o 00:03:26.785 CC lib/ftl/ftl_trace.o 00:03:27.351 LIB libspdk_nbd.a 00:03:27.351 SO libspdk_nbd.so.7.0 00:03:27.611 SYMLINK libspdk_nbd.so 00:03:27.611 LIB libspdk_ublk.a 00:03:27.611 LIB libspdk_scsi.a 00:03:27.611 SO libspdk_ublk.so.3.0 00:03:27.611 SO libspdk_scsi.so.9.0 00:03:27.611 SYMLINK libspdk_ublk.so 00:03:27.611 SYMLINK libspdk_scsi.so 00:03:27.869 LIB libspdk_ftl.a 00:03:27.869 CC lib/vhost/vhost.o 00:03:27.869 CC lib/vhost/vhost_scsi.o 00:03:27.869 CC lib/iscsi/conn.o 00:03:27.869 CC lib/iscsi/init_grp.o 00:03:27.869 CC lib/vhost/vhost_rpc.o 00:03:27.869 CC lib/vhost/rte_vhost_user.o 00:03:27.869 CC lib/vhost/vhost_blk.o 00:03:27.869 CC lib/iscsi/iscsi.o 00:03:27.869 CC lib/iscsi/md5.o 00:03:27.869 CC lib/iscsi/param.o 00:03:27.869 CC lib/iscsi/portal_grp.o 00:03:27.869 CC lib/iscsi/iscsi_rpc.o 00:03:27.869 CC lib/iscsi/tgt_node.o 00:03:27.869 CC lib/iscsi/task.o 00:03:27.869 CC lib/iscsi/iscsi_subsystem.o 00:03:27.869 SO libspdk_ftl.so.9.0 00:03:28.436 SYMLINK libspdk_ftl.so 00:03:28.694 LIB libspdk_nvmf.a 00:03:28.694 SO libspdk_nvmf.so.18.0 00:03:28.694 LIB libspdk_vhost.a 00:03:28.694 SYMLINK libspdk_nvmf.so 00:03:28.694 SO libspdk_vhost.so.8.0 00:03:28.953 SYMLINK libspdk_vhost.so 00:03:28.953 LIB libspdk_iscsi.a 00:03:28.953 SO libspdk_iscsi.so.8.0 00:03:29.212 SYMLINK libspdk_iscsi.so 00:03:29.781 CC module/env_dpdk/env_dpdk_rpc.o 00:03:29.781 CC module/scheduler/dynamic/scheduler_dynamic.o 00:03:29.781 LIB libspdk_env_dpdk_rpc.a 00:03:29.781 CC module/scheduler/gscheduler/gscheduler.o 00:03:29.781 CC module/blob/bdev/blob_bdev.o 00:03:29.781 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:03:29.781 CC module/accel/iaa/accel_iaa_rpc.o 00:03:29.781 CC module/accel/iaa/accel_iaa.o 00:03:29.781 CC module/keyring/file/keyring.o 00:03:29.781 CC module/accel/dsa/accel_dsa.o 00:03:29.781 CC module/accel/ioat/accel_ioat.o 00:03:29.781 CC module/keyring/file/keyring_rpc.o 00:03:29.781 CC module/accel/ioat/accel_ioat_rpc.o 00:03:29.781 CC module/sock/posix/posix.o 00:03:29.781 CC module/accel/dsa/accel_dsa_rpc.o 00:03:29.781 CC module/accel/error/accel_error.o 00:03:29.781 CC module/accel/error/accel_error_rpc.o 00:03:29.781 SO libspdk_env_dpdk_rpc.so.6.0 00:03:30.040 SYMLINK libspdk_env_dpdk_rpc.so 00:03:30.040 LIB libspdk_scheduler_dynamic.a 00:03:30.040 LIB libspdk_keyring_file.a 00:03:30.040 LIB libspdk_scheduler_dpdk_governor.a 00:03:30.040 LIB libspdk_scheduler_gscheduler.a 00:03:30.040 SO libspdk_scheduler_dynamic.so.4.0 00:03:30.040 SO libspdk_scheduler_dpdk_governor.so.4.0 00:03:30.040 SO libspdk_keyring_file.so.1.0 00:03:30.040 LIB libspdk_accel_ioat.a 00:03:30.040 LIB libspdk_accel_error.a 00:03:30.040 LIB libspdk_accel_iaa.a 00:03:30.040 SO libspdk_scheduler_gscheduler.so.4.0 00:03:30.040 SYMLINK libspdk_scheduler_dpdk_governor.so 00:03:30.040 LIB libspdk_blob_bdev.a 00:03:30.040 SO libspdk_accel_ioat.so.6.0 00:03:30.040 SYMLINK libspdk_scheduler_dynamic.so 00:03:30.040 LIB libspdk_accel_dsa.a 00:03:30.040 SO libspdk_accel_error.so.2.0 00:03:30.040 SO libspdk_accel_iaa.so.3.0 00:03:30.040 SYMLINK libspdk_keyring_file.so 00:03:30.040 SO libspdk_blob_bdev.so.11.0 00:03:30.040 SYMLINK libspdk_scheduler_gscheduler.so 00:03:30.040 SO libspdk_accel_dsa.so.5.0 00:03:30.040 SYMLINK libspdk_accel_error.so 00:03:30.040 SYMLINK libspdk_accel_ioat.so 00:03:30.040 SYMLINK libspdk_accel_iaa.so 00:03:30.299 SYMLINK libspdk_blob_bdev.so 00:03:30.299 SYMLINK libspdk_accel_dsa.so 00:03:30.560 LIB libspdk_sock_posix.a 00:03:30.560 SO libspdk_sock_posix.so.6.0 00:03:30.560 SYMLINK libspdk_sock_posix.so 00:03:30.560 CC module/blobfs/bdev/blobfs_bdev.o 00:03:30.560 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:03:30.560 CC module/bdev/delay/vbdev_delay_rpc.o 00:03:30.560 CC module/bdev/lvol/vbdev_lvol.o 00:03:30.560 CC module/bdev/delay/vbdev_delay.o 00:03:30.560 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:03:30.560 CC module/bdev/null/bdev_null.o 00:03:30.560 CC module/bdev/null/bdev_null_rpc.o 00:03:30.560 CC module/bdev/gpt/gpt.o 00:03:30.560 CC module/bdev/gpt/vbdev_gpt.o 00:03:30.560 CC module/bdev/split/vbdev_split.o 00:03:30.560 CC module/bdev/split/vbdev_split_rpc.o 00:03:30.560 CC module/bdev/error/vbdev_error.o 00:03:30.560 CC module/bdev/error/vbdev_error_rpc.o 00:03:30.560 CC module/bdev/malloc/bdev_malloc.o 00:03:30.560 CC module/bdev/malloc/bdev_malloc_rpc.o 00:03:30.560 CC module/bdev/passthru/vbdev_passthru.o 00:03:30.560 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:03:30.560 CC module/bdev/ftl/bdev_ftl_rpc.o 00:03:30.560 CC module/bdev/aio/bdev_aio.o 00:03:30.560 CC module/bdev/zone_block/vbdev_zone_block.o 00:03:30.560 CC module/bdev/ftl/bdev_ftl.o 00:03:30.560 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:03:30.560 CC module/bdev/aio/bdev_aio_rpc.o 00:03:30.560 CC module/bdev/virtio/bdev_virtio_scsi.o 00:03:30.560 CC module/bdev/virtio/bdev_virtio_rpc.o 00:03:30.820 CC module/bdev/nvme/bdev_nvme.o 00:03:30.820 CC module/bdev/virtio/bdev_virtio_blk.o 00:03:30.820 CC module/bdev/nvme/bdev_nvme_rpc.o 00:03:30.820 CC module/bdev/nvme/bdev_mdns_client.o 00:03:30.820 CC module/bdev/nvme/nvme_rpc.o 00:03:30.820 CC module/bdev/nvme/vbdev_opal_rpc.o 00:03:30.820 CC module/bdev/nvme/vbdev_opal.o 00:03:30.820 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:03:30.820 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:03:30.820 CC module/bdev/iscsi/bdev_iscsi.o 00:03:30.820 CC module/bdev/raid/bdev_raid.o 00:03:30.820 CC module/bdev/raid/bdev_raid_rpc.o 00:03:30.820 CC module/bdev/raid/bdev_raid_sb.o 00:03:30.820 CC module/bdev/raid/raid0.o 00:03:30.820 CC module/bdev/raid/raid1.o 00:03:30.820 CC module/bdev/raid/concat.o 00:03:30.820 LIB libspdk_blobfs_bdev.a 00:03:30.820 SO libspdk_blobfs_bdev.so.6.0 00:03:30.820 LIB libspdk_bdev_split.a 00:03:30.820 LIB libspdk_bdev_gpt.a 00:03:30.820 SYMLINK libspdk_blobfs_bdev.so 00:03:30.820 LIB libspdk_bdev_null.a 00:03:31.080 LIB libspdk_bdev_error.a 00:03:31.080 SO libspdk_bdev_split.so.6.0 00:03:31.080 SO libspdk_bdev_gpt.so.6.0 00:03:31.080 SO libspdk_bdev_null.so.6.0 00:03:31.080 SO libspdk_bdev_error.so.6.0 00:03:31.080 LIB libspdk_bdev_ftl.a 00:03:31.080 SYMLINK libspdk_bdev_split.so 00:03:31.080 LIB libspdk_bdev_delay.a 00:03:31.080 LIB libspdk_bdev_aio.a 00:03:31.080 SYMLINK libspdk_bdev_gpt.so 00:03:31.080 LIB libspdk_bdev_zone_block.a 00:03:31.080 SO libspdk_bdev_ftl.so.6.0 00:03:31.080 LIB libspdk_bdev_malloc.a 00:03:31.080 SYMLINK libspdk_bdev_null.so 00:03:31.080 SO libspdk_bdev_delay.so.6.0 00:03:31.080 LIB libspdk_bdev_passthru.a 00:03:31.080 SYMLINK libspdk_bdev_error.so 00:03:31.080 LIB libspdk_bdev_iscsi.a 00:03:31.080 SO libspdk_bdev_aio.so.6.0 00:03:31.080 SO libspdk_bdev_malloc.so.6.0 00:03:31.080 SO libspdk_bdev_zone_block.so.6.0 00:03:31.080 SO libspdk_bdev_iscsi.so.6.0 00:03:31.080 SO libspdk_bdev_passthru.so.6.0 00:03:31.080 SYMLINK libspdk_bdev_ftl.so 00:03:31.080 SYMLINK libspdk_bdev_delay.so 00:03:31.080 SYMLINK libspdk_bdev_aio.so 00:03:31.080 LIB libspdk_bdev_lvol.a 00:03:31.080 SYMLINK libspdk_bdev_zone_block.so 00:03:31.080 SYMLINK libspdk_bdev_malloc.so 00:03:31.080 SYMLINK libspdk_bdev_iscsi.so 00:03:31.080 SYMLINK libspdk_bdev_passthru.so 00:03:31.080 SO libspdk_bdev_lvol.so.6.0 00:03:31.340 LIB libspdk_bdev_virtio.a 00:03:31.340 SYMLINK libspdk_bdev_lvol.so 00:03:31.340 SO libspdk_bdev_virtio.so.6.0 00:03:31.340 SYMLINK libspdk_bdev_virtio.so 00:03:31.600 LIB libspdk_bdev_raid.a 00:03:31.600 SO libspdk_bdev_raid.so.6.0 00:03:31.600 SYMLINK libspdk_bdev_raid.so 00:03:32.538 LIB libspdk_bdev_nvme.a 00:03:32.538 SO libspdk_bdev_nvme.so.7.0 00:03:32.538 SYMLINK libspdk_bdev_nvme.so 00:03:33.106 CC module/event/subsystems/sock/sock.o 00:03:33.106 CC module/event/subsystems/scheduler/scheduler.o 00:03:33.106 CC module/event/subsystems/keyring/keyring.o 00:03:33.106 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:03:33.106 CC module/event/subsystems/vmd/vmd.o 00:03:33.106 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:03:33.106 CC module/event/subsystems/iobuf/iobuf.o 00:03:33.106 CC module/event/subsystems/vmd/vmd_rpc.o 00:03:33.365 LIB libspdk_event_scheduler.a 00:03:33.365 LIB libspdk_event_sock.a 00:03:33.365 LIB libspdk_event_vhost_blk.a 00:03:33.365 LIB libspdk_event_keyring.a 00:03:33.365 LIB libspdk_event_vmd.a 00:03:33.365 SO libspdk_event_sock.so.5.0 00:03:33.365 SO libspdk_event_scheduler.so.4.0 00:03:33.365 SO libspdk_event_keyring.so.1.0 00:03:33.365 SO libspdk_event_vhost_blk.so.3.0 00:03:33.365 LIB libspdk_event_iobuf.a 00:03:33.365 SO libspdk_event_vmd.so.6.0 00:03:33.365 SYMLINK libspdk_event_scheduler.so 00:03:33.365 SYMLINK libspdk_event_sock.so 00:03:33.365 SO libspdk_event_iobuf.so.3.0 00:03:33.365 SYMLINK libspdk_event_vhost_blk.so 00:03:33.365 SYMLINK libspdk_event_keyring.so 00:03:33.365 SYMLINK libspdk_event_vmd.so 00:03:33.623 SYMLINK libspdk_event_iobuf.so 00:03:33.923 CC module/event/subsystems/accel/accel.o 00:03:33.923 LIB libspdk_event_accel.a 00:03:33.923 SO libspdk_event_accel.so.6.0 00:03:33.923 SYMLINK libspdk_event_accel.so 00:03:34.527 CC module/event/subsystems/bdev/bdev.o 00:03:34.527 LIB libspdk_event_bdev.a 00:03:34.527 SO libspdk_event_bdev.so.6.0 00:03:34.527 SYMLINK libspdk_event_bdev.so 00:03:35.094 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:03:35.094 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:03:35.094 CC module/event/subsystems/scsi/scsi.o 00:03:35.094 CC module/event/subsystems/ublk/ublk.o 00:03:35.094 CC module/event/subsystems/nbd/nbd.o 00:03:35.094 LIB libspdk_event_scsi.a 00:03:35.094 LIB libspdk_event_ublk.a 00:03:35.094 LIB libspdk_event_nbd.a 00:03:35.094 SO libspdk_event_scsi.so.6.0 00:03:35.094 SO libspdk_event_ublk.so.3.0 00:03:35.094 LIB libspdk_event_nvmf.a 00:03:35.094 SO libspdk_event_nbd.so.6.0 00:03:35.094 SYMLINK libspdk_event_scsi.so 00:03:35.094 SO libspdk_event_nvmf.so.6.0 00:03:35.094 SYMLINK libspdk_event_ublk.so 00:03:35.354 SYMLINK libspdk_event_nbd.so 00:03:35.354 SYMLINK libspdk_event_nvmf.so 00:03:35.612 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:03:35.612 CC module/event/subsystems/iscsi/iscsi.o 00:03:35.612 LIB libspdk_event_vhost_scsi.a 00:03:35.612 SO libspdk_event_vhost_scsi.so.3.0 00:03:35.612 LIB libspdk_event_iscsi.a 00:03:35.612 SYMLINK libspdk_event_vhost_scsi.so 00:03:35.612 SO libspdk_event_iscsi.so.6.0 00:03:35.871 SYMLINK libspdk_event_iscsi.so 00:03:35.871 SO libspdk.so.6.0 00:03:35.871 SYMLINK libspdk.so 00:03:36.443 CC app/trace_record/trace_record.o 00:03:36.443 CXX app/trace/trace.o 00:03:36.443 CC app/spdk_top/spdk_top.o 00:03:36.443 CC test/rpc_client/rpc_client_test.o 00:03:36.443 TEST_HEADER include/spdk/accel.h 00:03:36.443 CC app/spdk_nvme_perf/perf.o 00:03:36.443 CC app/spdk_nvme_identify/identify.o 00:03:36.443 TEST_HEADER include/spdk/accel_module.h 00:03:36.443 TEST_HEADER include/spdk/assert.h 00:03:36.443 CC app/spdk_nvme_discover/discovery_aer.o 00:03:36.443 TEST_HEADER include/spdk/barrier.h 00:03:36.443 CC app/spdk_lspci/spdk_lspci.o 00:03:36.443 TEST_HEADER include/spdk/base64.h 00:03:36.443 TEST_HEADER include/spdk/bdev.h 00:03:36.443 TEST_HEADER include/spdk/bdev_module.h 00:03:36.443 TEST_HEADER include/spdk/bdev_zone.h 00:03:36.443 TEST_HEADER include/spdk/bit_array.h 00:03:36.443 TEST_HEADER include/spdk/bit_pool.h 00:03:36.443 CC examples/interrupt_tgt/interrupt_tgt.o 00:03:36.443 TEST_HEADER include/spdk/blob_bdev.h 00:03:36.443 TEST_HEADER include/spdk/blobfs_bdev.h 00:03:36.443 TEST_HEADER include/spdk/blobfs.h 00:03:36.443 TEST_HEADER include/spdk/blob.h 00:03:36.443 TEST_HEADER include/spdk/conf.h 00:03:36.443 CC app/spdk_dd/spdk_dd.o 00:03:36.443 TEST_HEADER include/spdk/config.h 00:03:36.443 TEST_HEADER include/spdk/cpuset.h 00:03:36.443 TEST_HEADER include/spdk/crc16.h 00:03:36.443 TEST_HEADER include/spdk/crc32.h 00:03:36.443 TEST_HEADER include/spdk/crc64.h 00:03:36.443 TEST_HEADER include/spdk/dif.h 00:03:36.443 CC app/iscsi_tgt/iscsi_tgt.o 00:03:36.443 TEST_HEADER include/spdk/dma.h 00:03:36.443 CC app/vhost/vhost.o 00:03:36.443 TEST_HEADER include/spdk/endian.h 00:03:36.443 CC app/nvmf_tgt/nvmf_main.o 00:03:36.443 TEST_HEADER include/spdk/env_dpdk.h 00:03:36.443 TEST_HEADER include/spdk/env.h 00:03:36.443 TEST_HEADER include/spdk/event.h 00:03:36.443 CC app/spdk_tgt/spdk_tgt.o 00:03:36.443 TEST_HEADER include/spdk/fd_group.h 00:03:36.443 TEST_HEADER include/spdk/fd.h 00:03:36.443 TEST_HEADER include/spdk/file.h 00:03:36.443 TEST_HEADER include/spdk/ftl.h 00:03:36.443 TEST_HEADER include/spdk/gpt_spec.h 00:03:36.443 TEST_HEADER include/spdk/hexlify.h 00:03:36.443 TEST_HEADER include/spdk/histogram_data.h 00:03:36.443 CC examples/nvme/hello_world/hello_world.o 00:03:36.443 CC examples/accel/perf/accel_perf.o 00:03:36.443 TEST_HEADER include/spdk/idxd.h 00:03:36.443 CC examples/ioat/verify/verify.o 00:03:36.443 CC examples/nvme/hotplug/hotplug.o 00:03:36.443 TEST_HEADER include/spdk/idxd_spec.h 00:03:36.443 TEST_HEADER include/spdk/init.h 00:03:36.443 CC examples/idxd/perf/perf.o 00:03:36.443 TEST_HEADER include/spdk/ioat.h 00:03:36.443 CC test/app/histogram_perf/histogram_perf.o 00:03:36.443 CC examples/nvme/reconnect/reconnect.o 00:03:36.443 TEST_HEADER include/spdk/ioat_spec.h 00:03:36.443 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:03:36.443 CC examples/ioat/perf/perf.o 00:03:36.443 CC test/thread/poller_perf/poller_perf.o 00:03:36.443 CC examples/sock/hello_world/hello_sock.o 00:03:36.443 CC examples/util/zipf/zipf.o 00:03:36.443 CC test/app/stub/stub.o 00:03:36.443 CC examples/nvme/cmb_copy/cmb_copy.o 00:03:36.443 CC test/nvme/startup/startup.o 00:03:36.443 CC examples/vmd/led/led.o 00:03:36.444 CC examples/nvme/abort/abort.o 00:03:36.444 CC test/nvme/aer/aer.o 00:03:36.444 CC examples/vmd/lsvmd/lsvmd.o 00:03:36.444 CC test/nvme/err_injection/err_injection.o 00:03:36.444 CC test/env/vtophys/vtophys.o 00:03:36.444 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:03:36.444 TEST_HEADER include/spdk/iscsi_spec.h 00:03:36.444 CC test/nvme/simple_copy/simple_copy.o 00:03:36.444 CC test/event/reactor_perf/reactor_perf.o 00:03:36.444 CC test/nvme/fused_ordering/fused_ordering.o 00:03:36.444 CC examples/nvme/nvme_manage/nvme_manage.o 00:03:36.444 CC test/nvme/e2edp/nvme_dp.o 00:03:36.444 CC test/nvme/compliance/nvme_compliance.o 00:03:36.444 TEST_HEADER include/spdk/json.h 00:03:36.444 CC test/nvme/reset/reset.o 00:03:36.444 TEST_HEADER include/spdk/jsonrpc.h 00:03:36.444 CC test/nvme/boot_partition/boot_partition.o 00:03:36.444 CC test/nvme/overhead/overhead.o 00:03:36.444 CC examples/nvme/arbitration/arbitration.o 00:03:36.444 CC test/event/reactor/reactor.o 00:03:36.444 CC examples/blob/cli/blobcli.o 00:03:36.444 TEST_HEADER include/spdk/keyring.h 00:03:36.444 CC test/nvme/sgl/sgl.o 00:03:36.444 CC test/event/event_perf/event_perf.o 00:03:36.444 CC test/nvme/reserve/reserve.o 00:03:36.444 CC examples/bdev/hello_world/hello_bdev.o 00:03:36.444 TEST_HEADER include/spdk/keyring_module.h 00:03:36.444 CC test/nvme/connect_stress/connect_stress.o 00:03:36.444 CC examples/thread/thread/thread_ex.o 00:03:36.444 CC test/event/app_repeat/app_repeat.o 00:03:36.444 CC test/app/jsoncat/jsoncat.o 00:03:36.444 CC test/env/memory/memory_ut.o 00:03:36.444 TEST_HEADER include/spdk/likely.h 00:03:36.444 CC test/dma/test_dma/test_dma.o 00:03:36.444 CC test/accel/dif/dif.o 00:03:36.444 CC test/nvme/doorbell_aers/doorbell_aers.o 00:03:36.444 CC app/fio/nvme/fio_plugin.o 00:03:36.444 TEST_HEADER include/spdk/log.h 00:03:36.444 CC examples/bdev/bdevperf/bdevperf.o 00:03:36.444 CC test/blobfs/mkfs/mkfs.o 00:03:36.444 CC examples/blob/hello_world/hello_blob.o 00:03:36.444 CC test/app/bdev_svc/bdev_svc.o 00:03:36.444 TEST_HEADER include/spdk/lvol.h 00:03:36.706 CC examples/nvmf/nvmf/nvmf.o 00:03:36.706 CC test/bdev/bdevio/bdevio.o 00:03:36.706 TEST_HEADER include/spdk/memory.h 00:03:36.706 CC test/event/scheduler/scheduler.o 00:03:36.706 TEST_HEADER include/spdk/mmio.h 00:03:36.706 TEST_HEADER include/spdk/nbd.h 00:03:36.706 TEST_HEADER include/spdk/notify.h 00:03:36.706 TEST_HEADER include/spdk/nvme.h 00:03:36.706 TEST_HEADER include/spdk/nvme_intel.h 00:03:36.706 TEST_HEADER include/spdk/nvme_ocssd.h 00:03:36.706 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:03:36.706 TEST_HEADER include/spdk/nvme_spec.h 00:03:36.706 TEST_HEADER include/spdk/nvme_zns.h 00:03:36.706 LINK spdk_lspci 00:03:36.706 TEST_HEADER include/spdk/nvmf_cmd.h 00:03:36.706 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:03:36.706 TEST_HEADER include/spdk/nvmf.h 00:03:36.706 TEST_HEADER include/spdk/nvmf_spec.h 00:03:36.706 TEST_HEADER include/spdk/nvmf_transport.h 00:03:36.706 LINK rpc_client_test 00:03:36.706 TEST_HEADER include/spdk/opal.h 00:03:36.706 TEST_HEADER include/spdk/opal_spec.h 00:03:36.706 TEST_HEADER include/spdk/pci_ids.h 00:03:36.706 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:03:36.706 TEST_HEADER include/spdk/pipe.h 00:03:36.706 TEST_HEADER include/spdk/queue.h 00:03:36.706 CC test/lvol/esnap/esnap.o 00:03:36.706 TEST_HEADER include/spdk/reduce.h 00:03:36.706 TEST_HEADER include/spdk/rpc.h 00:03:36.706 TEST_HEADER include/spdk/scheduler.h 00:03:36.706 CC test/env/mem_callbacks/mem_callbacks.o 00:03:36.706 TEST_HEADER include/spdk/scsi.h 00:03:36.706 TEST_HEADER include/spdk/scsi_spec.h 00:03:36.706 TEST_HEADER include/spdk/sock.h 00:03:36.706 TEST_HEADER include/spdk/stdinc.h 00:03:36.706 LINK spdk_nvme_discover 00:03:36.706 LINK interrupt_tgt 00:03:36.706 TEST_HEADER include/spdk/string.h 00:03:36.706 TEST_HEADER include/spdk/thread.h 00:03:36.706 TEST_HEADER include/spdk/trace.h 00:03:36.706 TEST_HEADER include/spdk/trace_parser.h 00:03:36.706 LINK nvmf_tgt 00:03:36.706 TEST_HEADER include/spdk/tree.h 00:03:36.706 LINK lsvmd 00:03:36.706 LINK histogram_perf 00:03:36.706 TEST_HEADER include/spdk/ublk.h 00:03:36.706 TEST_HEADER include/spdk/util.h 00:03:36.706 TEST_HEADER include/spdk/uuid.h 00:03:36.706 LINK poller_perf 00:03:36.706 TEST_HEADER include/spdk/version.h 00:03:36.706 TEST_HEADER include/spdk/vfio_user_pci.h 00:03:36.706 TEST_HEADER include/spdk/vfio_user_spec.h 00:03:36.706 LINK vtophys 00:03:36.706 TEST_HEADER include/spdk/vhost.h 00:03:36.706 TEST_HEADER include/spdk/vmd.h 00:03:36.706 LINK reactor 00:03:36.706 TEST_HEADER include/spdk/xor.h 00:03:36.976 LINK vhost 00:03:36.976 LINK spdk_trace_record 00:03:36.976 TEST_HEADER include/spdk/zipf.h 00:03:36.976 CXX test/cpp_headers/accel.o 00:03:36.976 LINK spdk_tgt 00:03:36.976 LINK zipf 00:03:36.976 LINK pmr_persistence 00:03:36.976 LINK led 00:03:36.976 LINK app_repeat 00:03:36.976 LINK reactor_perf 00:03:36.976 LINK jsoncat 00:03:36.976 LINK iscsi_tgt 00:03:36.976 LINK cmb_copy 00:03:36.976 LINK hello_world 00:03:36.976 LINK event_perf 00:03:36.976 LINK startup 00:03:36.976 LINK env_dpdk_post_init 00:03:36.976 LINK boot_partition 00:03:36.976 LINK stub 00:03:36.976 LINK bdev_svc 00:03:36.976 LINK doorbell_aers 00:03:36.976 LINK err_injection 00:03:36.976 LINK verify 00:03:36.976 LINK mkfs 00:03:36.976 LINK reserve 00:03:36.976 LINK hello_sock 00:03:36.976 LINK connect_stress 00:03:36.976 LINK simple_copy 00:03:36.976 LINK fused_ordering 00:03:36.976 LINK ioat_perf 00:03:36.976 LINK hotplug 00:03:36.976 LINK spdk_dd 00:03:36.976 LINK aer 00:03:36.976 LINK scheduler 00:03:36.976 LINK hello_blob 00:03:36.976 LINK hello_bdev 00:03:36.976 LINK sgl 00:03:36.977 LINK spdk_trace 00:03:36.977 LINK thread 00:03:36.977 LINK reset 00:03:36.977 LINK idxd_perf 00:03:36.977 LINK nvme_dp 00:03:37.237 LINK overhead 00:03:37.237 LINK arbitration 00:03:37.237 LINK abort 00:03:37.237 LINK nvme_compliance 00:03:37.237 LINK reconnect 00:03:37.237 LINK nvmf 00:03:37.237 CXX test/cpp_headers/accel_module.o 00:03:37.237 LINK test_dma 00:03:37.237 LINK bdevio 00:03:37.237 LINK dif 00:03:37.237 LINK accel_perf 00:03:37.237 CXX test/cpp_headers/assert.o 00:03:37.237 CXX test/cpp_headers/barrier.o 00:03:37.237 CXX test/cpp_headers/base64.o 00:03:37.237 CXX test/cpp_headers/bdev.o 00:03:37.237 CXX test/cpp_headers/bdev_module.o 00:03:37.237 CC test/env/pci/pci_ut.o 00:03:37.237 CXX test/cpp_headers/bdev_zone.o 00:03:37.237 CXX test/cpp_headers/bit_array.o 00:03:37.237 CXX test/cpp_headers/bit_pool.o 00:03:37.237 CXX test/cpp_headers/blobfs_bdev.o 00:03:37.237 CXX test/cpp_headers/blob_bdev.o 00:03:37.237 LINK nvme_manage 00:03:37.237 CXX test/cpp_headers/blobfs.o 00:03:37.237 CC app/fio/bdev/fio_plugin.o 00:03:37.498 LINK blobcli 00:03:37.498 CXX test/cpp_headers/blob.o 00:03:37.498 CXX test/cpp_headers/conf.o 00:03:37.498 CXX test/cpp_headers/config.o 00:03:37.498 CXX test/cpp_headers/cpuset.o 00:03:37.498 CXX test/cpp_headers/crc16.o 00:03:37.498 CXX test/cpp_headers/crc32.o 00:03:37.498 CC test/nvme/fdp/fdp.o 00:03:37.498 LINK nvme_fuzz 00:03:37.498 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:03:37.498 CXX test/cpp_headers/crc64.o 00:03:37.498 CXX test/cpp_headers/dif.o 00:03:37.498 CXX test/cpp_headers/endian.o 00:03:37.498 CXX test/cpp_headers/dma.o 00:03:37.498 CC test/nvme/cuse/cuse.o 00:03:37.498 CXX test/cpp_headers/env_dpdk.o 00:03:37.498 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:03:37.498 CXX test/cpp_headers/event.o 00:03:37.498 CXX test/cpp_headers/env.o 00:03:37.498 CXX test/cpp_headers/fd.o 00:03:37.498 CXX test/cpp_headers/fd_group.o 00:03:37.498 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:03:37.498 CXX test/cpp_headers/file.o 00:03:37.498 CXX test/cpp_headers/ftl.o 00:03:37.498 LINK spdk_nvme 00:03:37.498 CXX test/cpp_headers/gpt_spec.o 00:03:37.498 CXX test/cpp_headers/hexlify.o 00:03:37.498 CXX test/cpp_headers/histogram_data.o 00:03:37.498 CXX test/cpp_headers/idxd.o 00:03:37.498 CXX test/cpp_headers/idxd_spec.o 00:03:37.498 CXX test/cpp_headers/init.o 00:03:37.498 CXX test/cpp_headers/ioat.o 00:03:37.498 CXX test/cpp_headers/ioat_spec.o 00:03:37.498 CXX test/cpp_headers/iscsi_spec.o 00:03:37.498 CXX test/cpp_headers/json.o 00:03:37.498 CXX test/cpp_headers/jsonrpc.o 00:03:37.498 CXX test/cpp_headers/keyring.o 00:03:37.498 CXX test/cpp_headers/keyring_module.o 00:03:37.498 CXX test/cpp_headers/likely.o 00:03:37.498 CXX test/cpp_headers/log.o 00:03:37.498 CXX test/cpp_headers/lvol.o 00:03:37.498 CXX test/cpp_headers/memory.o 00:03:37.498 CXX test/cpp_headers/mmio.o 00:03:37.498 CXX test/cpp_headers/nbd.o 00:03:37.498 CXX test/cpp_headers/notify.o 00:03:37.498 CXX test/cpp_headers/nvme.o 00:03:37.498 CXX test/cpp_headers/nvme_ocssd.o 00:03:37.498 CXX test/cpp_headers/nvme_intel.o 00:03:37.498 CXX test/cpp_headers/nvme_ocssd_spec.o 00:03:37.498 CXX test/cpp_headers/nvme_spec.o 00:03:37.498 CXX test/cpp_headers/nvme_zns.o 00:03:37.760 CXX test/cpp_headers/nvmf_cmd.o 00:03:37.760 CXX test/cpp_headers/nvmf_fc_spec.o 00:03:37.760 CXX test/cpp_headers/nvmf.o 00:03:37.760 CXX test/cpp_headers/nvmf_spec.o 00:03:37.760 CXX test/cpp_headers/nvmf_transport.o 00:03:37.760 CXX test/cpp_headers/opal.o 00:03:37.760 CXX test/cpp_headers/opal_spec.o 00:03:37.760 CXX test/cpp_headers/pci_ids.o 00:03:37.760 LINK mem_callbacks 00:03:37.760 CXX test/cpp_headers/pipe.o 00:03:37.760 CXX test/cpp_headers/queue.o 00:03:37.760 CXX test/cpp_headers/reduce.o 00:03:37.760 CXX test/cpp_headers/rpc.o 00:03:37.760 CXX test/cpp_headers/scheduler.o 00:03:37.760 CXX test/cpp_headers/scsi.o 00:03:37.760 CXX test/cpp_headers/scsi_spec.o 00:03:37.760 CXX test/cpp_headers/sock.o 00:03:37.760 LINK spdk_nvme_perf 00:03:37.760 LINK spdk_nvme_identify 00:03:37.760 CXX test/cpp_headers/stdinc.o 00:03:37.760 CXX test/cpp_headers/string.o 00:03:37.760 CXX test/cpp_headers/thread.o 00:03:37.760 CXX test/cpp_headers/trace.o 00:03:37.760 CXX test/cpp_headers/trace_parser.o 00:03:37.760 CXX test/cpp_headers/tree.o 00:03:37.760 CXX test/cpp_headers/ublk.o 00:03:37.760 CXX test/cpp_headers/util.o 00:03:37.760 LINK bdevperf 00:03:37.760 CXX test/cpp_headers/uuid.o 00:03:38.020 CXX test/cpp_headers/version.o 00:03:38.020 CXX test/cpp_headers/vfio_user_pci.o 00:03:38.020 CXX test/cpp_headers/vfio_user_spec.o 00:03:38.020 CXX test/cpp_headers/vhost.o 00:03:38.020 CXX test/cpp_headers/vmd.o 00:03:38.020 LINK spdk_top 00:03:38.020 CXX test/cpp_headers/xor.o 00:03:38.021 CXX test/cpp_headers/zipf.o 00:03:38.021 LINK fdp 00:03:38.021 LINK pci_ut 00:03:38.021 LINK memory_ut 00:03:38.021 LINK spdk_bdev 00:03:38.279 LINK vhost_fuzz 00:03:38.538 LINK cuse 00:03:39.106 LINK iscsi_fuzz 00:03:41.008 LINK esnap 00:03:41.267 00:03:41.267 real 0m48.066s 00:03:41.267 user 6m59.991s 00:03:41.267 sys 3m14.094s 00:03:41.267 02:23:14 -- common/autotest_common.sh@1112 -- $ xtrace_disable 00:03:41.267 02:23:14 -- common/autotest_common.sh@10 -- $ set +x 00:03:41.267 ************************************ 00:03:41.267 END TEST make 00:03:41.267 ************************************ 00:03:41.267 02:23:14 -- spdk/autobuild.sh@1 -- $ stop_monitor_resources 00:03:41.267 02:23:14 -- pm/common@30 -- $ signal_monitor_resources TERM 00:03:41.267 02:23:14 -- pm/common@41 -- $ local monitor pid pids signal=TERM 00:03:41.267 02:23:14 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:03:41.267 02:23:14 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-cpu-load.pid ]] 00:03:41.267 02:23:14 -- pm/common@45 -- $ pid=1316476 00:03:41.267 02:23:14 -- pm/common@52 -- $ sudo kill -TERM 1316476 00:03:41.267 02:23:14 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:03:41.267 02:23:14 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-vmstat.pid ]] 00:03:41.267 02:23:14 -- pm/common@45 -- $ pid=1316481 00:03:41.267 02:23:14 -- pm/common@52 -- $ sudo kill -TERM 1316481 00:03:41.267 02:23:14 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:03:41.267 02:23:14 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-cpu-temp.pid ]] 00:03:41.267 02:23:14 -- pm/common@45 -- $ pid=1316480 00:03:41.267 02:23:14 -- pm/common@52 -- $ sudo kill -TERM 1316480 00:03:41.267 02:23:14 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:03:41.267 02:23:14 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-bmc-pm.pid ]] 00:03:41.267 02:23:14 -- pm/common@45 -- $ pid=1316482 00:03:41.267 02:23:14 -- pm/common@52 -- $ sudo kill -TERM 1316482 00:03:41.527 02:23:14 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:03:41.527 02:23:14 -- nvmf/common.sh@7 -- # uname -s 00:03:41.527 02:23:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:03:41.527 02:23:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:03:41.527 02:23:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:03:41.527 02:23:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:03:41.527 02:23:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:03:41.527 02:23:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:03:41.527 02:23:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:03:41.527 02:23:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:03:41.527 02:23:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:03:41.527 02:23:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:03:41.527 02:23:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:03:41.527 02:23:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:03:41.527 02:23:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:03:41.527 02:23:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:03:41.527 02:23:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:03:41.527 02:23:14 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:03:41.527 02:23:14 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:03:41.527 02:23:14 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:03:41.527 02:23:14 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:03:41.527 02:23:14 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:03:41.527 02:23:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:41.527 02:23:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:41.527 02:23:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:41.527 02:23:14 -- paths/export.sh@5 -- # export PATH 00:03:41.527 02:23:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:41.527 02:23:14 -- nvmf/common.sh@47 -- # : 0 00:03:41.527 02:23:14 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:03:41.527 02:23:14 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:03:41.527 02:23:14 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:03:41.527 02:23:14 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:03:41.527 02:23:14 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:03:41.527 02:23:14 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:03:41.527 02:23:14 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:03:41.527 02:23:14 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:03:41.527 02:23:14 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:03:41.527 02:23:14 -- spdk/autotest.sh@32 -- # uname -s 00:03:41.527 02:23:14 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:03:41.527 02:23:14 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:03:41.527 02:23:14 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/coredumps 00:03:41.527 02:23:14 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:03:41.527 02:23:14 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/coredumps 00:03:41.527 02:23:14 -- spdk/autotest.sh@44 -- # modprobe nbd 00:03:41.527 02:23:14 -- spdk/autotest.sh@46 -- # type -P udevadm 00:03:41.527 02:23:14 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:03:41.527 02:23:14 -- spdk/autotest.sh@48 -- # udevadm_pid=1373197 00:03:41.527 02:23:14 -- spdk/autotest.sh@53 -- # start_monitor_resources 00:03:41.527 02:23:14 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:03:41.527 02:23:14 -- pm/common@17 -- # local monitor 00:03:41.527 02:23:14 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:03:41.527 02:23:14 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=1373200 00:03:41.527 02:23:14 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:03:41.527 02:23:14 -- pm/common@21 -- # date +%s 00:03:41.527 02:23:14 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=1373202 00:03:41.527 02:23:14 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:03:41.527 02:23:14 -- pm/common@21 -- # date +%s 00:03:41.527 02:23:14 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=1373206 00:03:41.527 02:23:14 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:03:41.527 02:23:14 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=1373212 00:03:41.527 02:23:14 -- pm/common@26 -- # sleep 1 00:03:41.527 02:23:14 -- pm/common@21 -- # date +%s 00:03:41.527 02:23:14 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1714177394 00:03:41.527 02:23:14 -- pm/common@21 -- # date +%s 00:03:41.527 02:23:14 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1714177394 00:03:41.527 02:23:14 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1714177394 00:03:41.527 02:23:14 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1714177394 00:03:41.527 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autotest.sh.1714177394_collect-vmstat.pm.log 00:03:41.527 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autotest.sh.1714177394_collect-bmc-pm.bmc.pm.log 00:03:41.527 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autotest.sh.1714177394_collect-cpu-load.pm.log 00:03:41.527 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autotest.sh.1714177394_collect-cpu-temp.pm.log 00:03:42.465 02:23:15 -- spdk/autotest.sh@55 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:03:42.465 02:23:15 -- spdk/autotest.sh@57 -- # timing_enter autotest 00:03:42.465 02:23:15 -- common/autotest_common.sh@710 -- # xtrace_disable 00:03:42.465 02:23:15 -- common/autotest_common.sh@10 -- # set +x 00:03:42.465 02:23:15 -- spdk/autotest.sh@59 -- # create_test_list 00:03:42.465 02:23:15 -- common/autotest_common.sh@734 -- # xtrace_disable 00:03:42.465 02:23:15 -- common/autotest_common.sh@10 -- # set +x 00:03:42.465 02:23:16 -- spdk/autotest.sh@61 -- # dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/autotest.sh 00:03:42.465 02:23:16 -- spdk/autotest.sh@61 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:03:42.465 02:23:16 -- spdk/autotest.sh@61 -- # src=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:03:42.465 02:23:16 -- spdk/autotest.sh@62 -- # out=/var/jenkins/workspace/nvmf-phy-autotest/spdk/../output 00:03:42.465 02:23:16 -- spdk/autotest.sh@63 -- # cd /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:03:42.465 02:23:16 -- spdk/autotest.sh@65 -- # freebsd_update_contigmem_mod 00:03:42.465 02:23:16 -- common/autotest_common.sh@1441 -- # uname 00:03:42.465 02:23:16 -- common/autotest_common.sh@1441 -- # '[' Linux = FreeBSD ']' 00:03:42.465 02:23:16 -- spdk/autotest.sh@66 -- # freebsd_set_maxsock_buf 00:03:42.465 02:23:16 -- common/autotest_common.sh@1461 -- # uname 00:03:42.465 02:23:16 -- common/autotest_common.sh@1461 -- # [[ Linux = FreeBSD ]] 00:03:42.465 02:23:16 -- spdk/autotest.sh@71 -- # grep CC_TYPE mk/cc.mk 00:03:42.465 02:23:16 -- spdk/autotest.sh@71 -- # CC_TYPE=CC_TYPE=gcc 00:03:42.465 02:23:16 -- spdk/autotest.sh@72 -- # hash lcov 00:03:42.465 02:23:16 -- spdk/autotest.sh@72 -- # [[ CC_TYPE=gcc == *\c\l\a\n\g* ]] 00:03:42.465 02:23:16 -- spdk/autotest.sh@80 -- # export 'LCOV_OPTS= 00:03:42.465 --rc lcov_branch_coverage=1 00:03:42.465 --rc lcov_function_coverage=1 00:03:42.465 --rc genhtml_branch_coverage=1 00:03:42.465 --rc genhtml_function_coverage=1 00:03:42.465 --rc genhtml_legend=1 00:03:42.465 --rc geninfo_all_blocks=1 00:03:42.465 ' 00:03:42.465 02:23:16 -- spdk/autotest.sh@80 -- # LCOV_OPTS=' 00:03:42.465 --rc lcov_branch_coverage=1 00:03:42.465 --rc lcov_function_coverage=1 00:03:42.465 --rc genhtml_branch_coverage=1 00:03:42.465 --rc genhtml_function_coverage=1 00:03:42.465 --rc genhtml_legend=1 00:03:42.465 --rc geninfo_all_blocks=1 00:03:42.465 ' 00:03:42.465 02:23:16 -- spdk/autotest.sh@81 -- # export 'LCOV=lcov 00:03:42.465 --rc lcov_branch_coverage=1 00:03:42.465 --rc lcov_function_coverage=1 00:03:42.465 --rc genhtml_branch_coverage=1 00:03:42.465 --rc genhtml_function_coverage=1 00:03:42.465 --rc genhtml_legend=1 00:03:42.465 --rc geninfo_all_blocks=1 00:03:42.465 --no-external' 00:03:42.465 02:23:16 -- spdk/autotest.sh@81 -- # LCOV='lcov 00:03:42.465 --rc lcov_branch_coverage=1 00:03:42.465 --rc lcov_function_coverage=1 00:03:42.465 --rc genhtml_branch_coverage=1 00:03:42.465 --rc genhtml_function_coverage=1 00:03:42.465 --rc genhtml_legend=1 00:03:42.465 --rc geninfo_all_blocks=1 00:03:42.465 --no-external' 00:03:42.465 02:23:16 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -v 00:03:42.733 lcov: LCOV version 1.14 00:03:42.733 02:23:16 -- spdk/autotest.sh@85 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -c -i -t Baseline -d /var/jenkins/workspace/nvmf-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_base.info 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/accel.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/accel.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/accel_module.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/accel_module.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/assert.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/assert.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/barrier.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/barrier.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/base64.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/base64.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bdev.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bdev.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bdev_module.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bdev_module.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bdev_zone.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bdev_zone.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bit_array.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bit_array.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bit_pool.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bit_pool.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blob_bdev.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blob_bdev.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blobfs_bdev.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blobfs_bdev.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blobfs.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blobfs.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blob.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blob.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/conf.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/conf.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/config.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/config.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/crc16.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/crc16.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/cpuset.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/cpuset.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/crc32.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/crc32.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/dif.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/dif.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/crc64.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/crc64.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/endian.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/endian.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/dma.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/dma.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/env_dpdk.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/env_dpdk.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/env.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/env.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/fd.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/fd.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/fd_group.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/fd_group.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/event.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/event.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/file.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/file.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ftl.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ftl.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/gpt_spec.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/gpt_spec.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/hexlify.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/hexlify.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/idxd.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/idxd.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/histogram_data.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/histogram_data.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/idxd_spec.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/idxd_spec.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/init.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/init.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ioat.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ioat.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/iscsi_spec.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/iscsi_spec.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ioat_spec.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ioat_spec.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/json.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/json.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/keyring.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/keyring.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/jsonrpc.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/jsonrpc.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/log.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/log.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/keyring_module.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/keyring_module.gcno 00:03:49.317 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/likely.gcno:no functions found 00:03:49.317 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/likely.gcno 00:03:49.318 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/memory.gcno:no functions found 00:03:49.318 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/memory.gcno 00:03:49.318 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/lvol.gcno:no functions found 00:03:49.318 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/lvol.gcno 00:03:49.318 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nbd.gcno:no functions found 00:03:49.318 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nbd.gcno 00:03:49.318 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/mmio.gcno:no functions found 00:03:49.318 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/mmio.gcno 00:03:49.318 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/notify.gcno:no functions found 00:03:49.318 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/notify.gcno 00:03:49.318 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme.gcno:no functions found 00:03:49.318 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme.gcno 00:03:49.318 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_ocssd.gcno:no functions found 00:03:49.318 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_ocssd.gcno 00:03:49.318 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_ocssd_spec.gcno:no functions found 00:03:49.318 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_ocssd_spec.gcno 00:03:49.318 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_intel.gcno:no functions found 00:03:49.318 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_intel.gcno 00:03:49.318 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_zns.gcno:no functions found 00:03:49.318 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_zns.gcno 00:03:49.318 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_spec.gcno:no functions found 00:03:49.318 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_spec.gcno 00:03:49.318 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_fc_spec.gcno:no functions found 00:03:49.318 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_fc_spec.gcno 00:03:49.318 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_cmd.gcno:no functions found 00:03:49.318 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_cmd.gcno 00:03:49.318 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf.gcno:no functions found 00:03:49.318 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf.gcno 00:03:49.318 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_spec.gcno:no functions found 00:03:49.318 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_spec.gcno 00:03:49.318 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_transport.gcno:no functions found 00:03:49.318 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_transport.gcno 00:03:49.318 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/opal.gcno:no functions found 00:03:49.318 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/opal.gcno 00:03:49.318 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/opal_spec.gcno:no functions found 00:03:49.318 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/opal_spec.gcno 00:03:49.318 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/pci_ids.gcno:no functions found 00:03:49.318 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/pci_ids.gcno 00:03:49.318 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/pipe.gcno:no functions found 00:03:49.318 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/pipe.gcno 00:03:49.318 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/queue.gcno:no functions found 00:03:49.318 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/queue.gcno 00:03:49.318 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/rpc.gcno:no functions found 00:03:49.318 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/rpc.gcno 00:03:49.318 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/scheduler.gcno:no functions found 00:03:49.318 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/scheduler.gcno 00:03:49.318 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/reduce.gcno:no functions found 00:03:49.318 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/reduce.gcno 00:03:49.577 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/scsi.gcno:no functions found 00:03:49.577 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/scsi.gcno 00:03:49.577 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/scsi_spec.gcno:no functions found 00:03:49.577 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/scsi_spec.gcno 00:03:49.577 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/sock.gcno:no functions found 00:03:49.577 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/sock.gcno 00:03:49.577 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/stdinc.gcno:no functions found 00:03:49.577 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/stdinc.gcno 00:03:49.577 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/string.gcno:no functions found 00:03:49.577 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/string.gcno 00:03:49.577 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/thread.gcno:no functions found 00:03:49.577 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/thread.gcno 00:03:49.577 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/trace.gcno:no functions found 00:03:49.577 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/trace.gcno 00:03:49.577 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/trace_parser.gcno:no functions found 00:03:49.577 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/trace_parser.gcno 00:03:49.577 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/tree.gcno:no functions found 00:03:49.577 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/tree.gcno 00:03:49.577 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/uuid.gcno:no functions found 00:03:49.577 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/uuid.gcno 00:03:49.577 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ublk.gcno:no functions found 00:03:49.577 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ublk.gcno 00:03:49.577 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/util.gcno:no functions found 00:03:49.577 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/util.gcno 00:03:49.577 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/version.gcno:no functions found 00:03:49.577 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/version.gcno 00:03:49.577 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vfio_user_pci.gcno:no functions found 00:03:49.577 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vfio_user_pci.gcno 00:03:49.577 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vfio_user_spec.gcno:no functions found 00:03:49.577 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vfio_user_spec.gcno 00:03:49.577 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vhost.gcno:no functions found 00:03:49.577 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vhost.gcno 00:03:49.577 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vmd.gcno:no functions found 00:03:49.577 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vmd.gcno 00:03:49.577 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/zipf.gcno:no functions found 00:03:49.577 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/zipf.gcno 00:03:49.577 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/xor.gcno:no functions found 00:03:49.577 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/xor.gcno 00:03:52.115 /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/nvme/nvme_stubs.gcno:no functions found 00:03:52.115 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/nvme/nvme_stubs.gcno 00:04:00.277 /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:04:00.277 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:04:00.278 /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:04:00.278 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:04:00.278 /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:04:00.278 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:04:06.850 02:23:40 -- spdk/autotest.sh@89 -- # timing_enter pre_cleanup 00:04:06.850 02:23:40 -- common/autotest_common.sh@710 -- # xtrace_disable 00:04:06.850 02:23:40 -- common/autotest_common.sh@10 -- # set +x 00:04:06.850 02:23:40 -- spdk/autotest.sh@91 -- # rm -f 00:04:06.850 02:23:40 -- spdk/autotest.sh@94 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:04:09.384 0000:5f:00.0 (8086 0a54): Already using the nvme driver 00:04:09.384 0000:00:04.7 (8086 2021): Already using the ioatdma driver 00:04:09.384 0000:00:04.6 (8086 2021): Already using the ioatdma driver 00:04:09.384 0000:00:04.5 (8086 2021): Already using the ioatdma driver 00:04:09.384 0000:00:04.4 (8086 2021): Already using the ioatdma driver 00:04:09.384 0000:00:04.3 (8086 2021): Already using the ioatdma driver 00:04:09.384 0000:00:04.2 (8086 2021): Already using the ioatdma driver 00:04:09.384 0000:00:04.1 (8086 2021): Already using the ioatdma driver 00:04:09.384 0000:00:04.0 (8086 2021): Already using the ioatdma driver 00:04:09.384 0000:80:04.7 (8086 2021): Already using the ioatdma driver 00:04:09.384 0000:80:04.6 (8086 2021): Already using the ioatdma driver 00:04:09.384 0000:80:04.5 (8086 2021): Already using the ioatdma driver 00:04:09.384 0000:80:04.4 (8086 2021): Already using the ioatdma driver 00:04:09.384 0000:80:04.3 (8086 2021): Already using the ioatdma driver 00:04:09.384 0000:80:04.2 (8086 2021): Already using the ioatdma driver 00:04:09.384 0000:80:04.1 (8086 2021): Already using the ioatdma driver 00:04:09.384 0000:80:04.0 (8086 2021): Already using the ioatdma driver 00:04:09.643 02:23:43 -- spdk/autotest.sh@96 -- # get_zoned_devs 00:04:09.643 02:23:43 -- common/autotest_common.sh@1655 -- # zoned_devs=() 00:04:09.643 02:23:43 -- common/autotest_common.sh@1655 -- # local -gA zoned_devs 00:04:09.643 02:23:43 -- common/autotest_common.sh@1656 -- # local nvme bdf 00:04:09.643 02:23:43 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:04:09.643 02:23:43 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme0n1 00:04:09.643 02:23:43 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:04:09.643 02:23:43 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:09.643 02:23:43 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:04:09.643 02:23:43 -- spdk/autotest.sh@98 -- # (( 0 > 0 )) 00:04:09.643 02:23:43 -- spdk/autotest.sh@110 -- # for dev in /dev/nvme*n!(*p*) 00:04:09.643 02:23:43 -- spdk/autotest.sh@112 -- # [[ -z '' ]] 00:04:09.643 02:23:43 -- spdk/autotest.sh@113 -- # block_in_use /dev/nvme0n1 00:04:09.643 02:23:43 -- scripts/common.sh@378 -- # local block=/dev/nvme0n1 pt 00:04:09.643 02:23:43 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:04:09.643 No valid GPT data, bailing 00:04:09.643 02:23:43 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:04:09.643 02:23:43 -- scripts/common.sh@391 -- # pt= 00:04:09.643 02:23:43 -- scripts/common.sh@392 -- # return 1 00:04:09.643 02:23:43 -- spdk/autotest.sh@114 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:04:09.643 1+0 records in 00:04:09.643 1+0 records out 00:04:09.643 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0048262 s, 217 MB/s 00:04:09.643 02:23:43 -- spdk/autotest.sh@118 -- # sync 00:04:09.643 02:23:43 -- spdk/autotest.sh@120 -- # xtrace_disable_per_cmd reap_spdk_processes 00:04:09.643 02:23:43 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:04:09.643 02:23:43 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:04:14.917 02:23:47 -- spdk/autotest.sh@124 -- # uname -s 00:04:14.917 02:23:47 -- spdk/autotest.sh@124 -- # '[' Linux = Linux ']' 00:04:14.917 02:23:47 -- spdk/autotest.sh@125 -- # run_test setup.sh /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/test-setup.sh 00:04:14.917 02:23:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:14.917 02:23:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:14.917 02:23:47 -- common/autotest_common.sh@10 -- # set +x 00:04:14.917 ************************************ 00:04:14.917 START TEST setup.sh 00:04:14.917 ************************************ 00:04:14.917 02:23:47 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/test-setup.sh 00:04:14.917 * Looking for test storage... 00:04:14.917 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup 00:04:14.917 02:23:47 -- setup/test-setup.sh@10 -- # uname -s 00:04:14.917 02:23:47 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:04:14.917 02:23:47 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/acl.sh 00:04:14.917 02:23:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:14.917 02:23:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:14.917 02:23:47 -- common/autotest_common.sh@10 -- # set +x 00:04:14.917 ************************************ 00:04:14.917 START TEST acl 00:04:14.917 ************************************ 00:04:14.917 02:23:48 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/acl.sh 00:04:14.917 * Looking for test storage... 00:04:14.917 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup 00:04:14.917 02:23:48 -- setup/acl.sh@10 -- # get_zoned_devs 00:04:14.917 02:23:48 -- common/autotest_common.sh@1655 -- # zoned_devs=() 00:04:14.917 02:23:48 -- common/autotest_common.sh@1655 -- # local -gA zoned_devs 00:04:14.917 02:23:48 -- common/autotest_common.sh@1656 -- # local nvme bdf 00:04:14.917 02:23:48 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:04:14.917 02:23:48 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme0n1 00:04:14.917 02:23:48 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:04:14.917 02:23:48 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:14.917 02:23:48 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:04:14.917 02:23:48 -- setup/acl.sh@12 -- # devs=() 00:04:14.917 02:23:48 -- setup/acl.sh@12 -- # declare -a devs 00:04:14.917 02:23:48 -- setup/acl.sh@13 -- # drivers=() 00:04:14.917 02:23:48 -- setup/acl.sh@13 -- # declare -A drivers 00:04:14.917 02:23:48 -- setup/acl.sh@51 -- # setup reset 00:04:14.917 02:23:48 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:14.917 02:23:48 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:04:18.208 02:23:51 -- setup/acl.sh@52 -- # collect_setup_devs 00:04:18.208 02:23:51 -- setup/acl.sh@16 -- # local dev driver 00:04:18.208 02:23:51 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:18.208 02:23:51 -- setup/acl.sh@15 -- # setup output status 00:04:18.208 02:23:51 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:18.208 02:23:51 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh status 00:04:20.744 Hugepages 00:04:20.744 node hugesize free / total 00:04:20.744 02:23:54 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:04:20.744 02:23:54 -- setup/acl.sh@19 -- # continue 00:04:20.744 02:23:54 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:20.744 02:23:54 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:04:20.744 02:23:54 -- setup/acl.sh@19 -- # continue 00:04:20.744 02:23:54 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:20.744 02:23:54 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:04:20.744 02:23:54 -- setup/acl.sh@19 -- # continue 00:04:20.744 02:23:54 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:20.744 00:04:20.744 Type BDF Vendor Device NUMA Driver Device Block devices 00:04:20.744 02:23:54 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:04:20.744 02:23:54 -- setup/acl.sh@19 -- # continue 00:04:20.744 02:23:54 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:20.744 02:23:54 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:04:20.744 02:23:54 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:20.744 02:23:54 -- setup/acl.sh@20 -- # continue 00:04:20.744 02:23:54 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:20.744 02:23:54 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:04:20.744 02:23:54 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:20.744 02:23:54 -- setup/acl.sh@20 -- # continue 00:04:20.744 02:23:54 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:20.744 02:23:54 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:04:20.744 02:23:54 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:20.744 02:23:54 -- setup/acl.sh@20 -- # continue 00:04:20.744 02:23:54 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:20.744 02:23:54 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:04:20.744 02:23:54 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:20.744 02:23:54 -- setup/acl.sh@20 -- # continue 00:04:20.744 02:23:54 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:20.744 02:23:54 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:04:20.744 02:23:54 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:20.744 02:23:54 -- setup/acl.sh@20 -- # continue 00:04:20.744 02:23:54 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:20.744 02:23:54 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:04:20.744 02:23:54 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:20.744 02:23:54 -- setup/acl.sh@20 -- # continue 00:04:20.744 02:23:54 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:20.744 02:23:54 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:04:20.744 02:23:54 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:20.744 02:23:54 -- setup/acl.sh@20 -- # continue 00:04:20.744 02:23:54 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:20.744 02:23:54 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:04:20.744 02:23:54 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:20.744 02:23:54 -- setup/acl.sh@20 -- # continue 00:04:20.744 02:23:54 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:20.744 02:23:54 -- setup/acl.sh@19 -- # [[ 0000:5f:00.0 == *:*:*.* ]] 00:04:20.744 02:23:54 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:04:20.744 02:23:54 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\5\f\:\0\0\.\0* ]] 00:04:20.744 02:23:54 -- setup/acl.sh@22 -- # devs+=("$dev") 00:04:20.744 02:23:54 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:04:20.744 02:23:54 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:20.744 02:23:54 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:04:20.744 02:23:54 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:20.744 02:23:54 -- setup/acl.sh@20 -- # continue 00:04:20.744 02:23:54 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:20.744 02:23:54 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:04:20.744 02:23:54 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:20.744 02:23:54 -- setup/acl.sh@20 -- # continue 00:04:20.744 02:23:54 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:20.744 02:23:54 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:04:20.744 02:23:54 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:20.744 02:23:54 -- setup/acl.sh@20 -- # continue 00:04:20.744 02:23:54 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:20.744 02:23:54 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:04:20.744 02:23:54 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:20.744 02:23:54 -- setup/acl.sh@20 -- # continue 00:04:20.744 02:23:54 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:20.744 02:23:54 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:04:20.744 02:23:54 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:20.744 02:23:54 -- setup/acl.sh@20 -- # continue 00:04:20.744 02:23:54 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:20.744 02:23:54 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:04:20.744 02:23:54 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:20.744 02:23:54 -- setup/acl.sh@20 -- # continue 00:04:20.744 02:23:54 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:20.744 02:23:54 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:04:20.744 02:23:54 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:20.744 02:23:54 -- setup/acl.sh@20 -- # continue 00:04:20.744 02:23:54 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:20.744 02:23:54 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:04:20.744 02:23:54 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:20.744 02:23:54 -- setup/acl.sh@20 -- # continue 00:04:20.744 02:23:54 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:20.744 02:23:54 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:04:20.744 02:23:54 -- setup/acl.sh@54 -- # run_test denied denied 00:04:20.744 02:23:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:20.744 02:23:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:20.744 02:23:54 -- common/autotest_common.sh@10 -- # set +x 00:04:21.004 ************************************ 00:04:21.004 START TEST denied 00:04:21.004 ************************************ 00:04:21.004 02:23:54 -- common/autotest_common.sh@1111 -- # denied 00:04:21.004 02:23:54 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:5f:00.0' 00:04:21.004 02:23:54 -- setup/acl.sh@38 -- # setup output config 00:04:21.004 02:23:54 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:5f:00.0' 00:04:21.004 02:23:54 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:21.004 02:23:54 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:04:24.294 0000:5f:00.0 (8086 0a54): Skipping denied controller at 0000:5f:00.0 00:04:24.294 02:23:57 -- setup/acl.sh@40 -- # verify 0000:5f:00.0 00:04:24.294 02:23:57 -- setup/acl.sh@28 -- # local dev driver 00:04:24.294 02:23:57 -- setup/acl.sh@30 -- # for dev in "$@" 00:04:24.294 02:23:57 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:5f:00.0 ]] 00:04:24.294 02:23:57 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:5f:00.0/driver 00:04:24.294 02:23:57 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:04:24.294 02:23:57 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:04:24.294 02:23:57 -- setup/acl.sh@41 -- # setup reset 00:04:24.294 02:23:57 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:24.294 02:23:57 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:04:28.495 00:04:28.495 real 0m6.894s 00:04:28.495 user 0m1.955s 00:04:28.495 sys 0m4.170s 00:04:28.495 02:24:01 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:28.495 02:24:01 -- common/autotest_common.sh@10 -- # set +x 00:04:28.495 ************************************ 00:04:28.495 END TEST denied 00:04:28.495 ************************************ 00:04:28.495 02:24:01 -- setup/acl.sh@55 -- # run_test allowed allowed 00:04:28.495 02:24:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:28.495 02:24:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:28.496 02:24:01 -- common/autotest_common.sh@10 -- # set +x 00:04:28.496 ************************************ 00:04:28.496 START TEST allowed 00:04:28.496 ************************************ 00:04:28.496 02:24:01 -- common/autotest_common.sh@1111 -- # allowed 00:04:28.496 02:24:01 -- setup/acl.sh@46 -- # grep -E '0000:5f:00.0 .*: nvme -> .*' 00:04:28.496 02:24:01 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:5f:00.0 00:04:28.496 02:24:01 -- setup/acl.sh@45 -- # setup output config 00:04:28.496 02:24:01 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:28.496 02:24:01 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:04:35.129 0000:5f:00.0 (8086 0a54): nvme -> vfio-pci 00:04:35.129 02:24:07 -- setup/acl.sh@47 -- # verify 00:04:35.129 02:24:07 -- setup/acl.sh@28 -- # local dev driver 00:04:35.129 02:24:07 -- setup/acl.sh@48 -- # setup reset 00:04:35.129 02:24:07 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:35.129 02:24:07 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:04:37.662 00:04:37.662 real 0m9.579s 00:04:37.662 user 0m2.085s 00:04:37.662 sys 0m4.205s 00:04:37.662 02:24:11 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:37.662 02:24:11 -- common/autotest_common.sh@10 -- # set +x 00:04:37.662 ************************************ 00:04:37.662 END TEST allowed 00:04:37.662 ************************************ 00:04:37.662 00:04:37.662 real 0m23.126s 00:04:37.662 user 0m6.419s 00:04:37.662 sys 0m12.777s 00:04:37.662 02:24:11 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:37.662 02:24:11 -- common/autotest_common.sh@10 -- # set +x 00:04:37.662 ************************************ 00:04:37.662 END TEST acl 00:04:37.662 ************************************ 00:04:37.662 02:24:11 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/hugepages.sh 00:04:37.662 02:24:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:37.662 02:24:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:37.662 02:24:11 -- common/autotest_common.sh@10 -- # set +x 00:04:37.923 ************************************ 00:04:37.923 START TEST hugepages 00:04:37.923 ************************************ 00:04:37.923 02:24:11 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/hugepages.sh 00:04:37.923 * Looking for test storage... 00:04:37.923 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup 00:04:37.923 02:24:11 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:04:37.923 02:24:11 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:04:37.923 02:24:11 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:04:37.923 02:24:11 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:04:37.923 02:24:11 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:04:37.923 02:24:11 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:04:37.923 02:24:11 -- setup/common.sh@17 -- # local get=Hugepagesize 00:04:37.923 02:24:11 -- setup/common.sh@18 -- # local node= 00:04:37.923 02:24:11 -- setup/common.sh@19 -- # local var val 00:04:37.923 02:24:11 -- setup/common.sh@20 -- # local mem_f mem 00:04:37.923 02:24:11 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:37.923 02:24:11 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:37.923 02:24:11 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:37.923 02:24:11 -- setup/common.sh@28 -- # mapfile -t mem 00:04:37.923 02:24:11 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.923 02:24:11 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 44029356 kB' 'MemAvailable: 47618968 kB' 'Buffers: 5092 kB' 'Cached: 9484320 kB' 'SwapCached: 0 kB' 'Active: 6502028 kB' 'Inactive: 3423272 kB' 'Active(anon): 5941528 kB' 'Inactive(anon): 0 kB' 'Active(file): 560500 kB' 'Inactive(file): 3423272 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 439380 kB' 'Mapped: 194724 kB' 'Shmem: 5505640 kB' 'KReclaimable: 205564 kB' 'Slab: 644228 kB' 'SReclaimable: 205564 kB' 'SUnreclaim: 438664 kB' 'KernelStack: 16592 kB' 'PageTables: 8156 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36439252 kB' 'Committed_AS: 7183388 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 202852 kB' 'VmallocChunk: 0 kB' 'Percpu: 52480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 1918424 kB' 'DirectMap2M: 18728960 kB' 'DirectMap1G: 48234496 kB' 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.923 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.923 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # continue 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.924 02:24:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.924 02:24:11 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:37.924 02:24:11 -- setup/common.sh@33 -- # echo 2048 00:04:37.924 02:24:11 -- setup/common.sh@33 -- # return 0 00:04:37.924 02:24:11 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:04:37.924 02:24:11 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:04:37.924 02:24:11 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:04:37.924 02:24:11 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:04:37.924 02:24:11 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:04:37.924 02:24:11 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:04:37.924 02:24:11 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:04:37.924 02:24:11 -- setup/hugepages.sh@207 -- # get_nodes 00:04:37.924 02:24:11 -- setup/hugepages.sh@27 -- # local node 00:04:37.924 02:24:11 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:37.924 02:24:11 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:04:37.924 02:24:11 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:37.924 02:24:11 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:37.924 02:24:11 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:37.924 02:24:11 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:37.924 02:24:11 -- setup/hugepages.sh@208 -- # clear_hp 00:04:37.924 02:24:11 -- setup/hugepages.sh@37 -- # local node hp 00:04:37.924 02:24:11 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:37.924 02:24:11 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:37.924 02:24:11 -- setup/hugepages.sh@41 -- # echo 0 00:04:37.924 02:24:11 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:37.924 02:24:11 -- setup/hugepages.sh@41 -- # echo 0 00:04:38.183 02:24:11 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:38.183 02:24:11 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:38.183 02:24:11 -- setup/hugepages.sh@41 -- # echo 0 00:04:38.183 02:24:11 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:38.183 02:24:11 -- setup/hugepages.sh@41 -- # echo 0 00:04:38.183 02:24:11 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:04:38.183 02:24:11 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:04:38.183 02:24:11 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:04:38.183 02:24:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:38.183 02:24:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:38.183 02:24:11 -- common/autotest_common.sh@10 -- # set +x 00:04:38.183 ************************************ 00:04:38.183 START TEST default_setup 00:04:38.183 ************************************ 00:04:38.183 02:24:11 -- common/autotest_common.sh@1111 -- # default_setup 00:04:38.183 02:24:11 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:04:38.183 02:24:11 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:38.183 02:24:11 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:04:38.183 02:24:11 -- setup/hugepages.sh@51 -- # shift 00:04:38.183 02:24:11 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:04:38.183 02:24:11 -- setup/hugepages.sh@52 -- # local node_ids 00:04:38.183 02:24:11 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:38.183 02:24:11 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:38.183 02:24:11 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:04:38.183 02:24:11 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:04:38.183 02:24:11 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:38.183 02:24:11 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:38.183 02:24:11 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:38.183 02:24:11 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:38.183 02:24:11 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:38.183 02:24:11 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:04:38.183 02:24:11 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:38.183 02:24:11 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:04:38.183 02:24:11 -- setup/hugepages.sh@73 -- # return 0 00:04:38.183 02:24:11 -- setup/hugepages.sh@137 -- # setup output 00:04:38.184 02:24:11 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:38.184 02:24:11 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:04:41.476 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:04:41.476 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:04:41.476 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:04:41.476 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:04:41.476 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:04:41.476 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:04:41.476 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:04:41.476 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:04:41.476 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:04:41.476 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:04:41.476 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:04:41.476 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:04:41.476 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:04:41.476 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:04:41.476 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:04:41.476 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:04:44.772 0000:5f:00.0 (8086 0a54): nvme -> vfio-pci 00:04:44.772 02:24:18 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:04:44.772 02:24:18 -- setup/hugepages.sh@89 -- # local node 00:04:44.772 02:24:18 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:44.772 02:24:18 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:44.772 02:24:18 -- setup/hugepages.sh@92 -- # local surp 00:04:44.772 02:24:18 -- setup/hugepages.sh@93 -- # local resv 00:04:44.772 02:24:18 -- setup/hugepages.sh@94 -- # local anon 00:04:44.772 02:24:18 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:44.772 02:24:18 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:44.772 02:24:18 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:44.772 02:24:18 -- setup/common.sh@18 -- # local node= 00:04:44.772 02:24:18 -- setup/common.sh@19 -- # local var val 00:04:44.772 02:24:18 -- setup/common.sh@20 -- # local mem_f mem 00:04:44.772 02:24:18 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:44.772 02:24:18 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:44.772 02:24:18 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:44.772 02:24:18 -- setup/common.sh@28 -- # mapfile -t mem 00:04:44.772 02:24:18 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.772 02:24:18 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46194432 kB' 'MemAvailable: 49783804 kB' 'Buffers: 5092 kB' 'Cached: 9484448 kB' 'SwapCached: 0 kB' 'Active: 6516312 kB' 'Inactive: 3423272 kB' 'Active(anon): 5955812 kB' 'Inactive(anon): 0 kB' 'Active(file): 560500 kB' 'Inactive(file): 3423272 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 453312 kB' 'Mapped: 194924 kB' 'Shmem: 5505768 kB' 'KReclaimable: 205084 kB' 'Slab: 642816 kB' 'SReclaimable: 205084 kB' 'SUnreclaim: 437732 kB' 'KernelStack: 16672 kB' 'PageTables: 8548 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 7199060 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203092 kB' 'VmallocChunk: 0 kB' 'Percpu: 52480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1918424 kB' 'DirectMap2M: 18728960 kB' 'DirectMap1G: 48234496 kB' 00:04:44.772 02:24:18 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.772 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.772 02:24:18 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.772 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.772 02:24:18 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.772 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.772 02:24:18 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.772 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.772 02:24:18 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.772 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.772 02:24:18 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.772 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.772 02:24:18 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.772 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.772 02:24:18 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.772 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.772 02:24:18 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.772 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.772 02:24:18 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.772 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.772 02:24:18 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.772 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.772 02:24:18 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.772 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.772 02:24:18 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.772 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.772 02:24:18 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.772 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.772 02:24:18 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.772 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.772 02:24:18 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.772 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.772 02:24:18 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.772 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.772 02:24:18 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.772 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.772 02:24:18 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.772 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.772 02:24:18 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.772 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.772 02:24:18 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.772 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.772 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.773 02:24:18 -- setup/common.sh@33 -- # echo 0 00:04:44.773 02:24:18 -- setup/common.sh@33 -- # return 0 00:04:44.773 02:24:18 -- setup/hugepages.sh@97 -- # anon=0 00:04:44.773 02:24:18 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:44.773 02:24:18 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:44.773 02:24:18 -- setup/common.sh@18 -- # local node= 00:04:44.773 02:24:18 -- setup/common.sh@19 -- # local var val 00:04:44.773 02:24:18 -- setup/common.sh@20 -- # local mem_f mem 00:04:44.773 02:24:18 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:44.773 02:24:18 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:44.773 02:24:18 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:44.773 02:24:18 -- setup/common.sh@28 -- # mapfile -t mem 00:04:44.773 02:24:18 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.773 02:24:18 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46194088 kB' 'MemAvailable: 49783460 kB' 'Buffers: 5092 kB' 'Cached: 9484452 kB' 'SwapCached: 0 kB' 'Active: 6516044 kB' 'Inactive: 3423272 kB' 'Active(anon): 5955544 kB' 'Inactive(anon): 0 kB' 'Active(file): 560500 kB' 'Inactive(file): 3423272 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 453036 kB' 'Mapped: 194844 kB' 'Shmem: 5505772 kB' 'KReclaimable: 205084 kB' 'Slab: 642776 kB' 'SReclaimable: 205084 kB' 'SUnreclaim: 437692 kB' 'KernelStack: 16592 kB' 'PageTables: 8172 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 7197684 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 202980 kB' 'VmallocChunk: 0 kB' 'Percpu: 52480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1918424 kB' 'DirectMap2M: 18728960 kB' 'DirectMap1G: 48234496 kB' 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.773 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.773 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.774 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.774 02:24:18 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.774 02:24:18 -- setup/common.sh@33 -- # echo 0 00:04:44.774 02:24:18 -- setup/common.sh@33 -- # return 0 00:04:44.774 02:24:18 -- setup/hugepages.sh@99 -- # surp=0 00:04:44.774 02:24:18 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:44.774 02:24:18 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:44.774 02:24:18 -- setup/common.sh@18 -- # local node= 00:04:44.774 02:24:18 -- setup/common.sh@19 -- # local var val 00:04:44.774 02:24:18 -- setup/common.sh@20 -- # local mem_f mem 00:04:44.774 02:24:18 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:44.774 02:24:18 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:44.774 02:24:18 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:44.774 02:24:18 -- setup/common.sh@28 -- # mapfile -t mem 00:04:44.775 02:24:18 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.775 02:24:18 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46194344 kB' 'MemAvailable: 49783716 kB' 'Buffers: 5092 kB' 'Cached: 9484468 kB' 'SwapCached: 0 kB' 'Active: 6516308 kB' 'Inactive: 3423272 kB' 'Active(anon): 5955808 kB' 'Inactive(anon): 0 kB' 'Active(file): 560500 kB' 'Inactive(file): 3423272 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 453328 kB' 'Mapped: 194844 kB' 'Shmem: 5505788 kB' 'KReclaimable: 205084 kB' 'Slab: 642776 kB' 'SReclaimable: 205084 kB' 'SUnreclaim: 437692 kB' 'KernelStack: 16704 kB' 'PageTables: 8336 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 7199468 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203060 kB' 'VmallocChunk: 0 kB' 'Percpu: 52480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1918424 kB' 'DirectMap2M: 18728960 kB' 'DirectMap1G: 48234496 kB' 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.775 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.775 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.776 02:24:18 -- setup/common.sh@33 -- # echo 0 00:04:44.776 02:24:18 -- setup/common.sh@33 -- # return 0 00:04:44.776 02:24:18 -- setup/hugepages.sh@100 -- # resv=0 00:04:44.776 02:24:18 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:44.776 nr_hugepages=1024 00:04:44.776 02:24:18 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:44.776 resv_hugepages=0 00:04:44.776 02:24:18 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:44.776 surplus_hugepages=0 00:04:44.776 02:24:18 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:44.776 anon_hugepages=0 00:04:44.776 02:24:18 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:44.776 02:24:18 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:44.776 02:24:18 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:44.776 02:24:18 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:44.776 02:24:18 -- setup/common.sh@18 -- # local node= 00:04:44.776 02:24:18 -- setup/common.sh@19 -- # local var val 00:04:44.776 02:24:18 -- setup/common.sh@20 -- # local mem_f mem 00:04:44.776 02:24:18 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:44.776 02:24:18 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:44.776 02:24:18 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:44.776 02:24:18 -- setup/common.sh@28 -- # mapfile -t mem 00:04:44.776 02:24:18 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.776 02:24:18 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46193240 kB' 'MemAvailable: 49782612 kB' 'Buffers: 5092 kB' 'Cached: 9484496 kB' 'SwapCached: 0 kB' 'Active: 6516668 kB' 'Inactive: 3423272 kB' 'Active(anon): 5956168 kB' 'Inactive(anon): 0 kB' 'Active(file): 560500 kB' 'Inactive(file): 3423272 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 453740 kB' 'Mapped: 194844 kB' 'Shmem: 5505816 kB' 'KReclaimable: 205084 kB' 'Slab: 642776 kB' 'SReclaimable: 205084 kB' 'SUnreclaim: 437692 kB' 'KernelStack: 16736 kB' 'PageTables: 8456 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 7199484 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203108 kB' 'VmallocChunk: 0 kB' 'Percpu: 52480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1918424 kB' 'DirectMap2M: 18728960 kB' 'DirectMap1G: 48234496 kB' 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.776 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.776 02:24:18 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.777 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.777 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.778 02:24:18 -- setup/common.sh@33 -- # echo 1024 00:04:44.778 02:24:18 -- setup/common.sh@33 -- # return 0 00:04:44.778 02:24:18 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:44.778 02:24:18 -- setup/hugepages.sh@112 -- # get_nodes 00:04:44.778 02:24:18 -- setup/hugepages.sh@27 -- # local node 00:04:44.778 02:24:18 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:44.778 02:24:18 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:44.778 02:24:18 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:44.778 02:24:18 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:44.778 02:24:18 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:44.778 02:24:18 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:44.778 02:24:18 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:44.778 02:24:18 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:44.778 02:24:18 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:44.778 02:24:18 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:44.778 02:24:18 -- setup/common.sh@18 -- # local node=0 00:04:44.778 02:24:18 -- setup/common.sh@19 -- # local var val 00:04:44.778 02:24:18 -- setup/common.sh@20 -- # local mem_f mem 00:04:44.778 02:24:18 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:44.778 02:24:18 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:44.778 02:24:18 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:44.778 02:24:18 -- setup/common.sh@28 -- # mapfile -t mem 00:04:44.778 02:24:18 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.778 02:24:18 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32587064 kB' 'MemFree: 27371040 kB' 'MemUsed: 5216024 kB' 'SwapCached: 0 kB' 'Active: 1730884 kB' 'Inactive: 78032 kB' 'Active(anon): 1348124 kB' 'Inactive(anon): 0 kB' 'Active(file): 382760 kB' 'Inactive(file): 78032 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1676428 kB' 'Mapped: 60008 kB' 'AnonPages: 135688 kB' 'Shmem: 1215636 kB' 'KernelStack: 9928 kB' 'PageTables: 4192 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 118464 kB' 'Slab: 373888 kB' 'SReclaimable: 118464 kB' 'SUnreclaim: 255424 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.778 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.778 02:24:18 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.779 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.779 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.779 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.779 02:24:18 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.779 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.779 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.779 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.779 02:24:18 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.779 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.779 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.779 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.779 02:24:18 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.779 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.779 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.779 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.779 02:24:18 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.779 02:24:18 -- setup/common.sh@32 -- # continue 00:04:44.779 02:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.779 02:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.779 02:24:18 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.779 02:24:18 -- setup/common.sh@33 -- # echo 0 00:04:44.779 02:24:18 -- setup/common.sh@33 -- # return 0 00:04:44.779 02:24:18 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:44.779 02:24:18 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:44.779 02:24:18 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:44.779 02:24:18 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:44.779 02:24:18 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:44.779 node0=1024 expecting 1024 00:04:44.779 02:24:18 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:44.779 00:04:44.779 real 0m6.555s 00:04:44.779 user 0m1.313s 00:04:44.779 sys 0m2.168s 00:04:44.779 02:24:18 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:44.779 02:24:18 -- common/autotest_common.sh@10 -- # set +x 00:04:44.779 ************************************ 00:04:44.779 END TEST default_setup 00:04:44.779 ************************************ 00:04:44.779 02:24:18 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:04:44.779 02:24:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:44.779 02:24:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:44.779 02:24:18 -- common/autotest_common.sh@10 -- # set +x 00:04:45.038 ************************************ 00:04:45.038 START TEST per_node_1G_alloc 00:04:45.038 ************************************ 00:04:45.038 02:24:18 -- common/autotest_common.sh@1111 -- # per_node_1G_alloc 00:04:45.038 02:24:18 -- setup/hugepages.sh@143 -- # local IFS=, 00:04:45.038 02:24:18 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:04:45.039 02:24:18 -- setup/hugepages.sh@49 -- # local size=1048576 00:04:45.039 02:24:18 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:04:45.039 02:24:18 -- setup/hugepages.sh@51 -- # shift 00:04:45.039 02:24:18 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:04:45.039 02:24:18 -- setup/hugepages.sh@52 -- # local node_ids 00:04:45.039 02:24:18 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:45.039 02:24:18 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:04:45.039 02:24:18 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:04:45.039 02:24:18 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:04:45.039 02:24:18 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:45.039 02:24:18 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:04:45.039 02:24:18 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:45.039 02:24:18 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:45.039 02:24:18 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:45.039 02:24:18 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:04:45.039 02:24:18 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:45.039 02:24:18 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:04:45.039 02:24:18 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:45.039 02:24:18 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:04:45.039 02:24:18 -- setup/hugepages.sh@73 -- # return 0 00:04:45.039 02:24:18 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:04:45.039 02:24:18 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:04:45.039 02:24:18 -- setup/hugepages.sh@146 -- # setup output 00:04:45.039 02:24:18 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:45.039 02:24:18 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:04:48.333 0000:5f:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:48.333 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:04:48.333 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:04:48.333 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:04:48.333 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:04:48.333 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:04:48.333 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:04:48.333 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:04:48.333 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:04:48.333 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:04:48.333 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:04:48.333 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:04:48.333 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:04:48.333 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:04:48.333 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:04:48.333 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:04:48.333 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:04:48.333 02:24:21 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:04:48.333 02:24:21 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:04:48.333 02:24:21 -- setup/hugepages.sh@89 -- # local node 00:04:48.333 02:24:21 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:48.333 02:24:21 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:48.333 02:24:21 -- setup/hugepages.sh@92 -- # local surp 00:04:48.333 02:24:21 -- setup/hugepages.sh@93 -- # local resv 00:04:48.333 02:24:21 -- setup/hugepages.sh@94 -- # local anon 00:04:48.333 02:24:21 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:48.333 02:24:21 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:48.333 02:24:21 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:48.333 02:24:21 -- setup/common.sh@18 -- # local node= 00:04:48.333 02:24:21 -- setup/common.sh@19 -- # local var val 00:04:48.333 02:24:21 -- setup/common.sh@20 -- # local mem_f mem 00:04:48.333 02:24:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:48.333 02:24:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:48.333 02:24:21 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:48.333 02:24:21 -- setup/common.sh@28 -- # mapfile -t mem 00:04:48.333 02:24:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:48.333 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.333 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.333 02:24:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46192608 kB' 'MemAvailable: 49781968 kB' 'Buffers: 5092 kB' 'Cached: 9484572 kB' 'SwapCached: 0 kB' 'Active: 6511876 kB' 'Inactive: 3423272 kB' 'Active(anon): 5951376 kB' 'Inactive(anon): 0 kB' 'Active(file): 560500 kB' 'Inactive(file): 3423272 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 448716 kB' 'Mapped: 193956 kB' 'Shmem: 5505892 kB' 'KReclaimable: 205060 kB' 'Slab: 643148 kB' 'SReclaimable: 205060 kB' 'SUnreclaim: 438088 kB' 'KernelStack: 16480 kB' 'PageTables: 7876 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 7190444 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 202964 kB' 'VmallocChunk: 0 kB' 'Percpu: 52480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1918424 kB' 'DirectMap2M: 18728960 kB' 'DirectMap1G: 48234496 kB' 00:04:48.333 02:24:21 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.333 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.333 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.333 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.333 02:24:21 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.333 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.333 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.333 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.333 02:24:21 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.333 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.333 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.333 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.333 02:24:21 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.333 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.333 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.333 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.333 02:24:21 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.333 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.333 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.333 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.333 02:24:21 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.333 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.333 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.333 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.333 02:24:21 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.333 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.333 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.333 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.333 02:24:21 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.333 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.333 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.333 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.333 02:24:21 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.333 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.333 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.333 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.333 02:24:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.333 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.333 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.333 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.333 02:24:21 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.333 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.333 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.333 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.333 02:24:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.333 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.333 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.333 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.333 02:24:21 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.333 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.333 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.333 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.333 02:24:21 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.333 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.333 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.334 02:24:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.334 02:24:21 -- setup/common.sh@33 -- # echo 0 00:04:48.334 02:24:21 -- setup/common.sh@33 -- # return 0 00:04:48.334 02:24:21 -- setup/hugepages.sh@97 -- # anon=0 00:04:48.334 02:24:21 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:48.334 02:24:21 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:48.334 02:24:21 -- setup/common.sh@18 -- # local node= 00:04:48.334 02:24:21 -- setup/common.sh@19 -- # local var val 00:04:48.334 02:24:21 -- setup/common.sh@20 -- # local mem_f mem 00:04:48.334 02:24:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:48.334 02:24:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:48.334 02:24:21 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:48.334 02:24:21 -- setup/common.sh@28 -- # mapfile -t mem 00:04:48.334 02:24:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.334 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.335 02:24:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46191988 kB' 'MemAvailable: 49781348 kB' 'Buffers: 5092 kB' 'Cached: 9484576 kB' 'SwapCached: 0 kB' 'Active: 6512160 kB' 'Inactive: 3423272 kB' 'Active(anon): 5951660 kB' 'Inactive(anon): 0 kB' 'Active(file): 560500 kB' 'Inactive(file): 3423272 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 449008 kB' 'Mapped: 193956 kB' 'Shmem: 5505896 kB' 'KReclaimable: 205060 kB' 'Slab: 643140 kB' 'SReclaimable: 205060 kB' 'SUnreclaim: 438080 kB' 'KernelStack: 16480 kB' 'PageTables: 7896 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 7190456 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 202932 kB' 'VmallocChunk: 0 kB' 'Percpu: 52480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1918424 kB' 'DirectMap2M: 18728960 kB' 'DirectMap1G: 48234496 kB' 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.335 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.335 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.336 02:24:21 -- setup/common.sh@33 -- # echo 0 00:04:48.336 02:24:21 -- setup/common.sh@33 -- # return 0 00:04:48.336 02:24:21 -- setup/hugepages.sh@99 -- # surp=0 00:04:48.336 02:24:21 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:48.336 02:24:21 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:48.336 02:24:21 -- setup/common.sh@18 -- # local node= 00:04:48.336 02:24:21 -- setup/common.sh@19 -- # local var val 00:04:48.336 02:24:21 -- setup/common.sh@20 -- # local mem_f mem 00:04:48.336 02:24:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:48.336 02:24:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:48.336 02:24:21 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:48.336 02:24:21 -- setup/common.sh@28 -- # mapfile -t mem 00:04:48.336 02:24:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.336 02:24:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46200988 kB' 'MemAvailable: 49790348 kB' 'Buffers: 5092 kB' 'Cached: 9484576 kB' 'SwapCached: 0 kB' 'Active: 6511876 kB' 'Inactive: 3423272 kB' 'Active(anon): 5951376 kB' 'Inactive(anon): 0 kB' 'Active(file): 560500 kB' 'Inactive(file): 3423272 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 448776 kB' 'Mapped: 193956 kB' 'Shmem: 5505896 kB' 'KReclaimable: 205060 kB' 'Slab: 643140 kB' 'SReclaimable: 205060 kB' 'SUnreclaim: 438080 kB' 'KernelStack: 16464 kB' 'PageTables: 7852 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 7190472 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 202932 kB' 'VmallocChunk: 0 kB' 'Percpu: 52480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1918424 kB' 'DirectMap2M: 18728960 kB' 'DirectMap1G: 48234496 kB' 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.336 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.336 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.337 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.337 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.338 02:24:21 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.338 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.338 02:24:21 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.338 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.338 02:24:21 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.338 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.338 02:24:21 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.338 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.338 02:24:21 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.338 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.338 02:24:21 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.338 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.338 02:24:21 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.338 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.338 02:24:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.338 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.338 02:24:21 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.338 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.338 02:24:21 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.338 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.338 02:24:21 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.338 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.338 02:24:21 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.338 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.338 02:24:21 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.338 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.338 02:24:21 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.338 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.338 02:24:21 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.338 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.338 02:24:21 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.338 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.338 02:24:21 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.338 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.338 02:24:21 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.338 02:24:21 -- setup/common.sh@33 -- # echo 0 00:04:48.338 02:24:21 -- setup/common.sh@33 -- # return 0 00:04:48.338 02:24:21 -- setup/hugepages.sh@100 -- # resv=0 00:04:48.338 02:24:21 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:48.338 nr_hugepages=1024 00:04:48.338 02:24:21 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:48.338 resv_hugepages=0 00:04:48.338 02:24:21 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:48.338 surplus_hugepages=0 00:04:48.338 02:24:21 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:48.338 anon_hugepages=0 00:04:48.338 02:24:21 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:48.338 02:24:21 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:48.338 02:24:21 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:48.338 02:24:21 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:48.338 02:24:21 -- setup/common.sh@18 -- # local node= 00:04:48.338 02:24:21 -- setup/common.sh@19 -- # local var val 00:04:48.338 02:24:21 -- setup/common.sh@20 -- # local mem_f mem 00:04:48.338 02:24:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:48.338 02:24:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:48.338 02:24:21 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:48.338 02:24:21 -- setup/common.sh@28 -- # mapfile -t mem 00:04:48.338 02:24:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.338 02:24:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46201740 kB' 'MemAvailable: 49791100 kB' 'Buffers: 5092 kB' 'Cached: 9484600 kB' 'SwapCached: 0 kB' 'Active: 6512288 kB' 'Inactive: 3423272 kB' 'Active(anon): 5951788 kB' 'Inactive(anon): 0 kB' 'Active(file): 560500 kB' 'Inactive(file): 3423272 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 449152 kB' 'Mapped: 193956 kB' 'Shmem: 5505920 kB' 'KReclaimable: 205060 kB' 'Slab: 643140 kB' 'SReclaimable: 205060 kB' 'SUnreclaim: 438080 kB' 'KernelStack: 16480 kB' 'PageTables: 7896 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 7190484 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 202932 kB' 'VmallocChunk: 0 kB' 'Percpu: 52480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1918424 kB' 'DirectMap2M: 18728960 kB' 'DirectMap1G: 48234496 kB' 00:04:48.338 02:24:21 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.338 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.338 02:24:21 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.338 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.338 02:24:21 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.338 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.338 02:24:21 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.338 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.338 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.339 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.339 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.340 02:24:21 -- setup/common.sh@33 -- # echo 1024 00:04:48.340 02:24:21 -- setup/common.sh@33 -- # return 0 00:04:48.340 02:24:21 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:48.340 02:24:21 -- setup/hugepages.sh@112 -- # get_nodes 00:04:48.340 02:24:21 -- setup/hugepages.sh@27 -- # local node 00:04:48.340 02:24:21 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:48.340 02:24:21 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:48.340 02:24:21 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:48.340 02:24:21 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:48.340 02:24:21 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:48.340 02:24:21 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:48.340 02:24:21 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:48.340 02:24:21 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:48.340 02:24:21 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:48.340 02:24:21 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:48.340 02:24:21 -- setup/common.sh@18 -- # local node=0 00:04:48.340 02:24:21 -- setup/common.sh@19 -- # local var val 00:04:48.340 02:24:21 -- setup/common.sh@20 -- # local mem_f mem 00:04:48.340 02:24:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:48.340 02:24:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:48.340 02:24:21 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:48.340 02:24:21 -- setup/common.sh@28 -- # mapfile -t mem 00:04:48.340 02:24:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.340 02:24:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32587064 kB' 'MemFree: 28423184 kB' 'MemUsed: 4163880 kB' 'SwapCached: 0 kB' 'Active: 1729916 kB' 'Inactive: 78032 kB' 'Active(anon): 1347156 kB' 'Inactive(anon): 0 kB' 'Active(file): 382760 kB' 'Inactive(file): 78032 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1676452 kB' 'Mapped: 59112 kB' 'AnonPages: 134688 kB' 'Shmem: 1215660 kB' 'KernelStack: 9672 kB' 'PageTables: 3572 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 118432 kB' 'Slab: 374300 kB' 'SReclaimable: 118432 kB' 'SUnreclaim: 255868 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.340 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.340 02:24:21 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.341 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.341 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.342 02:24:21 -- setup/common.sh@33 -- # echo 0 00:04:48.342 02:24:21 -- setup/common.sh@33 -- # return 0 00:04:48.342 02:24:21 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:48.342 02:24:21 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:48.342 02:24:21 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:48.342 02:24:21 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:48.342 02:24:21 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:48.342 02:24:21 -- setup/common.sh@18 -- # local node=1 00:04:48.342 02:24:21 -- setup/common.sh@19 -- # local var val 00:04:48.342 02:24:21 -- setup/common.sh@20 -- # local mem_f mem 00:04:48.342 02:24:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:48.342 02:24:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:48.342 02:24:21 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:48.342 02:24:21 -- setup/common.sh@28 -- # mapfile -t mem 00:04:48.342 02:24:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.342 02:24:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27708540 kB' 'MemFree: 17777296 kB' 'MemUsed: 9931244 kB' 'SwapCached: 0 kB' 'Active: 4782336 kB' 'Inactive: 3345240 kB' 'Active(anon): 4604596 kB' 'Inactive(anon): 0 kB' 'Active(file): 177740 kB' 'Inactive(file): 3345240 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7813268 kB' 'Mapped: 134844 kB' 'AnonPages: 314456 kB' 'Shmem: 4290288 kB' 'KernelStack: 6808 kB' 'PageTables: 4324 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 86628 kB' 'Slab: 268840 kB' 'SReclaimable: 86628 kB' 'SUnreclaim: 182212 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.342 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.342 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.343 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.343 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.343 02:24:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.343 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.343 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.343 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.343 02:24:21 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.343 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.343 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.343 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.343 02:24:21 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.343 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.343 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.343 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.343 02:24:21 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.343 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.343 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.343 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.343 02:24:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.343 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.343 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.343 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.343 02:24:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.343 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.343 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.343 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.343 02:24:21 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.343 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.343 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.343 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.343 02:24:21 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.343 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.343 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.343 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.343 02:24:21 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.343 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.343 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.343 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.343 02:24:21 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.343 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.343 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.343 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.343 02:24:21 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.343 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.343 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.343 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.343 02:24:21 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.343 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.343 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.343 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.343 02:24:21 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.343 02:24:21 -- setup/common.sh@32 -- # continue 00:04:48.343 02:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.343 02:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.343 02:24:21 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.343 02:24:21 -- setup/common.sh@33 -- # echo 0 00:04:48.343 02:24:21 -- setup/common.sh@33 -- # return 0 00:04:48.343 02:24:21 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:48.343 02:24:21 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:48.343 02:24:21 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:48.343 02:24:21 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:48.343 02:24:21 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:48.343 node0=512 expecting 512 00:04:48.343 02:24:21 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:48.343 02:24:21 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:48.343 02:24:21 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:48.343 02:24:21 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:04:48.343 node1=512 expecting 512 00:04:48.343 02:24:21 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:04:48.343 00:04:48.343 real 0m3.260s 00:04:48.343 user 0m1.222s 00:04:48.343 sys 0m2.075s 00:04:48.343 02:24:21 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:48.343 02:24:21 -- common/autotest_common.sh@10 -- # set +x 00:04:48.343 ************************************ 00:04:48.343 END TEST per_node_1G_alloc 00:04:48.343 ************************************ 00:04:48.343 02:24:21 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:04:48.343 02:24:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:48.343 02:24:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:48.343 02:24:21 -- common/autotest_common.sh@10 -- # set +x 00:04:48.343 ************************************ 00:04:48.343 START TEST even_2G_alloc 00:04:48.343 ************************************ 00:04:48.343 02:24:21 -- common/autotest_common.sh@1111 -- # even_2G_alloc 00:04:48.343 02:24:21 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:04:48.343 02:24:21 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:48.343 02:24:21 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:48.343 02:24:21 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:48.343 02:24:21 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:48.343 02:24:21 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:48.343 02:24:21 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:48.343 02:24:21 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:48.343 02:24:21 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:48.343 02:24:21 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:48.343 02:24:21 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:48.343 02:24:21 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:48.343 02:24:21 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:48.343 02:24:21 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:48.343 02:24:21 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:48.343 02:24:21 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:48.343 02:24:21 -- setup/hugepages.sh@83 -- # : 512 00:04:48.343 02:24:21 -- setup/hugepages.sh@84 -- # : 1 00:04:48.343 02:24:21 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:48.343 02:24:21 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:48.343 02:24:21 -- setup/hugepages.sh@83 -- # : 0 00:04:48.343 02:24:21 -- setup/hugepages.sh@84 -- # : 0 00:04:48.343 02:24:21 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:48.343 02:24:21 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:04:48.343 02:24:21 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:04:48.343 02:24:21 -- setup/hugepages.sh@153 -- # setup output 00:04:48.343 02:24:21 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:48.343 02:24:21 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:04:51.638 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:04:51.638 0000:5f:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:51.638 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:04:51.638 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:04:51.638 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:04:51.638 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:04:51.638 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:04:51.638 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:04:51.638 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:04:51.638 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:04:51.638 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:04:51.638 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:04:51.638 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:04:51.638 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:04:51.638 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:04:51.638 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:04:51.638 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:04:51.638 02:24:25 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:04:51.638 02:24:25 -- setup/hugepages.sh@89 -- # local node 00:04:51.638 02:24:25 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:51.638 02:24:25 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:51.638 02:24:25 -- setup/hugepages.sh@92 -- # local surp 00:04:51.638 02:24:25 -- setup/hugepages.sh@93 -- # local resv 00:04:51.638 02:24:25 -- setup/hugepages.sh@94 -- # local anon 00:04:51.638 02:24:25 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:51.638 02:24:25 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:51.638 02:24:25 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:51.638 02:24:25 -- setup/common.sh@18 -- # local node= 00:04:51.638 02:24:25 -- setup/common.sh@19 -- # local var val 00:04:51.638 02:24:25 -- setup/common.sh@20 -- # local mem_f mem 00:04:51.638 02:24:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:51.638 02:24:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:51.638 02:24:25 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:51.638 02:24:25 -- setup/common.sh@28 -- # mapfile -t mem 00:04:51.638 02:24:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:51.638 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.638 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.638 02:24:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46208668 kB' 'MemAvailable: 49798028 kB' 'Buffers: 5092 kB' 'Cached: 9484684 kB' 'SwapCached: 0 kB' 'Active: 6518172 kB' 'Inactive: 3423272 kB' 'Active(anon): 5957672 kB' 'Inactive(anon): 0 kB' 'Active(file): 560500 kB' 'Inactive(file): 3423272 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 455452 kB' 'Mapped: 194452 kB' 'Shmem: 5506004 kB' 'KReclaimable: 205060 kB' 'Slab: 643272 kB' 'SReclaimable: 205060 kB' 'SUnreclaim: 438212 kB' 'KernelStack: 16576 kB' 'PageTables: 7964 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 7197236 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 202980 kB' 'VmallocChunk: 0 kB' 'Percpu: 52480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1918424 kB' 'DirectMap2M: 18728960 kB' 'DirectMap1G: 48234496 kB' 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.639 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.639 02:24:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.639 02:24:25 -- setup/common.sh@33 -- # echo 0 00:04:51.639 02:24:25 -- setup/common.sh@33 -- # return 0 00:04:51.639 02:24:25 -- setup/hugepages.sh@97 -- # anon=0 00:04:51.640 02:24:25 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:51.640 02:24:25 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:51.640 02:24:25 -- setup/common.sh@18 -- # local node= 00:04:51.640 02:24:25 -- setup/common.sh@19 -- # local var val 00:04:51.640 02:24:25 -- setup/common.sh@20 -- # local mem_f mem 00:04:51.640 02:24:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:51.640 02:24:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:51.640 02:24:25 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:51.640 02:24:25 -- setup/common.sh@28 -- # mapfile -t mem 00:04:51.640 02:24:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.640 02:24:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46208216 kB' 'MemAvailable: 49797576 kB' 'Buffers: 5092 kB' 'Cached: 9484688 kB' 'SwapCached: 0 kB' 'Active: 6513044 kB' 'Inactive: 3423272 kB' 'Active(anon): 5952544 kB' 'Inactive(anon): 0 kB' 'Active(file): 560500 kB' 'Inactive(file): 3423272 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 449860 kB' 'Mapped: 194368 kB' 'Shmem: 5506008 kB' 'KReclaimable: 205060 kB' 'Slab: 643556 kB' 'SReclaimable: 205060 kB' 'SUnreclaim: 438496 kB' 'KernelStack: 16576 kB' 'PageTables: 8180 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 7191128 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 202996 kB' 'VmallocChunk: 0 kB' 'Percpu: 52480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1918424 kB' 'DirectMap2M: 18728960 kB' 'DirectMap1G: 48234496 kB' 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.640 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.640 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.641 02:24:25 -- setup/common.sh@33 -- # echo 0 00:04:51.641 02:24:25 -- setup/common.sh@33 -- # return 0 00:04:51.641 02:24:25 -- setup/hugepages.sh@99 -- # surp=0 00:04:51.641 02:24:25 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:51.641 02:24:25 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:51.641 02:24:25 -- setup/common.sh@18 -- # local node= 00:04:51.641 02:24:25 -- setup/common.sh@19 -- # local var val 00:04:51.641 02:24:25 -- setup/common.sh@20 -- # local mem_f mem 00:04:51.641 02:24:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:51.641 02:24:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:51.641 02:24:25 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:51.641 02:24:25 -- setup/common.sh@28 -- # mapfile -t mem 00:04:51.641 02:24:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.641 02:24:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46207972 kB' 'MemAvailable: 49797332 kB' 'Buffers: 5092 kB' 'Cached: 9484700 kB' 'SwapCached: 0 kB' 'Active: 6513000 kB' 'Inactive: 3423272 kB' 'Active(anon): 5952500 kB' 'Inactive(anon): 0 kB' 'Active(file): 560500 kB' 'Inactive(file): 3423272 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 449788 kB' 'Mapped: 193968 kB' 'Shmem: 5506020 kB' 'KReclaimable: 205060 kB' 'Slab: 643548 kB' 'SReclaimable: 205060 kB' 'SUnreclaim: 438488 kB' 'KernelStack: 16576 kB' 'PageTables: 8152 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 7191144 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 202980 kB' 'VmallocChunk: 0 kB' 'Percpu: 52480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1918424 kB' 'DirectMap2M: 18728960 kB' 'DirectMap1G: 48234496 kB' 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.641 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.641 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.642 02:24:25 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.642 02:24:25 -- setup/common.sh@33 -- # echo 0 00:04:51.642 02:24:25 -- setup/common.sh@33 -- # return 0 00:04:51.642 02:24:25 -- setup/hugepages.sh@100 -- # resv=0 00:04:51.642 02:24:25 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:51.642 nr_hugepages=1024 00:04:51.642 02:24:25 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:51.642 resv_hugepages=0 00:04:51.642 02:24:25 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:51.642 surplus_hugepages=0 00:04:51.642 02:24:25 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:51.642 anon_hugepages=0 00:04:51.642 02:24:25 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:51.642 02:24:25 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:51.642 02:24:25 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:51.642 02:24:25 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:51.642 02:24:25 -- setup/common.sh@18 -- # local node= 00:04:51.642 02:24:25 -- setup/common.sh@19 -- # local var val 00:04:51.642 02:24:25 -- setup/common.sh@20 -- # local mem_f mem 00:04:51.642 02:24:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:51.642 02:24:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:51.642 02:24:25 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:51.642 02:24:25 -- setup/common.sh@28 -- # mapfile -t mem 00:04:51.642 02:24:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.642 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.643 02:24:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46208476 kB' 'MemAvailable: 49797836 kB' 'Buffers: 5092 kB' 'Cached: 9484712 kB' 'SwapCached: 0 kB' 'Active: 6513364 kB' 'Inactive: 3423272 kB' 'Active(anon): 5952864 kB' 'Inactive(anon): 0 kB' 'Active(file): 560500 kB' 'Inactive(file): 3423272 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 450132 kB' 'Mapped: 193968 kB' 'Shmem: 5506032 kB' 'KReclaimable: 205060 kB' 'Slab: 643548 kB' 'SReclaimable: 205060 kB' 'SUnreclaim: 438488 kB' 'KernelStack: 16592 kB' 'PageTables: 8196 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 7191160 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 202980 kB' 'VmallocChunk: 0 kB' 'Percpu: 52480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1918424 kB' 'DirectMap2M: 18728960 kB' 'DirectMap1G: 48234496 kB' 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.643 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.643 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.644 02:24:25 -- setup/common.sh@33 -- # echo 1024 00:04:51.644 02:24:25 -- setup/common.sh@33 -- # return 0 00:04:51.644 02:24:25 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:51.644 02:24:25 -- setup/hugepages.sh@112 -- # get_nodes 00:04:51.644 02:24:25 -- setup/hugepages.sh@27 -- # local node 00:04:51.644 02:24:25 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:51.644 02:24:25 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:51.644 02:24:25 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:51.644 02:24:25 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:51.644 02:24:25 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:51.644 02:24:25 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:51.644 02:24:25 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:51.644 02:24:25 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:51.644 02:24:25 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:51.644 02:24:25 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:51.644 02:24:25 -- setup/common.sh@18 -- # local node=0 00:04:51.644 02:24:25 -- setup/common.sh@19 -- # local var val 00:04:51.644 02:24:25 -- setup/common.sh@20 -- # local mem_f mem 00:04:51.644 02:24:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:51.644 02:24:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:51.644 02:24:25 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:51.644 02:24:25 -- setup/common.sh@28 -- # mapfile -t mem 00:04:51.644 02:24:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.644 02:24:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32587064 kB' 'MemFree: 28429360 kB' 'MemUsed: 4157704 kB' 'SwapCached: 0 kB' 'Active: 1731052 kB' 'Inactive: 78032 kB' 'Active(anon): 1348292 kB' 'Inactive(anon): 0 kB' 'Active(file): 382760 kB' 'Inactive(file): 78032 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1676512 kB' 'Mapped: 59112 kB' 'AnonPages: 135856 kB' 'Shmem: 1215720 kB' 'KernelStack: 9768 kB' 'PageTables: 3880 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 118432 kB' 'Slab: 374312 kB' 'SReclaimable: 118432 kB' 'SUnreclaim: 255880 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.644 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.644 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.645 02:24:25 -- setup/common.sh@33 -- # echo 0 00:04:51.645 02:24:25 -- setup/common.sh@33 -- # return 0 00:04:51.645 02:24:25 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:51.645 02:24:25 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:51.645 02:24:25 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:51.645 02:24:25 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:51.645 02:24:25 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:51.645 02:24:25 -- setup/common.sh@18 -- # local node=1 00:04:51.645 02:24:25 -- setup/common.sh@19 -- # local var val 00:04:51.645 02:24:25 -- setup/common.sh@20 -- # local mem_f mem 00:04:51.645 02:24:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:51.645 02:24:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:51.645 02:24:25 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:51.645 02:24:25 -- setup/common.sh@28 -- # mapfile -t mem 00:04:51.645 02:24:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.645 02:24:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27708540 kB' 'MemFree: 17779732 kB' 'MemUsed: 9928808 kB' 'SwapCached: 0 kB' 'Active: 4781988 kB' 'Inactive: 3345240 kB' 'Active(anon): 4604248 kB' 'Inactive(anon): 0 kB' 'Active(file): 177740 kB' 'Inactive(file): 3345240 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7813292 kB' 'Mapped: 134856 kB' 'AnonPages: 313960 kB' 'Shmem: 4290312 kB' 'KernelStack: 6824 kB' 'PageTables: 4316 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 86628 kB' 'Slab: 269236 kB' 'SReclaimable: 86628 kB' 'SUnreclaim: 182608 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.645 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.645 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # continue 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.646 02:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.646 02:24:25 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.646 02:24:25 -- setup/common.sh@33 -- # echo 0 00:04:51.646 02:24:25 -- setup/common.sh@33 -- # return 0 00:04:51.646 02:24:25 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:51.646 02:24:25 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:51.646 02:24:25 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:51.646 02:24:25 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:51.646 02:24:25 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:51.646 node0=512 expecting 512 00:04:51.646 02:24:25 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:51.646 02:24:25 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:51.646 02:24:25 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:51.646 02:24:25 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:04:51.646 node1=512 expecting 512 00:04:51.646 02:24:25 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:04:51.646 00:04:51.646 real 0m3.249s 00:04:51.646 user 0m1.257s 00:04:51.646 sys 0m2.055s 00:04:51.646 02:24:25 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:51.646 02:24:25 -- common/autotest_common.sh@10 -- # set +x 00:04:51.646 ************************************ 00:04:51.646 END TEST even_2G_alloc 00:04:51.646 ************************************ 00:04:51.646 02:24:25 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:04:51.646 02:24:25 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:51.646 02:24:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:51.646 02:24:25 -- common/autotest_common.sh@10 -- # set +x 00:04:51.906 ************************************ 00:04:51.906 START TEST odd_alloc 00:04:51.906 ************************************ 00:04:51.906 02:24:25 -- common/autotest_common.sh@1111 -- # odd_alloc 00:04:51.906 02:24:25 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:04:51.906 02:24:25 -- setup/hugepages.sh@49 -- # local size=2098176 00:04:51.906 02:24:25 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:51.906 02:24:25 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:51.906 02:24:25 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:04:51.906 02:24:25 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:51.906 02:24:25 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:51.906 02:24:25 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:51.906 02:24:25 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:04:51.906 02:24:25 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:51.906 02:24:25 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:51.906 02:24:25 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:51.906 02:24:25 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:51.906 02:24:25 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:51.906 02:24:25 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:51.906 02:24:25 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:51.906 02:24:25 -- setup/hugepages.sh@83 -- # : 513 00:04:51.906 02:24:25 -- setup/hugepages.sh@84 -- # : 1 00:04:51.906 02:24:25 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:51.906 02:24:25 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:04:51.906 02:24:25 -- setup/hugepages.sh@83 -- # : 0 00:04:51.906 02:24:25 -- setup/hugepages.sh@84 -- # : 0 00:04:51.906 02:24:25 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:51.906 02:24:25 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:04:51.906 02:24:25 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:04:51.906 02:24:25 -- setup/hugepages.sh@160 -- # setup output 00:04:51.906 02:24:25 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:51.906 02:24:25 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:04:55.205 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:04:55.205 0000:5f:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:55.205 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:04:55.205 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:04:55.205 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:04:55.205 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:04:55.205 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:04:55.205 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:04:55.205 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:04:55.205 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:04:55.205 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:04:55.205 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:04:55.205 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:04:55.205 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:04:55.205 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:04:55.205 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:04:55.205 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:04:55.205 02:24:28 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:04:55.205 02:24:28 -- setup/hugepages.sh@89 -- # local node 00:04:55.205 02:24:28 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:55.205 02:24:28 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:55.205 02:24:28 -- setup/hugepages.sh@92 -- # local surp 00:04:55.205 02:24:28 -- setup/hugepages.sh@93 -- # local resv 00:04:55.205 02:24:28 -- setup/hugepages.sh@94 -- # local anon 00:04:55.205 02:24:28 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:55.205 02:24:28 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:55.205 02:24:28 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:55.205 02:24:28 -- setup/common.sh@18 -- # local node= 00:04:55.205 02:24:28 -- setup/common.sh@19 -- # local var val 00:04:55.205 02:24:28 -- setup/common.sh@20 -- # local mem_f mem 00:04:55.205 02:24:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:55.205 02:24:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:55.205 02:24:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:55.205 02:24:28 -- setup/common.sh@28 -- # mapfile -t mem 00:04:55.205 02:24:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:55.205 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.205 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.205 02:24:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46216608 kB' 'MemAvailable: 49805968 kB' 'Buffers: 5092 kB' 'Cached: 9484796 kB' 'SwapCached: 0 kB' 'Active: 6513372 kB' 'Inactive: 3423272 kB' 'Active(anon): 5952872 kB' 'Inactive(anon): 0 kB' 'Active(file): 560500 kB' 'Inactive(file): 3423272 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 449568 kB' 'Mapped: 194072 kB' 'Shmem: 5506116 kB' 'KReclaimable: 205060 kB' 'Slab: 642720 kB' 'SReclaimable: 205060 kB' 'SUnreclaim: 437660 kB' 'KernelStack: 16480 kB' 'PageTables: 7920 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37486804 kB' 'Committed_AS: 7191320 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203012 kB' 'VmallocChunk: 0 kB' 'Percpu: 52480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1918424 kB' 'DirectMap2M: 18728960 kB' 'DirectMap1G: 48234496 kB' 00:04:55.205 02:24:28 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.205 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.205 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.205 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.205 02:24:28 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.205 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.205 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.206 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.206 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:55.207 02:24:28 -- setup/common.sh@33 -- # echo 0 00:04:55.207 02:24:28 -- setup/common.sh@33 -- # return 0 00:04:55.207 02:24:28 -- setup/hugepages.sh@97 -- # anon=0 00:04:55.207 02:24:28 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:55.207 02:24:28 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:55.207 02:24:28 -- setup/common.sh@18 -- # local node= 00:04:55.207 02:24:28 -- setup/common.sh@19 -- # local var val 00:04:55.207 02:24:28 -- setup/common.sh@20 -- # local mem_f mem 00:04:55.207 02:24:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:55.207 02:24:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:55.207 02:24:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:55.207 02:24:28 -- setup/common.sh@28 -- # mapfile -t mem 00:04:55.207 02:24:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.207 02:24:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46217480 kB' 'MemAvailable: 49806840 kB' 'Buffers: 5092 kB' 'Cached: 9484800 kB' 'SwapCached: 0 kB' 'Active: 6513112 kB' 'Inactive: 3423272 kB' 'Active(anon): 5952612 kB' 'Inactive(anon): 0 kB' 'Active(file): 560500 kB' 'Inactive(file): 3423272 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 449800 kB' 'Mapped: 193996 kB' 'Shmem: 5506120 kB' 'KReclaimable: 205060 kB' 'Slab: 642704 kB' 'SReclaimable: 205060 kB' 'SUnreclaim: 437644 kB' 'KernelStack: 16464 kB' 'PageTables: 7856 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37486804 kB' 'Committed_AS: 7191332 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 202980 kB' 'VmallocChunk: 0 kB' 'Percpu: 52480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1918424 kB' 'DirectMap2M: 18728960 kB' 'DirectMap1G: 48234496 kB' 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.207 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.207 02:24:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.208 02:24:28 -- setup/common.sh@33 -- # echo 0 00:04:55.208 02:24:28 -- setup/common.sh@33 -- # return 0 00:04:55.208 02:24:28 -- setup/hugepages.sh@99 -- # surp=0 00:04:55.208 02:24:28 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:55.208 02:24:28 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:55.208 02:24:28 -- setup/common.sh@18 -- # local node= 00:04:55.208 02:24:28 -- setup/common.sh@19 -- # local var val 00:04:55.208 02:24:28 -- setup/common.sh@20 -- # local mem_f mem 00:04:55.208 02:24:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:55.208 02:24:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:55.208 02:24:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:55.208 02:24:28 -- setup/common.sh@28 -- # mapfile -t mem 00:04:55.208 02:24:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.208 02:24:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46217984 kB' 'MemAvailable: 49807344 kB' 'Buffers: 5092 kB' 'Cached: 9484808 kB' 'SwapCached: 0 kB' 'Active: 6513484 kB' 'Inactive: 3423272 kB' 'Active(anon): 5952984 kB' 'Inactive(anon): 0 kB' 'Active(file): 560500 kB' 'Inactive(file): 3423272 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 450128 kB' 'Mapped: 193996 kB' 'Shmem: 5506128 kB' 'KReclaimable: 205060 kB' 'Slab: 642704 kB' 'SReclaimable: 205060 kB' 'SUnreclaim: 437644 kB' 'KernelStack: 16464 kB' 'PageTables: 7856 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37486804 kB' 'Committed_AS: 7191348 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 202980 kB' 'VmallocChunk: 0 kB' 'Percpu: 52480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1918424 kB' 'DirectMap2M: 18728960 kB' 'DirectMap1G: 48234496 kB' 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.208 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.208 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.209 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.209 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.210 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.210 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.210 02:24:28 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.210 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.210 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.210 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.210 02:24:28 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:55.210 02:24:28 -- setup/common.sh@33 -- # echo 0 00:04:55.210 02:24:28 -- setup/common.sh@33 -- # return 0 00:04:55.210 02:24:28 -- setup/hugepages.sh@100 -- # resv=0 00:04:55.210 02:24:28 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:04:55.210 nr_hugepages=1025 00:04:55.210 02:24:28 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:55.210 resv_hugepages=0 00:04:55.210 02:24:28 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:55.210 surplus_hugepages=0 00:04:55.210 02:24:28 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:55.210 anon_hugepages=0 00:04:55.210 02:24:28 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:04:55.210 02:24:28 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:04:55.210 02:24:28 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:55.210 02:24:28 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:55.210 02:24:28 -- setup/common.sh@18 -- # local node= 00:04:55.210 02:24:28 -- setup/common.sh@19 -- # local var val 00:04:55.210 02:24:28 -- setup/common.sh@20 -- # local mem_f mem 00:04:55.210 02:24:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:55.210 02:24:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:55.210 02:24:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:55.210 02:24:28 -- setup/common.sh@28 -- # mapfile -t mem 00:04:55.210 02:24:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:55.210 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.210 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.210 02:24:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46217936 kB' 'MemAvailable: 49807296 kB' 'Buffers: 5092 kB' 'Cached: 9484828 kB' 'SwapCached: 0 kB' 'Active: 6513144 kB' 'Inactive: 3423272 kB' 'Active(anon): 5952644 kB' 'Inactive(anon): 0 kB' 'Active(file): 560500 kB' 'Inactive(file): 3423272 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 449840 kB' 'Mapped: 193996 kB' 'Shmem: 5506148 kB' 'KReclaimable: 205060 kB' 'Slab: 642704 kB' 'SReclaimable: 205060 kB' 'SUnreclaim: 437644 kB' 'KernelStack: 16480 kB' 'PageTables: 7900 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37486804 kB' 'Committed_AS: 7191364 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 202980 kB' 'VmallocChunk: 0 kB' 'Percpu: 52480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1918424 kB' 'DirectMap2M: 18728960 kB' 'DirectMap1G: 48234496 kB' 00:04:55.210 02:24:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.210 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.210 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.210 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.210 02:24:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.210 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.210 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.210 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.210 02:24:28 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.210 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.210 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.210 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.210 02:24:28 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.210 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.210 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.210 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.210 02:24:28 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.210 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.210 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.210 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.210 02:24:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.210 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.210 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.210 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.210 02:24:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.210 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.210 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.210 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.210 02:24:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.210 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.210 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.210 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.210 02:24:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.210 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.210 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.210 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.210 02:24:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.210 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.210 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.210 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.210 02:24:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.210 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.210 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.210 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.210 02:24:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.210 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.210 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.210 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.210 02:24:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.210 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.210 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.210 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.210 02:24:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.210 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.210 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.210 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.210 02:24:28 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.210 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.210 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.210 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.210 02:24:28 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.210 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.210 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.210 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.210 02:24:28 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.210 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.210 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.210 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.210 02:24:28 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.210 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.210 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.210 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.210 02:24:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:55.211 02:24:28 -- setup/common.sh@33 -- # echo 1025 00:04:55.211 02:24:28 -- setup/common.sh@33 -- # return 0 00:04:55.211 02:24:28 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:04:55.211 02:24:28 -- setup/hugepages.sh@112 -- # get_nodes 00:04:55.211 02:24:28 -- setup/hugepages.sh@27 -- # local node 00:04:55.211 02:24:28 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:55.211 02:24:28 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:55.211 02:24:28 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:55.211 02:24:28 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:04:55.211 02:24:28 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:55.211 02:24:28 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:55.211 02:24:28 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:55.211 02:24:28 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:55.211 02:24:28 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:55.211 02:24:28 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:55.211 02:24:28 -- setup/common.sh@18 -- # local node=0 00:04:55.211 02:24:28 -- setup/common.sh@19 -- # local var val 00:04:55.211 02:24:28 -- setup/common.sh@20 -- # local mem_f mem 00:04:55.211 02:24:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:55.211 02:24:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:55.211 02:24:28 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:55.211 02:24:28 -- setup/common.sh@28 -- # mapfile -t mem 00:04:55.211 02:24:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.211 02:24:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32587064 kB' 'MemFree: 28469404 kB' 'MemUsed: 4117660 kB' 'SwapCached: 0 kB' 'Active: 1731540 kB' 'Inactive: 78032 kB' 'Active(anon): 1348780 kB' 'Inactive(anon): 0 kB' 'Active(file): 382760 kB' 'Inactive(file): 78032 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1676632 kB' 'Mapped: 59112 kB' 'AnonPages: 136180 kB' 'Shmem: 1215840 kB' 'KernelStack: 9672 kB' 'PageTables: 3624 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 118432 kB' 'Slab: 373664 kB' 'SReclaimable: 118432 kB' 'SUnreclaim: 255232 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.211 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.211 02:24:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.212 02:24:28 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.212 02:24:28 -- setup/common.sh@33 -- # echo 0 00:04:55.212 02:24:28 -- setup/common.sh@33 -- # return 0 00:04:55.212 02:24:28 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:55.212 02:24:28 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:55.212 02:24:28 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:55.212 02:24:28 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:55.212 02:24:28 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:55.212 02:24:28 -- setup/common.sh@18 -- # local node=1 00:04:55.212 02:24:28 -- setup/common.sh@19 -- # local var val 00:04:55.212 02:24:28 -- setup/common.sh@20 -- # local mem_f mem 00:04:55.212 02:24:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:55.212 02:24:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:55.212 02:24:28 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:55.212 02:24:28 -- setup/common.sh@28 -- # mapfile -t mem 00:04:55.212 02:24:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.212 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.213 02:24:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27708540 kB' 'MemFree: 17748532 kB' 'MemUsed: 9960008 kB' 'SwapCached: 0 kB' 'Active: 4782016 kB' 'Inactive: 3345240 kB' 'Active(anon): 4604276 kB' 'Inactive(anon): 0 kB' 'Active(file): 177740 kB' 'Inactive(file): 3345240 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7813300 kB' 'Mapped: 134884 kB' 'AnonPages: 314036 kB' 'Shmem: 4290320 kB' 'KernelStack: 6824 kB' 'PageTables: 4320 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 86628 kB' 'Slab: 269040 kB' 'SReclaimable: 86628 kB' 'SUnreclaim: 182412 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # continue 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:55.213 02:24:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:55.213 02:24:28 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:55.213 02:24:28 -- setup/common.sh@33 -- # echo 0 00:04:55.213 02:24:28 -- setup/common.sh@33 -- # return 0 00:04:55.213 02:24:28 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:55.213 02:24:28 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:55.213 02:24:28 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:55.213 02:24:28 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:55.213 02:24:28 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:04:55.213 node0=512 expecting 513 00:04:55.213 02:24:28 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:55.213 02:24:28 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:55.213 02:24:28 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:55.213 02:24:28 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:04:55.213 node1=513 expecting 512 00:04:55.213 02:24:28 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:04:55.213 00:04:55.213 real 0m3.146s 00:04:55.213 user 0m1.201s 00:04:55.213 sys 0m1.987s 00:04:55.213 02:24:28 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:55.214 02:24:28 -- common/autotest_common.sh@10 -- # set +x 00:04:55.214 ************************************ 00:04:55.214 END TEST odd_alloc 00:04:55.214 ************************************ 00:04:55.214 02:24:28 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:04:55.214 02:24:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:55.214 02:24:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:55.214 02:24:28 -- common/autotest_common.sh@10 -- # set +x 00:04:55.214 ************************************ 00:04:55.214 START TEST custom_alloc 00:04:55.214 ************************************ 00:04:55.214 02:24:28 -- common/autotest_common.sh@1111 -- # custom_alloc 00:04:55.214 02:24:28 -- setup/hugepages.sh@167 -- # local IFS=, 00:04:55.214 02:24:28 -- setup/hugepages.sh@169 -- # local node 00:04:55.214 02:24:28 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:04:55.214 02:24:28 -- setup/hugepages.sh@170 -- # local nodes_hp 00:04:55.214 02:24:28 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:04:55.214 02:24:28 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:04:55.214 02:24:28 -- setup/hugepages.sh@49 -- # local size=1048576 00:04:55.214 02:24:28 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:55.214 02:24:28 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:55.214 02:24:28 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:04:55.214 02:24:28 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:55.214 02:24:28 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:55.214 02:24:28 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:55.214 02:24:28 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:04:55.214 02:24:28 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:55.214 02:24:28 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:55.214 02:24:28 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:55.214 02:24:28 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:55.214 02:24:28 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:55.214 02:24:28 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:55.214 02:24:28 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:04:55.214 02:24:28 -- setup/hugepages.sh@83 -- # : 256 00:04:55.214 02:24:28 -- setup/hugepages.sh@84 -- # : 1 00:04:55.214 02:24:28 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:55.214 02:24:28 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:04:55.214 02:24:28 -- setup/hugepages.sh@83 -- # : 0 00:04:55.214 02:24:28 -- setup/hugepages.sh@84 -- # : 0 00:04:55.214 02:24:28 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:55.214 02:24:28 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:04:55.214 02:24:28 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:04:55.214 02:24:28 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:04:55.214 02:24:28 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:55.214 02:24:28 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:55.214 02:24:28 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:55.214 02:24:28 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:55.214 02:24:28 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:55.214 02:24:28 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:55.214 02:24:28 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:55.214 02:24:28 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:55.214 02:24:28 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:55.214 02:24:28 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:55.214 02:24:28 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:55.214 02:24:28 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:55.214 02:24:28 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:04:55.214 02:24:28 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:55.214 02:24:28 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:04:55.214 02:24:28 -- setup/hugepages.sh@78 -- # return 0 00:04:55.214 02:24:28 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:04:55.214 02:24:28 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:04:55.214 02:24:28 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:04:55.214 02:24:28 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:04:55.214 02:24:28 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:04:55.214 02:24:28 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:04:55.214 02:24:28 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:04:55.214 02:24:28 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:04:55.214 02:24:28 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:55.214 02:24:28 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:55.214 02:24:28 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:55.214 02:24:28 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:55.214 02:24:28 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:55.214 02:24:28 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:55.214 02:24:28 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:55.214 02:24:28 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:04:55.214 02:24:28 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:55.214 02:24:28 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:04:55.214 02:24:28 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:55.214 02:24:28 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:04:55.214 02:24:28 -- setup/hugepages.sh@78 -- # return 0 00:04:55.214 02:24:28 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:04:55.214 02:24:28 -- setup/hugepages.sh@187 -- # setup output 00:04:55.214 02:24:28 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:55.214 02:24:28 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:04:58.570 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:04:58.570 0000:5f:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:58.570 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:04:58.570 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:04:58.570 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:04:58.570 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:04:58.570 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:04:58.570 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:04:58.570 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:04:58.570 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:04:58.570 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:04:58.570 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:04:58.570 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:04:58.571 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:04:58.571 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:04:58.571 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:04:58.571 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:04:58.571 02:24:31 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:04:58.571 02:24:31 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:04:58.571 02:24:31 -- setup/hugepages.sh@89 -- # local node 00:04:58.571 02:24:31 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:58.571 02:24:31 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:58.571 02:24:31 -- setup/hugepages.sh@92 -- # local surp 00:04:58.571 02:24:31 -- setup/hugepages.sh@93 -- # local resv 00:04:58.571 02:24:31 -- setup/hugepages.sh@94 -- # local anon 00:04:58.571 02:24:31 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:58.571 02:24:31 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:58.571 02:24:31 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:58.571 02:24:31 -- setup/common.sh@18 -- # local node= 00:04:58.571 02:24:31 -- setup/common.sh@19 -- # local var val 00:04:58.571 02:24:31 -- setup/common.sh@20 -- # local mem_f mem 00:04:58.571 02:24:31 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:58.571 02:24:31 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:58.571 02:24:31 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:58.571 02:24:31 -- setup/common.sh@28 -- # mapfile -t mem 00:04:58.571 02:24:31 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.571 02:24:31 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 45148812 kB' 'MemAvailable: 48738124 kB' 'Buffers: 5092 kB' 'Cached: 9484920 kB' 'SwapCached: 0 kB' 'Active: 6514812 kB' 'Inactive: 3423272 kB' 'Active(anon): 5954312 kB' 'Inactive(anon): 0 kB' 'Active(file): 560500 kB' 'Inactive(file): 3423272 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 451468 kB' 'Mapped: 194024 kB' 'Shmem: 5506240 kB' 'KReclaimable: 204964 kB' 'Slab: 643292 kB' 'SReclaimable: 204964 kB' 'SUnreclaim: 438328 kB' 'KernelStack: 16416 kB' 'PageTables: 7716 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36963540 kB' 'Committed_AS: 7191688 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 202948 kB' 'VmallocChunk: 0 kB' 'Percpu: 52480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1918424 kB' 'DirectMap2M: 18728960 kB' 'DirectMap1G: 48234496 kB' 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.571 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.571 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:58.572 02:24:31 -- setup/common.sh@33 -- # echo 0 00:04:58.572 02:24:31 -- setup/common.sh@33 -- # return 0 00:04:58.572 02:24:31 -- setup/hugepages.sh@97 -- # anon=0 00:04:58.572 02:24:31 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:58.572 02:24:31 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:58.572 02:24:31 -- setup/common.sh@18 -- # local node= 00:04:58.572 02:24:31 -- setup/common.sh@19 -- # local var val 00:04:58.572 02:24:31 -- setup/common.sh@20 -- # local mem_f mem 00:04:58.572 02:24:31 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:58.572 02:24:31 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:58.572 02:24:31 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:58.572 02:24:31 -- setup/common.sh@28 -- # mapfile -t mem 00:04:58.572 02:24:31 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.572 02:24:31 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 45149796 kB' 'MemAvailable: 48739108 kB' 'Buffers: 5092 kB' 'Cached: 9484920 kB' 'SwapCached: 0 kB' 'Active: 6515032 kB' 'Inactive: 3423272 kB' 'Active(anon): 5954532 kB' 'Inactive(anon): 0 kB' 'Active(file): 560500 kB' 'Inactive(file): 3423272 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 451752 kB' 'Mapped: 194020 kB' 'Shmem: 5506240 kB' 'KReclaimable: 204964 kB' 'Slab: 643292 kB' 'SReclaimable: 204964 kB' 'SUnreclaim: 438328 kB' 'KernelStack: 16480 kB' 'PageTables: 7900 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36963540 kB' 'Committed_AS: 7191700 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 202900 kB' 'VmallocChunk: 0 kB' 'Percpu: 52480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1918424 kB' 'DirectMap2M: 18728960 kB' 'DirectMap1G: 48234496 kB' 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.572 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.572 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.573 02:24:31 -- setup/common.sh@33 -- # echo 0 00:04:58.573 02:24:31 -- setup/common.sh@33 -- # return 0 00:04:58.573 02:24:31 -- setup/hugepages.sh@99 -- # surp=0 00:04:58.573 02:24:31 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:58.573 02:24:31 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:58.573 02:24:31 -- setup/common.sh@18 -- # local node= 00:04:58.573 02:24:31 -- setup/common.sh@19 -- # local var val 00:04:58.573 02:24:31 -- setup/common.sh@20 -- # local mem_f mem 00:04:58.573 02:24:31 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:58.573 02:24:31 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:58.573 02:24:31 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:58.573 02:24:31 -- setup/common.sh@28 -- # mapfile -t mem 00:04:58.573 02:24:31 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.573 02:24:31 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 45149796 kB' 'MemAvailable: 48739108 kB' 'Buffers: 5092 kB' 'Cached: 9484928 kB' 'SwapCached: 0 kB' 'Active: 6514940 kB' 'Inactive: 3423272 kB' 'Active(anon): 5954440 kB' 'Inactive(anon): 0 kB' 'Active(file): 560500 kB' 'Inactive(file): 3423272 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 451644 kB' 'Mapped: 194020 kB' 'Shmem: 5506248 kB' 'KReclaimable: 204964 kB' 'Slab: 643292 kB' 'SReclaimable: 204964 kB' 'SUnreclaim: 438328 kB' 'KernelStack: 16512 kB' 'PageTables: 7988 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36963540 kB' 'Committed_AS: 7191716 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 202900 kB' 'VmallocChunk: 0 kB' 'Percpu: 52480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1918424 kB' 'DirectMap2M: 18728960 kB' 'DirectMap1G: 48234496 kB' 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.573 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.573 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.574 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.574 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:58.575 02:24:31 -- setup/common.sh@33 -- # echo 0 00:04:58.575 02:24:31 -- setup/common.sh@33 -- # return 0 00:04:58.575 02:24:31 -- setup/hugepages.sh@100 -- # resv=0 00:04:58.575 02:24:31 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:04:58.575 nr_hugepages=1536 00:04:58.575 02:24:31 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:58.575 resv_hugepages=0 00:04:58.575 02:24:31 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:58.575 surplus_hugepages=0 00:04:58.575 02:24:31 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:58.575 anon_hugepages=0 00:04:58.575 02:24:31 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:58.575 02:24:31 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:04:58.575 02:24:31 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:58.575 02:24:31 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:58.575 02:24:31 -- setup/common.sh@18 -- # local node= 00:04:58.575 02:24:31 -- setup/common.sh@19 -- # local var val 00:04:58.575 02:24:31 -- setup/common.sh@20 -- # local mem_f mem 00:04:58.575 02:24:31 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:58.575 02:24:31 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:58.575 02:24:31 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:58.575 02:24:31 -- setup/common.sh@28 -- # mapfile -t mem 00:04:58.575 02:24:31 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.575 02:24:31 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 45150032 kB' 'MemAvailable: 48739344 kB' 'Buffers: 5092 kB' 'Cached: 9484948 kB' 'SwapCached: 0 kB' 'Active: 6514780 kB' 'Inactive: 3423272 kB' 'Active(anon): 5954280 kB' 'Inactive(anon): 0 kB' 'Active(file): 560500 kB' 'Inactive(file): 3423272 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 451436 kB' 'Mapped: 194020 kB' 'Shmem: 5506268 kB' 'KReclaimable: 204964 kB' 'Slab: 643292 kB' 'SReclaimable: 204964 kB' 'SUnreclaim: 438328 kB' 'KernelStack: 16480 kB' 'PageTables: 7900 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36963540 kB' 'Committed_AS: 7191732 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 202916 kB' 'VmallocChunk: 0 kB' 'Percpu: 52480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1918424 kB' 'DirectMap2M: 18728960 kB' 'DirectMap1G: 48234496 kB' 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.575 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.575 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.576 02:24:31 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:58.576 02:24:31 -- setup/common.sh@33 -- # echo 1536 00:04:58.576 02:24:31 -- setup/common.sh@33 -- # return 0 00:04:58.576 02:24:31 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:58.576 02:24:31 -- setup/hugepages.sh@112 -- # get_nodes 00:04:58.576 02:24:31 -- setup/hugepages.sh@27 -- # local node 00:04:58.576 02:24:31 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:58.576 02:24:31 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:58.576 02:24:31 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:58.576 02:24:31 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:58.576 02:24:31 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:58.576 02:24:31 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:58.576 02:24:31 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:58.576 02:24:31 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:58.576 02:24:31 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:58.576 02:24:31 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:58.576 02:24:31 -- setup/common.sh@18 -- # local node=0 00:04:58.576 02:24:31 -- setup/common.sh@19 -- # local var val 00:04:58.576 02:24:31 -- setup/common.sh@20 -- # local mem_f mem 00:04:58.576 02:24:31 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:58.576 02:24:31 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:58.576 02:24:31 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:58.576 02:24:31 -- setup/common.sh@28 -- # mapfile -t mem 00:04:58.576 02:24:31 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.576 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.577 02:24:31 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32587064 kB' 'MemFree: 28459624 kB' 'MemUsed: 4127440 kB' 'SwapCached: 0 kB' 'Active: 1732504 kB' 'Inactive: 78032 kB' 'Active(anon): 1349744 kB' 'Inactive(anon): 0 kB' 'Active(file): 382760 kB' 'Inactive(file): 78032 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1676724 kB' 'Mapped: 59112 kB' 'AnonPages: 137136 kB' 'Shmem: 1215932 kB' 'KernelStack: 9640 kB' 'PageTables: 3580 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 118432 kB' 'Slab: 374128 kB' 'SReclaimable: 118432 kB' 'SUnreclaim: 255696 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.577 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.577 02:24:31 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.577 02:24:31 -- setup/common.sh@33 -- # echo 0 00:04:58.577 02:24:31 -- setup/common.sh@33 -- # return 0 00:04:58.577 02:24:31 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:58.577 02:24:31 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:58.577 02:24:31 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:58.577 02:24:31 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:58.577 02:24:31 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:58.577 02:24:31 -- setup/common.sh@18 -- # local node=1 00:04:58.577 02:24:31 -- setup/common.sh@19 -- # local var val 00:04:58.577 02:24:31 -- setup/common.sh@20 -- # local mem_f mem 00:04:58.577 02:24:31 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:58.577 02:24:31 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:58.577 02:24:31 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:58.577 02:24:31 -- setup/common.sh@28 -- # mapfile -t mem 00:04:58.578 02:24:31 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.578 02:24:31 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27708540 kB' 'MemFree: 16690408 kB' 'MemUsed: 11018132 kB' 'SwapCached: 0 kB' 'Active: 4781956 kB' 'Inactive: 3345240 kB' 'Active(anon): 4604216 kB' 'Inactive(anon): 0 kB' 'Active(file): 177740 kB' 'Inactive(file): 3345240 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7813316 kB' 'Mapped: 134908 kB' 'AnonPages: 313984 kB' 'Shmem: 4290336 kB' 'KernelStack: 6840 kB' 'PageTables: 4320 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 86532 kB' 'Slab: 269164 kB' 'SReclaimable: 86532 kB' 'SUnreclaim: 182632 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # continue 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:58.578 02:24:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:58.578 02:24:31 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:58.578 02:24:31 -- setup/common.sh@33 -- # echo 0 00:04:58.578 02:24:31 -- setup/common.sh@33 -- # return 0 00:04:58.578 02:24:31 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:58.578 02:24:31 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:58.578 02:24:31 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:58.579 02:24:31 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:58.579 02:24:31 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:58.579 node0=512 expecting 512 00:04:58.579 02:24:31 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:58.579 02:24:31 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:58.579 02:24:31 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:58.579 02:24:31 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:04:58.579 node1=1024 expecting 1024 00:04:58.579 02:24:31 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:04:58.579 00:04:58.579 real 0m3.267s 00:04:58.579 user 0m1.274s 00:04:58.579 sys 0m2.075s 00:04:58.579 02:24:31 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:58.579 02:24:31 -- common/autotest_common.sh@10 -- # set +x 00:04:58.579 ************************************ 00:04:58.579 END TEST custom_alloc 00:04:58.579 ************************************ 00:04:58.579 02:24:31 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:04:58.579 02:24:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:58.579 02:24:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:58.579 02:24:31 -- common/autotest_common.sh@10 -- # set +x 00:04:58.579 ************************************ 00:04:58.579 START TEST no_shrink_alloc 00:04:58.579 ************************************ 00:04:58.579 02:24:32 -- common/autotest_common.sh@1111 -- # no_shrink_alloc 00:04:58.579 02:24:32 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:04:58.579 02:24:32 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:58.579 02:24:32 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:04:58.579 02:24:32 -- setup/hugepages.sh@51 -- # shift 00:04:58.579 02:24:32 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:04:58.579 02:24:32 -- setup/hugepages.sh@52 -- # local node_ids 00:04:58.579 02:24:32 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:58.579 02:24:32 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:58.579 02:24:32 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:04:58.579 02:24:32 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:04:58.579 02:24:32 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:58.579 02:24:32 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:58.579 02:24:32 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:58.579 02:24:32 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:58.579 02:24:32 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:58.579 02:24:32 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:04:58.579 02:24:32 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:58.579 02:24:32 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:04:58.579 02:24:32 -- setup/hugepages.sh@73 -- # return 0 00:04:58.579 02:24:32 -- setup/hugepages.sh@198 -- # setup output 00:04:58.579 02:24:32 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:58.579 02:24:32 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:05:01.872 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:05:01.872 0000:5f:00.0 (8086 0a54): Already using the vfio-pci driver 00:05:01.872 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:05:01.872 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:05:01.872 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:05:01.872 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:05:01.872 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:05:01.872 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:05:01.872 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:05:01.872 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:05:01.872 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:05:01.872 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:05:01.872 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:05:01.872 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:05:01.872 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:05:01.872 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:05:01.872 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:05:01.872 02:24:35 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:05:01.872 02:24:35 -- setup/hugepages.sh@89 -- # local node 00:05:01.872 02:24:35 -- setup/hugepages.sh@90 -- # local sorted_t 00:05:01.872 02:24:35 -- setup/hugepages.sh@91 -- # local sorted_s 00:05:01.872 02:24:35 -- setup/hugepages.sh@92 -- # local surp 00:05:01.872 02:24:35 -- setup/hugepages.sh@93 -- # local resv 00:05:01.872 02:24:35 -- setup/hugepages.sh@94 -- # local anon 00:05:01.872 02:24:35 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:05:01.872 02:24:35 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:05:01.872 02:24:35 -- setup/common.sh@17 -- # local get=AnonHugePages 00:05:01.872 02:24:35 -- setup/common.sh@18 -- # local node= 00:05:01.872 02:24:35 -- setup/common.sh@19 -- # local var val 00:05:01.872 02:24:35 -- setup/common.sh@20 -- # local mem_f mem 00:05:01.872 02:24:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:01.872 02:24:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:01.872 02:24:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:01.872 02:24:35 -- setup/common.sh@28 -- # mapfile -t mem 00:05:01.872 02:24:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:01.872 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.872 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.872 02:24:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46175792 kB' 'MemAvailable: 49765104 kB' 'Buffers: 5092 kB' 'Cached: 9485032 kB' 'SwapCached: 0 kB' 'Active: 6516188 kB' 'Inactive: 3423272 kB' 'Active(anon): 5955688 kB' 'Inactive(anon): 0 kB' 'Active(file): 560500 kB' 'Inactive(file): 3423272 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 452108 kB' 'Mapped: 194144 kB' 'Shmem: 5506352 kB' 'KReclaimable: 204964 kB' 'Slab: 642640 kB' 'SReclaimable: 204964 kB' 'SUnreclaim: 437676 kB' 'KernelStack: 16480 kB' 'PageTables: 7904 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 7192496 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 202996 kB' 'VmallocChunk: 0 kB' 'Percpu: 52480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1918424 kB' 'DirectMap2M: 18728960 kB' 'DirectMap1G: 48234496 kB' 00:05:01.872 02:24:35 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:01.872 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.872 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.872 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.872 02:24:35 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:01.872 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.872 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.872 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.872 02:24:35 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:01.872 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.872 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.872 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.872 02:24:35 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:01.872 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.872 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.872 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.872 02:24:35 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:01.872 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.872 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.872 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.872 02:24:35 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:01.872 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.872 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.872 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.872 02:24:35 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:01.872 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.872 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.872 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.872 02:24:35 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:01.872 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.872 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.872 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.872 02:24:35 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:01.872 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.872 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.872 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.872 02:24:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:01.872 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.872 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.872 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.872 02:24:35 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:01.872 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.872 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.872 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.872 02:24:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:01.872 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.872 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.872 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.872 02:24:35 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:01.872 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.872 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.872 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.872 02:24:35 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:01.872 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.872 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.872 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.872 02:24:35 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:01.872 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.872 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.872 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.872 02:24:35 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:01.872 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.872 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.872 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.872 02:24:35 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:01.872 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:01.873 02:24:35 -- setup/common.sh@33 -- # echo 0 00:05:01.873 02:24:35 -- setup/common.sh@33 -- # return 0 00:05:01.873 02:24:35 -- setup/hugepages.sh@97 -- # anon=0 00:05:01.873 02:24:35 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:05:01.873 02:24:35 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:01.873 02:24:35 -- setup/common.sh@18 -- # local node= 00:05:01.873 02:24:35 -- setup/common.sh@19 -- # local var val 00:05:01.873 02:24:35 -- setup/common.sh@20 -- # local mem_f mem 00:05:01.873 02:24:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:01.873 02:24:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:01.873 02:24:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:01.873 02:24:35 -- setup/common.sh@28 -- # mapfile -t mem 00:05:01.873 02:24:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.873 02:24:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46175540 kB' 'MemAvailable: 49764852 kB' 'Buffers: 5092 kB' 'Cached: 9485036 kB' 'SwapCached: 0 kB' 'Active: 6516280 kB' 'Inactive: 3423272 kB' 'Active(anon): 5955780 kB' 'Inactive(anon): 0 kB' 'Active(file): 560500 kB' 'Inactive(file): 3423272 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 452240 kB' 'Mapped: 194128 kB' 'Shmem: 5506356 kB' 'KReclaimable: 204964 kB' 'Slab: 642640 kB' 'SReclaimable: 204964 kB' 'SUnreclaim: 437676 kB' 'KernelStack: 16480 kB' 'PageTables: 7896 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 7192504 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 202996 kB' 'VmallocChunk: 0 kB' 'Percpu: 52480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1918424 kB' 'DirectMap2M: 18728960 kB' 'DirectMap1G: 48234496 kB' 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.873 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.873 02:24:35 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.874 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.874 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.875 02:24:35 -- setup/common.sh@33 -- # echo 0 00:05:01.875 02:24:35 -- setup/common.sh@33 -- # return 0 00:05:01.875 02:24:35 -- setup/hugepages.sh@99 -- # surp=0 00:05:01.875 02:24:35 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:05:01.875 02:24:35 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:05:01.875 02:24:35 -- setup/common.sh@18 -- # local node= 00:05:01.875 02:24:35 -- setup/common.sh@19 -- # local var val 00:05:01.875 02:24:35 -- setup/common.sh@20 -- # local mem_f mem 00:05:01.875 02:24:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:01.875 02:24:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:01.875 02:24:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:01.875 02:24:35 -- setup/common.sh@28 -- # mapfile -t mem 00:05:01.875 02:24:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.875 02:24:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46175772 kB' 'MemAvailable: 49765084 kB' 'Buffers: 5092 kB' 'Cached: 9485048 kB' 'SwapCached: 0 kB' 'Active: 6515456 kB' 'Inactive: 3423272 kB' 'Active(anon): 5954956 kB' 'Inactive(anon): 0 kB' 'Active(file): 560500 kB' 'Inactive(file): 3423272 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 451880 kB' 'Mapped: 194052 kB' 'Shmem: 5506368 kB' 'KReclaimable: 204964 kB' 'Slab: 642636 kB' 'SReclaimable: 204964 kB' 'SUnreclaim: 437672 kB' 'KernelStack: 16480 kB' 'PageTables: 7892 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 7192520 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 202996 kB' 'VmallocChunk: 0 kB' 'Percpu: 52480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1918424 kB' 'DirectMap2M: 18728960 kB' 'DirectMap1G: 48234496 kB' 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.875 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.875 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:01.876 02:24:35 -- setup/common.sh@33 -- # echo 0 00:05:01.876 02:24:35 -- setup/common.sh@33 -- # return 0 00:05:01.876 02:24:35 -- setup/hugepages.sh@100 -- # resv=0 00:05:01.876 02:24:35 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:05:01.876 nr_hugepages=1024 00:05:01.876 02:24:35 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:05:01.876 resv_hugepages=0 00:05:01.876 02:24:35 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:05:01.876 surplus_hugepages=0 00:05:01.876 02:24:35 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:05:01.876 anon_hugepages=0 00:05:01.876 02:24:35 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:05:01.876 02:24:35 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:05:01.876 02:24:35 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:05:01.876 02:24:35 -- setup/common.sh@17 -- # local get=HugePages_Total 00:05:01.876 02:24:35 -- setup/common.sh@18 -- # local node= 00:05:01.876 02:24:35 -- setup/common.sh@19 -- # local var val 00:05:01.876 02:24:35 -- setup/common.sh@20 -- # local mem_f mem 00:05:01.876 02:24:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:01.876 02:24:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:01.876 02:24:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:01.876 02:24:35 -- setup/common.sh@28 -- # mapfile -t mem 00:05:01.876 02:24:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.876 02:24:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46176276 kB' 'MemAvailable: 49765588 kB' 'Buffers: 5092 kB' 'Cached: 9485060 kB' 'SwapCached: 0 kB' 'Active: 6515848 kB' 'Inactive: 3423272 kB' 'Active(anon): 5955348 kB' 'Inactive(anon): 0 kB' 'Active(file): 560500 kB' 'Inactive(file): 3423272 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 452236 kB' 'Mapped: 194052 kB' 'Shmem: 5506380 kB' 'KReclaimable: 204964 kB' 'Slab: 642636 kB' 'SReclaimable: 204964 kB' 'SUnreclaim: 437672 kB' 'KernelStack: 16496 kB' 'PageTables: 7936 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 7192536 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 202996 kB' 'VmallocChunk: 0 kB' 'Percpu: 52480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1918424 kB' 'DirectMap2M: 18728960 kB' 'DirectMap1G: 48234496 kB' 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.876 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.876 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.877 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.877 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:01.878 02:24:35 -- setup/common.sh@33 -- # echo 1024 00:05:01.878 02:24:35 -- setup/common.sh@33 -- # return 0 00:05:01.878 02:24:35 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:05:01.878 02:24:35 -- setup/hugepages.sh@112 -- # get_nodes 00:05:01.878 02:24:35 -- setup/hugepages.sh@27 -- # local node 00:05:01.878 02:24:35 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:01.878 02:24:35 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:05:01.878 02:24:35 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:01.878 02:24:35 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:05:01.878 02:24:35 -- setup/hugepages.sh@32 -- # no_nodes=2 00:05:01.878 02:24:35 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:05:01.878 02:24:35 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:05:01.878 02:24:35 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:05:01.878 02:24:35 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:05:01.878 02:24:35 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:01.878 02:24:35 -- setup/common.sh@18 -- # local node=0 00:05:01.878 02:24:35 -- setup/common.sh@19 -- # local var val 00:05:01.878 02:24:35 -- setup/common.sh@20 -- # local mem_f mem 00:05:01.878 02:24:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:01.878 02:24:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:05:01.878 02:24:35 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:05:01.878 02:24:35 -- setup/common.sh@28 -- # mapfile -t mem 00:05:01.878 02:24:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.878 02:24:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32587064 kB' 'MemFree: 27388864 kB' 'MemUsed: 5198200 kB' 'SwapCached: 0 kB' 'Active: 1731740 kB' 'Inactive: 78032 kB' 'Active(anon): 1348980 kB' 'Inactive(anon): 0 kB' 'Active(file): 382760 kB' 'Inactive(file): 78032 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1676808 kB' 'Mapped: 59112 kB' 'AnonPages: 136092 kB' 'Shmem: 1216016 kB' 'KernelStack: 9592 kB' 'PageTables: 3440 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 118432 kB' 'Slab: 373968 kB' 'SReclaimable: 118432 kB' 'SUnreclaim: 255536 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.878 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.878 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.879 02:24:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.879 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.879 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.879 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.879 02:24:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.879 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.879 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.879 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.879 02:24:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.879 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.879 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.879 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.879 02:24:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.879 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.879 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.879 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.879 02:24:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.879 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.879 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.879 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.879 02:24:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.879 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.879 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.879 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.879 02:24:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.879 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.879 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.879 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.879 02:24:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.879 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.879 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.879 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.879 02:24:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.879 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.879 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.879 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.879 02:24:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.879 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.879 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.879 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.879 02:24:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.879 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.879 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.879 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.879 02:24:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.879 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.879 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.879 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.879 02:24:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.879 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.879 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.879 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.879 02:24:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.879 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.879 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.879 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.879 02:24:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.879 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.879 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.879 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.879 02:24:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.879 02:24:35 -- setup/common.sh@32 -- # continue 00:05:01.879 02:24:35 -- setup/common.sh@31 -- # IFS=': ' 00:05:01.879 02:24:35 -- setup/common.sh@31 -- # read -r var val _ 00:05:01.879 02:24:35 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:01.879 02:24:35 -- setup/common.sh@33 -- # echo 0 00:05:01.879 02:24:35 -- setup/common.sh@33 -- # return 0 00:05:01.879 02:24:35 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:05:01.879 02:24:35 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:05:01.879 02:24:35 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:05:01.879 02:24:35 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:05:01.879 02:24:35 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:05:01.879 node0=1024 expecting 1024 00:05:01.879 02:24:35 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:05:01.879 02:24:35 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:05:01.879 02:24:35 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:05:01.879 02:24:35 -- setup/hugepages.sh@202 -- # setup output 00:05:01.879 02:24:35 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:01.879 02:24:35 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:05:04.418 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:05:04.418 0000:5f:00.0 (8086 0a54): Already using the vfio-pci driver 00:05:04.418 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:05:04.418 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:05:04.418 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:05:04.418 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:05:04.418 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:05:04.418 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:05:04.418 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:05:04.418 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:05:04.418 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:05:04.418 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:05:04.418 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:05:04.418 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:05:04.418 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:05:04.418 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:05:04.418 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:05:04.681 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:05:04.681 02:24:38 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:05:04.681 02:24:38 -- setup/hugepages.sh@89 -- # local node 00:05:04.681 02:24:38 -- setup/hugepages.sh@90 -- # local sorted_t 00:05:04.681 02:24:38 -- setup/hugepages.sh@91 -- # local sorted_s 00:05:04.681 02:24:38 -- setup/hugepages.sh@92 -- # local surp 00:05:04.681 02:24:38 -- setup/hugepages.sh@93 -- # local resv 00:05:04.681 02:24:38 -- setup/hugepages.sh@94 -- # local anon 00:05:04.681 02:24:38 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:05:04.681 02:24:38 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:05:04.681 02:24:38 -- setup/common.sh@17 -- # local get=AnonHugePages 00:05:04.681 02:24:38 -- setup/common.sh@18 -- # local node= 00:05:04.681 02:24:38 -- setup/common.sh@19 -- # local var val 00:05:04.681 02:24:38 -- setup/common.sh@20 -- # local mem_f mem 00:05:04.681 02:24:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:04.681 02:24:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:04.681 02:24:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:04.681 02:24:38 -- setup/common.sh@28 -- # mapfile -t mem 00:05:04.681 02:24:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:04.681 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.681 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.681 02:24:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46192080 kB' 'MemAvailable: 49781392 kB' 'Buffers: 5092 kB' 'Cached: 9485124 kB' 'SwapCached: 0 kB' 'Active: 6516996 kB' 'Inactive: 3423272 kB' 'Active(anon): 5956496 kB' 'Inactive(anon): 0 kB' 'Active(file): 560500 kB' 'Inactive(file): 3423272 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 452916 kB' 'Mapped: 194168 kB' 'Shmem: 5506444 kB' 'KReclaimable: 204964 kB' 'Slab: 643028 kB' 'SReclaimable: 204964 kB' 'SUnreclaim: 438064 kB' 'KernelStack: 16576 kB' 'PageTables: 7836 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 7195260 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203108 kB' 'VmallocChunk: 0 kB' 'Percpu: 52480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1918424 kB' 'DirectMap2M: 18728960 kB' 'DirectMap1G: 48234496 kB' 00:05:04.681 02:24:38 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.681 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.681 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.681 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.681 02:24:38 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.681 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.681 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.681 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.681 02:24:38 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.681 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.681 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.681 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.681 02:24:38 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.681 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.681 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.681 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.681 02:24:38 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.681 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.681 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.681 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.681 02:24:38 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.681 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.681 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.681 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.681 02:24:38 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.681 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.681 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.681 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.681 02:24:38 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.681 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.681 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.681 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.681 02:24:38 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.681 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.681 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.681 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.681 02:24:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.681 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.681 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.681 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.681 02:24:38 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.681 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.681 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.681 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.681 02:24:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.681 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.681 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.681 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.681 02:24:38 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.681 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.681 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.681 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.681 02:24:38 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.681 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.681 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.681 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.681 02:24:38 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.681 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.681 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.681 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.681 02:24:38 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.681 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.681 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.681 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.681 02:24:38 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.681 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.681 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.681 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.681 02:24:38 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.681 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.681 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.681 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.681 02:24:38 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.681 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.681 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.681 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.681 02:24:38 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.681 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.681 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.681 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.681 02:24:38 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:05:04.682 02:24:38 -- setup/common.sh@33 -- # echo 0 00:05:04.682 02:24:38 -- setup/common.sh@33 -- # return 0 00:05:04.682 02:24:38 -- setup/hugepages.sh@97 -- # anon=0 00:05:04.682 02:24:38 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:05:04.682 02:24:38 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:04.682 02:24:38 -- setup/common.sh@18 -- # local node= 00:05:04.682 02:24:38 -- setup/common.sh@19 -- # local var val 00:05:04.682 02:24:38 -- setup/common.sh@20 -- # local mem_f mem 00:05:04.682 02:24:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:04.682 02:24:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:04.682 02:24:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:04.682 02:24:38 -- setup/common.sh@28 -- # mapfile -t mem 00:05:04.682 02:24:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:04.682 02:24:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46194028 kB' 'MemAvailable: 49783340 kB' 'Buffers: 5092 kB' 'Cached: 9485128 kB' 'SwapCached: 0 kB' 'Active: 6516444 kB' 'Inactive: 3423272 kB' 'Active(anon): 5955944 kB' 'Inactive(anon): 0 kB' 'Active(file): 560500 kB' 'Inactive(file): 3423272 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 452868 kB' 'Mapped: 194088 kB' 'Shmem: 5506448 kB' 'KReclaimable: 204964 kB' 'Slab: 643016 kB' 'SReclaimable: 204964 kB' 'SUnreclaim: 438052 kB' 'KernelStack: 16544 kB' 'PageTables: 7924 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 7195268 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203092 kB' 'VmallocChunk: 0 kB' 'Percpu: 52480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1918424 kB' 'DirectMap2M: 18728960 kB' 'DirectMap1G: 48234496 kB' 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.682 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.682 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.683 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.683 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.684 02:24:38 -- setup/common.sh@33 -- # echo 0 00:05:04.684 02:24:38 -- setup/common.sh@33 -- # return 0 00:05:04.684 02:24:38 -- setup/hugepages.sh@99 -- # surp=0 00:05:04.684 02:24:38 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:05:04.684 02:24:38 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:05:04.684 02:24:38 -- setup/common.sh@18 -- # local node= 00:05:04.684 02:24:38 -- setup/common.sh@19 -- # local var val 00:05:04.684 02:24:38 -- setup/common.sh@20 -- # local mem_f mem 00:05:04.684 02:24:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:04.684 02:24:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:04.684 02:24:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:04.684 02:24:38 -- setup/common.sh@28 -- # mapfile -t mem 00:05:04.684 02:24:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.684 02:24:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46193224 kB' 'MemAvailable: 49782536 kB' 'Buffers: 5092 kB' 'Cached: 9485140 kB' 'SwapCached: 0 kB' 'Active: 6516092 kB' 'Inactive: 3423272 kB' 'Active(anon): 5955592 kB' 'Inactive(anon): 0 kB' 'Active(file): 560500 kB' 'Inactive(file): 3423272 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 452424 kB' 'Mapped: 194088 kB' 'Shmem: 5506460 kB' 'KReclaimable: 204964 kB' 'Slab: 643024 kB' 'SReclaimable: 204964 kB' 'SUnreclaim: 438060 kB' 'KernelStack: 16688 kB' 'PageTables: 8268 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 7195284 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203060 kB' 'VmallocChunk: 0 kB' 'Percpu: 52480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1918424 kB' 'DirectMap2M: 18728960 kB' 'DirectMap1G: 48234496 kB' 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.684 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.684 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:05:04.685 02:24:38 -- setup/common.sh@33 -- # echo 0 00:05:04.685 02:24:38 -- setup/common.sh@33 -- # return 0 00:05:04.685 02:24:38 -- setup/hugepages.sh@100 -- # resv=0 00:05:04.685 02:24:38 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:05:04.685 nr_hugepages=1024 00:05:04.685 02:24:38 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:05:04.685 resv_hugepages=0 00:05:04.685 02:24:38 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:05:04.685 surplus_hugepages=0 00:05:04.685 02:24:38 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:05:04.685 anon_hugepages=0 00:05:04.685 02:24:38 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:05:04.685 02:24:38 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:05:04.685 02:24:38 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:05:04.685 02:24:38 -- setup/common.sh@17 -- # local get=HugePages_Total 00:05:04.685 02:24:38 -- setup/common.sh@18 -- # local node= 00:05:04.685 02:24:38 -- setup/common.sh@19 -- # local var val 00:05:04.685 02:24:38 -- setup/common.sh@20 -- # local mem_f mem 00:05:04.685 02:24:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:04.685 02:24:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:05:04.685 02:24:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:05:04.685 02:24:38 -- setup/common.sh@28 -- # mapfile -t mem 00:05:04.685 02:24:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.685 02:24:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46191964 kB' 'MemAvailable: 49781276 kB' 'Buffers: 5092 kB' 'Cached: 9485156 kB' 'SwapCached: 0 kB' 'Active: 6516092 kB' 'Inactive: 3423272 kB' 'Active(anon): 5955592 kB' 'Inactive(anon): 0 kB' 'Active(file): 560500 kB' 'Inactive(file): 3423272 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 452440 kB' 'Mapped: 194088 kB' 'Shmem: 5506476 kB' 'KReclaimable: 204964 kB' 'Slab: 643024 kB' 'SReclaimable: 204964 kB' 'SUnreclaim: 438060 kB' 'KernelStack: 16592 kB' 'PageTables: 7896 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 7195148 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203108 kB' 'VmallocChunk: 0 kB' 'Percpu: 52480 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1918424 kB' 'DirectMap2M: 18728960 kB' 'DirectMap1G: 48234496 kB' 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.685 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.685 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.686 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.686 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:05:04.687 02:24:38 -- setup/common.sh@33 -- # echo 1024 00:05:04.687 02:24:38 -- setup/common.sh@33 -- # return 0 00:05:04.687 02:24:38 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:05:04.687 02:24:38 -- setup/hugepages.sh@112 -- # get_nodes 00:05:04.687 02:24:38 -- setup/hugepages.sh@27 -- # local node 00:05:04.687 02:24:38 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:04.687 02:24:38 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:05:04.687 02:24:38 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:05:04.687 02:24:38 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:05:04.687 02:24:38 -- setup/hugepages.sh@32 -- # no_nodes=2 00:05:04.687 02:24:38 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:05:04.687 02:24:38 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:05:04.687 02:24:38 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:05:04.687 02:24:38 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:05:04.687 02:24:38 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:05:04.687 02:24:38 -- setup/common.sh@18 -- # local node=0 00:05:04.687 02:24:38 -- setup/common.sh@19 -- # local var val 00:05:04.687 02:24:38 -- setup/common.sh@20 -- # local mem_f mem 00:05:04.687 02:24:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:05:04.687 02:24:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:05:04.687 02:24:38 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:05:04.687 02:24:38 -- setup/common.sh@28 -- # mapfile -t mem 00:05:04.687 02:24:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:05:04.687 02:24:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32587064 kB' 'MemFree: 27391860 kB' 'MemUsed: 5195204 kB' 'SwapCached: 0 kB' 'Active: 1733176 kB' 'Inactive: 78032 kB' 'Active(anon): 1350416 kB' 'Inactive(anon): 0 kB' 'Active(file): 382760 kB' 'Inactive(file): 78032 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1676884 kB' 'Mapped: 59112 kB' 'AnonPages: 137488 kB' 'Shmem: 1216092 kB' 'KernelStack: 9656 kB' 'PageTables: 3628 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 118432 kB' 'Slab: 374300 kB' 'SReclaimable: 118432 kB' 'SUnreclaim: 255868 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.687 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.687 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.688 02:24:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.688 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.688 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.688 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.688 02:24:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.688 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.688 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.688 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.688 02:24:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.688 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.688 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.688 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.688 02:24:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.688 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.688 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.688 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.688 02:24:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.688 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.688 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.688 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.688 02:24:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.688 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.688 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.688 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.688 02:24:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.688 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.688 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.688 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.688 02:24:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.688 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.688 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.688 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.688 02:24:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.688 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.688 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.688 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.688 02:24:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.688 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.688 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.688 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.688 02:24:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.688 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.688 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.688 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.688 02:24:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.688 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.688 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.688 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.688 02:24:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.688 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.688 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.688 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.688 02:24:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.688 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.688 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.688 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.688 02:24:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.688 02:24:38 -- setup/common.sh@32 -- # continue 00:05:04.688 02:24:38 -- setup/common.sh@31 -- # IFS=': ' 00:05:04.948 02:24:38 -- setup/common.sh@31 -- # read -r var val _ 00:05:04.948 02:24:38 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:05:04.948 02:24:38 -- setup/common.sh@33 -- # echo 0 00:05:04.948 02:24:38 -- setup/common.sh@33 -- # return 0 00:05:04.948 02:24:38 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:05:04.948 02:24:38 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:05:04.948 02:24:38 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:05:04.948 02:24:38 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:05:04.948 02:24:38 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:05:04.948 node0=1024 expecting 1024 00:05:04.948 02:24:38 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:05:04.948 00:05:04.948 real 0m6.204s 00:05:04.948 user 0m2.326s 00:05:04.948 sys 0m4.005s 00:05:04.948 02:24:38 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:04.948 02:24:38 -- common/autotest_common.sh@10 -- # set +x 00:05:04.948 ************************************ 00:05:04.948 END TEST no_shrink_alloc 00:05:04.948 ************************************ 00:05:04.948 02:24:38 -- setup/hugepages.sh@217 -- # clear_hp 00:05:04.948 02:24:38 -- setup/hugepages.sh@37 -- # local node hp 00:05:04.948 02:24:38 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:05:04.948 02:24:38 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:05:04.948 02:24:38 -- setup/hugepages.sh@41 -- # echo 0 00:05:04.948 02:24:38 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:05:04.948 02:24:38 -- setup/hugepages.sh@41 -- # echo 0 00:05:04.948 02:24:38 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:05:04.948 02:24:38 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:05:04.948 02:24:38 -- setup/hugepages.sh@41 -- # echo 0 00:05:04.948 02:24:38 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:05:04.948 02:24:38 -- setup/hugepages.sh@41 -- # echo 0 00:05:04.948 02:24:38 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:05:04.948 02:24:38 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:05:04.948 00:05:04.948 real 0m26.963s 00:05:04.948 user 0m9.069s 00:05:04.948 sys 0m15.089s 00:05:04.948 02:24:38 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:04.948 02:24:38 -- common/autotest_common.sh@10 -- # set +x 00:05:04.948 ************************************ 00:05:04.948 END TEST hugepages 00:05:04.948 ************************************ 00:05:04.948 02:24:38 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/driver.sh 00:05:04.948 02:24:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:04.948 02:24:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:04.948 02:24:38 -- common/autotest_common.sh@10 -- # set +x 00:05:04.948 ************************************ 00:05:04.948 START TEST driver 00:05:04.948 ************************************ 00:05:04.948 02:24:38 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/driver.sh 00:05:05.208 * Looking for test storage... 00:05:05.208 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup 00:05:05.208 02:24:38 -- setup/driver.sh@68 -- # setup reset 00:05:05.208 02:24:38 -- setup/common.sh@9 -- # [[ reset == output ]] 00:05:05.208 02:24:38 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:05:10.495 02:24:43 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:05:10.495 02:24:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:10.495 02:24:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:10.495 02:24:43 -- common/autotest_common.sh@10 -- # set +x 00:05:10.495 ************************************ 00:05:10.495 START TEST guess_driver 00:05:10.495 ************************************ 00:05:10.495 02:24:43 -- common/autotest_common.sh@1111 -- # guess_driver 00:05:10.495 02:24:43 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:05:10.495 02:24:43 -- setup/driver.sh@47 -- # local fail=0 00:05:10.495 02:24:43 -- setup/driver.sh@49 -- # pick_driver 00:05:10.495 02:24:43 -- setup/driver.sh@36 -- # vfio 00:05:10.495 02:24:43 -- setup/driver.sh@21 -- # local iommu_grups 00:05:10.495 02:24:43 -- setup/driver.sh@22 -- # local unsafe_vfio 00:05:10.495 02:24:43 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:05:10.495 02:24:43 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:05:10.495 02:24:43 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:05:10.495 02:24:43 -- setup/driver.sh@29 -- # (( 163 > 0 )) 00:05:10.495 02:24:43 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:05:10.495 02:24:43 -- setup/driver.sh@14 -- # mod vfio_pci 00:05:10.495 02:24:43 -- setup/driver.sh@12 -- # dep vfio_pci 00:05:10.495 02:24:43 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:05:10.495 02:24:43 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:05:10.495 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:05:10.495 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:05:10.495 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:05:10.495 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:05:10.495 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:05:10.495 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:05:10.495 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:05:10.495 02:24:43 -- setup/driver.sh@30 -- # return 0 00:05:10.495 02:24:43 -- setup/driver.sh@37 -- # echo vfio-pci 00:05:10.495 02:24:43 -- setup/driver.sh@49 -- # driver=vfio-pci 00:05:10.495 02:24:43 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:05:10.495 02:24:43 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:05:10.495 Looking for driver=vfio-pci 00:05:10.495 02:24:43 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:10.495 02:24:43 -- setup/driver.sh@45 -- # setup output config 00:05:10.495 02:24:43 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:10.495 02:24:43 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:05:13.035 02:24:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:13.036 02:24:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:13.036 02:24:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:13.036 02:24:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:13.036 02:24:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:13.036 02:24:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:13.036 02:24:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:13.036 02:24:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:13.036 02:24:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:13.036 02:24:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:13.036 02:24:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:13.036 02:24:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:13.036 02:24:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:13.036 02:24:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:13.036 02:24:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:13.036 02:24:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:13.036 02:24:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:13.036 02:24:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:13.036 02:24:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:13.036 02:24:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:13.036 02:24:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:13.036 02:24:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:13.036 02:24:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:13.036 02:24:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:13.036 02:24:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:13.036 02:24:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:13.036 02:24:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:13.036 02:24:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:13.036 02:24:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:13.036 02:24:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:13.036 02:24:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:13.036 02:24:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:13.036 02:24:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:13.036 02:24:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:13.036 02:24:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:13.036 02:24:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:13.036 02:24:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:13.036 02:24:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:13.036 02:24:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:13.036 02:24:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:13.036 02:24:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:13.036 02:24:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:13.036 02:24:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:13.036 02:24:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:13.036 02:24:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:13.036 02:24:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:13.036 02:24:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:13.036 02:24:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:16.321 02:24:49 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:05:16.321 02:24:49 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:05:16.321 02:24:49 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:05:16.321 02:24:49 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:05:16.321 02:24:49 -- setup/driver.sh@65 -- # setup reset 00:05:16.321 02:24:49 -- setup/common.sh@9 -- # [[ reset == output ]] 00:05:16.321 02:24:49 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:05:21.596 00:05:21.596 real 0m10.808s 00:05:21.596 user 0m2.399s 00:05:21.596 sys 0m4.552s 00:05:21.596 02:24:54 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:21.596 02:24:54 -- common/autotest_common.sh@10 -- # set +x 00:05:21.596 ************************************ 00:05:21.596 END TEST guess_driver 00:05:21.596 ************************************ 00:05:21.596 00:05:21.596 real 0m15.639s 00:05:21.596 user 0m3.819s 00:05:21.596 sys 0m7.190s 00:05:21.596 02:24:54 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:21.596 02:24:54 -- common/autotest_common.sh@10 -- # set +x 00:05:21.596 ************************************ 00:05:21.596 END TEST driver 00:05:21.596 ************************************ 00:05:21.596 02:24:54 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/devices.sh 00:05:21.596 02:24:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:21.596 02:24:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:21.596 02:24:54 -- common/autotest_common.sh@10 -- # set +x 00:05:21.596 ************************************ 00:05:21.596 START TEST devices 00:05:21.596 ************************************ 00:05:21.596 02:24:54 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/devices.sh 00:05:21.596 * Looking for test storage... 00:05:21.596 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup 00:05:21.596 02:24:54 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:05:21.596 02:24:54 -- setup/devices.sh@192 -- # setup reset 00:05:21.596 02:24:54 -- setup/common.sh@9 -- # [[ reset == output ]] 00:05:21.596 02:24:54 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:05:24.928 02:24:57 -- setup/devices.sh@194 -- # get_zoned_devs 00:05:24.928 02:24:57 -- common/autotest_common.sh@1655 -- # zoned_devs=() 00:05:24.928 02:24:57 -- common/autotest_common.sh@1655 -- # local -gA zoned_devs 00:05:24.928 02:24:57 -- common/autotest_common.sh@1656 -- # local nvme bdf 00:05:24.928 02:24:57 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:05:24.928 02:24:57 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme0n1 00:05:24.928 02:24:57 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:05:24.928 02:24:57 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:05:24.928 02:24:57 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:05:24.928 02:24:57 -- setup/devices.sh@196 -- # blocks=() 00:05:24.928 02:24:57 -- setup/devices.sh@196 -- # declare -a blocks 00:05:24.928 02:24:57 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:05:24.928 02:24:57 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:05:24.928 02:24:57 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:05:24.928 02:24:57 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:05:24.928 02:24:57 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:05:24.928 02:24:57 -- setup/devices.sh@201 -- # ctrl=nvme0 00:05:24.928 02:24:57 -- setup/devices.sh@202 -- # pci=0000:5f:00.0 00:05:24.928 02:24:57 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\5\f\:\0\0\.\0* ]] 00:05:24.928 02:24:57 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:05:24.928 02:24:57 -- scripts/common.sh@378 -- # local block=nvme0n1 pt 00:05:24.928 02:24:57 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:05:24.928 No valid GPT data, bailing 00:05:24.928 02:24:57 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:05:24.928 02:24:57 -- scripts/common.sh@391 -- # pt= 00:05:24.928 02:24:57 -- scripts/common.sh@392 -- # return 1 00:05:24.928 02:24:57 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:05:24.928 02:24:57 -- setup/common.sh@76 -- # local dev=nvme0n1 00:05:24.928 02:24:57 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:05:24.928 02:24:57 -- setup/common.sh@80 -- # echo 4000787030016 00:05:24.928 02:24:57 -- setup/devices.sh@204 -- # (( 4000787030016 >= min_disk_size )) 00:05:24.928 02:24:57 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:05:24.928 02:24:57 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:5f:00.0 00:05:24.928 02:24:57 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:05:24.928 02:24:57 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:05:24.928 02:24:57 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:05:24.928 02:24:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:24.928 02:24:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:24.928 02:24:57 -- common/autotest_common.sh@10 -- # set +x 00:05:24.928 ************************************ 00:05:24.928 START TEST nvme_mount 00:05:24.928 ************************************ 00:05:24.928 02:24:58 -- common/autotest_common.sh@1111 -- # nvme_mount 00:05:24.928 02:24:58 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:05:24.928 02:24:58 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:05:24.928 02:24:58 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:05:24.928 02:24:58 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:24.928 02:24:58 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:05:24.928 02:24:58 -- setup/common.sh@39 -- # local disk=nvme0n1 00:05:24.928 02:24:58 -- setup/common.sh@40 -- # local part_no=1 00:05:24.928 02:24:58 -- setup/common.sh@41 -- # local size=1073741824 00:05:24.928 02:24:58 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:05:24.928 02:24:58 -- setup/common.sh@44 -- # parts=() 00:05:24.928 02:24:58 -- setup/common.sh@44 -- # local parts 00:05:24.928 02:24:58 -- setup/common.sh@46 -- # (( part = 1 )) 00:05:24.928 02:24:58 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:24.928 02:24:58 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:05:24.928 02:24:58 -- setup/common.sh@46 -- # (( part++ )) 00:05:24.928 02:24:58 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:24.928 02:24:58 -- setup/common.sh@51 -- # (( size /= 512 )) 00:05:24.928 02:24:58 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:05:24.928 02:24:58 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:05:25.866 Creating new GPT entries in memory. 00:05:25.866 GPT data structures destroyed! You may now partition the disk using fdisk or 00:05:25.866 other utilities. 00:05:25.866 02:24:59 -- setup/common.sh@57 -- # (( part = 1 )) 00:05:25.866 02:24:59 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:25.866 02:24:59 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:05:25.866 02:24:59 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:05:25.866 02:24:59 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:05:26.804 Creating new GPT entries in memory. 00:05:26.804 The operation has completed successfully. 00:05:26.804 02:25:00 -- setup/common.sh@57 -- # (( part++ )) 00:05:26.804 02:25:00 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:26.804 02:25:00 -- setup/common.sh@62 -- # wait 1402491 00:05:26.804 02:25:00 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:05:26.804 02:25:00 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount size= 00:05:26.804 02:25:00 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:05:26.804 02:25:00 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:05:26.804 02:25:00 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:05:26.804 02:25:00 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:05:26.804 02:25:00 -- setup/devices.sh@105 -- # verify 0000:5f:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:26.804 02:25:00 -- setup/devices.sh@48 -- # local dev=0000:5f:00.0 00:05:26.804 02:25:00 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:05:26.804 02:25:00 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:05:26.804 02:25:00 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:26.804 02:25:00 -- setup/devices.sh@53 -- # local found=0 00:05:26.804 02:25:00 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:26.804 02:25:00 -- setup/devices.sh@56 -- # : 00:05:26.804 02:25:00 -- setup/devices.sh@59 -- # local pci status 00:05:26.804 02:25:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:26.804 02:25:00 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5f:00.0 00:05:26.804 02:25:00 -- setup/devices.sh@47 -- # setup output config 00:05:26.804 02:25:00 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:26.804 02:25:00 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:05:30.116 02:25:03 -- setup/devices.sh@62 -- # [[ 0000:5f:00.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:30.116 02:25:03 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:05:30.116 02:25:03 -- setup/devices.sh@63 -- # found=1 00:05:30.116 02:25:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:30.116 02:25:03 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:30.116 02:25:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:30.116 02:25:03 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:30.116 02:25:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:30.116 02:25:03 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:30.116 02:25:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:30.116 02:25:03 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:30.116 02:25:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:30.116 02:25:03 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:30.116 02:25:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:30.116 02:25:03 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:30.116 02:25:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:30.116 02:25:03 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:30.116 02:25:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:30.116 02:25:03 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:30.116 02:25:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:30.116 02:25:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:30.116 02:25:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:30.116 02:25:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:30.116 02:25:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:30.116 02:25:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:30.116 02:25:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:30.116 02:25:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:30.116 02:25:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:30.116 02:25:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:30.116 02:25:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:30.116 02:25:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:30.116 02:25:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:30.116 02:25:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:30.116 02:25:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:30.116 02:25:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:30.116 02:25:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:30.116 02:25:03 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:30.116 02:25:03 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount ]] 00:05:30.116 02:25:03 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:05:30.116 02:25:03 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:30.116 02:25:03 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:30.116 02:25:03 -- setup/devices.sh@110 -- # cleanup_nvme 00:05:30.116 02:25:03 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:05:30.116 02:25:03 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:05:30.116 02:25:03 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:30.116 02:25:03 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:05:30.117 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:05:30.117 02:25:03 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:05:30.117 02:25:03 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:30.117 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:05:30.117 /dev/nvme0n1: 8 bytes were erased at offset 0x3a3817d5e00 (gpt): 45 46 49 20 50 41 52 54 00:05:30.117 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:05:30.117 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:05:30.117 02:25:03 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:05:30.117 02:25:03 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:05:30.117 02:25:03 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:05:30.117 02:25:03 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:05:30.117 02:25:03 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:05:30.117 02:25:03 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:05:30.117 02:25:03 -- setup/devices.sh@116 -- # verify 0000:5f:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:30.117 02:25:03 -- setup/devices.sh@48 -- # local dev=0000:5f:00.0 00:05:30.117 02:25:03 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:05:30.117 02:25:03 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:05:30.117 02:25:03 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:30.117 02:25:03 -- setup/devices.sh@53 -- # local found=0 00:05:30.117 02:25:03 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:30.117 02:25:03 -- setup/devices.sh@56 -- # : 00:05:30.117 02:25:03 -- setup/devices.sh@59 -- # local pci status 00:05:30.117 02:25:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:30.117 02:25:03 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5f:00.0 00:05:30.117 02:25:03 -- setup/devices.sh@47 -- # setup output config 00:05:30.117 02:25:03 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:30.117 02:25:03 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:05:32.652 02:25:06 -- setup/devices.sh@62 -- # [[ 0000:5f:00.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:32.652 02:25:06 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:05:32.652 02:25:06 -- setup/devices.sh@63 -- # found=1 00:05:32.652 02:25:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:32.652 02:25:06 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:32.652 02:25:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:32.652 02:25:06 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:32.652 02:25:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:32.652 02:25:06 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:32.652 02:25:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:32.652 02:25:06 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:32.652 02:25:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:32.652 02:25:06 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:32.652 02:25:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:32.652 02:25:06 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:32.652 02:25:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:32.652 02:25:06 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:32.652 02:25:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:32.652 02:25:06 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:32.652 02:25:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:32.652 02:25:06 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:32.652 02:25:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:32.652 02:25:06 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:32.652 02:25:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:32.652 02:25:06 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:32.652 02:25:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:32.652 02:25:06 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:32.652 02:25:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:32.652 02:25:06 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:32.652 02:25:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:32.652 02:25:06 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:32.652 02:25:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:32.652 02:25:06 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:32.652 02:25:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:32.652 02:25:06 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:32.652 02:25:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:32.652 02:25:06 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:32.652 02:25:06 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount ]] 00:05:32.652 02:25:06 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:05:32.652 02:25:06 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:32.652 02:25:06 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:32.652 02:25:06 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:05:32.909 02:25:06 -- setup/devices.sh@125 -- # verify 0000:5f:00.0 data@nvme0n1 '' '' 00:05:32.909 02:25:06 -- setup/devices.sh@48 -- # local dev=0000:5f:00.0 00:05:32.909 02:25:06 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:05:32.909 02:25:06 -- setup/devices.sh@50 -- # local mount_point= 00:05:32.909 02:25:06 -- setup/devices.sh@51 -- # local test_file= 00:05:32.909 02:25:06 -- setup/devices.sh@53 -- # local found=0 00:05:32.909 02:25:06 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:05:32.909 02:25:06 -- setup/devices.sh@59 -- # local pci status 00:05:32.909 02:25:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:32.909 02:25:06 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5f:00.0 00:05:32.909 02:25:06 -- setup/devices.sh@47 -- # setup output config 00:05:32.909 02:25:06 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:32.909 02:25:06 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:05:36.197 02:25:09 -- setup/devices.sh@62 -- # [[ 0000:5f:00.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:36.197 02:25:09 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:05:36.197 02:25:09 -- setup/devices.sh@63 -- # found=1 00:05:36.197 02:25:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:36.197 02:25:09 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:36.197 02:25:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:36.197 02:25:09 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:36.197 02:25:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:36.197 02:25:09 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:36.197 02:25:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:36.197 02:25:09 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:36.197 02:25:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:36.197 02:25:09 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:36.197 02:25:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:36.197 02:25:09 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:36.197 02:25:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:36.197 02:25:09 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:36.197 02:25:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:36.197 02:25:09 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:36.197 02:25:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:36.197 02:25:09 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:36.197 02:25:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:36.197 02:25:09 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:36.197 02:25:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:36.197 02:25:09 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:36.197 02:25:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:36.197 02:25:09 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:36.197 02:25:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:36.197 02:25:09 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:36.197 02:25:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:36.197 02:25:09 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:36.197 02:25:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:36.197 02:25:09 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:36.197 02:25:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:36.197 02:25:09 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:36.197 02:25:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:36.197 02:25:09 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:36.197 02:25:09 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:05:36.197 02:25:09 -- setup/devices.sh@68 -- # return 0 00:05:36.197 02:25:09 -- setup/devices.sh@128 -- # cleanup_nvme 00:05:36.197 02:25:09 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:05:36.197 02:25:09 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:36.197 02:25:09 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:05:36.197 02:25:09 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:36.197 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:05:36.197 00:05:36.197 real 0m11.224s 00:05:36.197 user 0m3.155s 00:05:36.197 sys 0m5.878s 00:05:36.197 02:25:09 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:36.197 02:25:09 -- common/autotest_common.sh@10 -- # set +x 00:05:36.197 ************************************ 00:05:36.197 END TEST nvme_mount 00:05:36.197 ************************************ 00:05:36.197 02:25:09 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:05:36.197 02:25:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:36.197 02:25:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:36.197 02:25:09 -- common/autotest_common.sh@10 -- # set +x 00:05:36.197 ************************************ 00:05:36.197 START TEST dm_mount 00:05:36.197 ************************************ 00:05:36.197 02:25:09 -- common/autotest_common.sh@1111 -- # dm_mount 00:05:36.197 02:25:09 -- setup/devices.sh@144 -- # pv=nvme0n1 00:05:36.197 02:25:09 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:05:36.197 02:25:09 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:05:36.197 02:25:09 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:05:36.197 02:25:09 -- setup/common.sh@39 -- # local disk=nvme0n1 00:05:36.197 02:25:09 -- setup/common.sh@40 -- # local part_no=2 00:05:36.197 02:25:09 -- setup/common.sh@41 -- # local size=1073741824 00:05:36.197 02:25:09 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:05:36.197 02:25:09 -- setup/common.sh@44 -- # parts=() 00:05:36.197 02:25:09 -- setup/common.sh@44 -- # local parts 00:05:36.197 02:25:09 -- setup/common.sh@46 -- # (( part = 1 )) 00:05:36.197 02:25:09 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:36.197 02:25:09 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:05:36.197 02:25:09 -- setup/common.sh@46 -- # (( part++ )) 00:05:36.197 02:25:09 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:36.197 02:25:09 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:05:36.197 02:25:09 -- setup/common.sh@46 -- # (( part++ )) 00:05:36.197 02:25:09 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:36.197 02:25:09 -- setup/common.sh@51 -- # (( size /= 512 )) 00:05:36.197 02:25:09 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:05:36.197 02:25:09 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:05:37.134 Creating new GPT entries in memory. 00:05:37.134 GPT data structures destroyed! You may now partition the disk using fdisk or 00:05:37.134 other utilities. 00:05:37.134 02:25:10 -- setup/common.sh@57 -- # (( part = 1 )) 00:05:37.134 02:25:10 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:37.134 02:25:10 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:05:37.134 02:25:10 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:05:37.134 02:25:10 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:05:38.072 Creating new GPT entries in memory. 00:05:38.072 The operation has completed successfully. 00:05:38.072 02:25:11 -- setup/common.sh@57 -- # (( part++ )) 00:05:38.072 02:25:11 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:38.072 02:25:11 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:05:38.072 02:25:11 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:05:38.072 02:25:11 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:05:39.010 The operation has completed successfully. 00:05:39.011 02:25:12 -- setup/common.sh@57 -- # (( part++ )) 00:05:39.011 02:25:12 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:39.011 02:25:12 -- setup/common.sh@62 -- # wait 1406304 00:05:39.011 02:25:12 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:05:39.011 02:25:12 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:05:39.011 02:25:12 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:39.011 02:25:12 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:05:39.270 02:25:12 -- setup/devices.sh@160 -- # for t in {1..5} 00:05:39.270 02:25:12 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:39.270 02:25:12 -- setup/devices.sh@161 -- # break 00:05:39.270 02:25:12 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:39.270 02:25:12 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:05:39.270 02:25:12 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:05:39.270 02:25:12 -- setup/devices.sh@166 -- # dm=dm-0 00:05:39.270 02:25:12 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:05:39.270 02:25:12 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:05:39.270 02:25:12 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:05:39.270 02:25:12 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount size= 00:05:39.270 02:25:12 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:05:39.270 02:25:12 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:39.270 02:25:12 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:05:39.270 02:25:12 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:05:39.270 02:25:12 -- setup/devices.sh@174 -- # verify 0000:5f:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:39.270 02:25:12 -- setup/devices.sh@48 -- # local dev=0000:5f:00.0 00:05:39.270 02:25:12 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:05:39.270 02:25:12 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:05:39.270 02:25:12 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:39.270 02:25:12 -- setup/devices.sh@53 -- # local found=0 00:05:39.270 02:25:12 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:05:39.270 02:25:12 -- setup/devices.sh@56 -- # : 00:05:39.270 02:25:12 -- setup/devices.sh@59 -- # local pci status 00:05:39.270 02:25:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:39.270 02:25:12 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5f:00.0 00:05:39.270 02:25:12 -- setup/devices.sh@47 -- # setup output config 00:05:39.270 02:25:12 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:39.270 02:25:12 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:05:42.567 02:25:15 -- setup/devices.sh@62 -- # [[ 0000:5f:00.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:42.567 02:25:15 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:05:42.567 02:25:15 -- setup/devices.sh@63 -- # found=1 00:05:42.567 02:25:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:42.567 02:25:15 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:42.567 02:25:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:42.567 02:25:15 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:42.567 02:25:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:42.567 02:25:15 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:42.567 02:25:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:42.567 02:25:15 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:42.567 02:25:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:42.567 02:25:15 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:42.567 02:25:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:42.567 02:25:15 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:42.567 02:25:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:42.567 02:25:15 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:42.567 02:25:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:42.567 02:25:15 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:42.567 02:25:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:42.567 02:25:15 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:42.567 02:25:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:42.567 02:25:15 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:42.567 02:25:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:42.567 02:25:15 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:42.567 02:25:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:42.567 02:25:15 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:42.567 02:25:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:42.567 02:25:15 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:42.567 02:25:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:42.567 02:25:15 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:42.567 02:25:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:42.567 02:25:15 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:42.567 02:25:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:42.567 02:25:15 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:42.567 02:25:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:42.567 02:25:15 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:42.567 02:25:15 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount ]] 00:05:42.567 02:25:15 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:05:42.567 02:25:15 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:05:42.567 02:25:15 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:42.567 02:25:15 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:05:42.567 02:25:15 -- setup/devices.sh@184 -- # verify 0000:5f:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:05:42.567 02:25:15 -- setup/devices.sh@48 -- # local dev=0000:5f:00.0 00:05:42.567 02:25:15 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:05:42.567 02:25:15 -- setup/devices.sh@50 -- # local mount_point= 00:05:42.567 02:25:15 -- setup/devices.sh@51 -- # local test_file= 00:05:42.567 02:25:15 -- setup/devices.sh@53 -- # local found=0 00:05:42.567 02:25:15 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:05:42.567 02:25:15 -- setup/devices.sh@59 -- # local pci status 00:05:42.567 02:25:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:42.567 02:25:15 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5f:00.0 00:05:42.567 02:25:15 -- setup/devices.sh@47 -- # setup output config 00:05:42.567 02:25:15 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:42.567 02:25:15 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:05:45.858 02:25:19 -- setup/devices.sh@62 -- # [[ 0000:5f:00.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:45.858 02:25:19 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:05:45.858 02:25:19 -- setup/devices.sh@63 -- # found=1 00:05:45.858 02:25:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:45.858 02:25:19 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:45.858 02:25:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:45.858 02:25:19 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:45.858 02:25:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:45.858 02:25:19 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:45.858 02:25:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:45.858 02:25:19 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:45.858 02:25:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:45.859 02:25:19 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:45.859 02:25:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:45.859 02:25:19 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:45.859 02:25:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:45.859 02:25:19 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:45.859 02:25:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:45.859 02:25:19 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:45.859 02:25:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:45.859 02:25:19 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:45.859 02:25:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:45.859 02:25:19 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:45.859 02:25:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:45.859 02:25:19 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:45.859 02:25:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:45.859 02:25:19 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:45.859 02:25:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:45.859 02:25:19 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:45.859 02:25:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:45.859 02:25:19 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:45.859 02:25:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:45.859 02:25:19 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:45.859 02:25:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:45.859 02:25:19 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:05:45.859 02:25:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:45.859 02:25:19 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:45.859 02:25:19 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:05:45.859 02:25:19 -- setup/devices.sh@68 -- # return 0 00:05:45.859 02:25:19 -- setup/devices.sh@187 -- # cleanup_dm 00:05:45.859 02:25:19 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:05:45.859 02:25:19 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:05:45.859 02:25:19 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:05:45.859 02:25:19 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:45.859 02:25:19 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:05:45.859 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:05:45.859 02:25:19 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:05:45.859 02:25:19 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:05:45.859 00:05:45.859 real 0m9.758s 00:05:45.859 user 0m2.385s 00:05:45.859 sys 0m4.453s 00:05:45.859 02:25:19 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:45.859 02:25:19 -- common/autotest_common.sh@10 -- # set +x 00:05:45.859 ************************************ 00:05:45.859 END TEST dm_mount 00:05:45.859 ************************************ 00:05:45.859 02:25:19 -- setup/devices.sh@1 -- # cleanup 00:05:45.859 02:25:19 -- setup/devices.sh@11 -- # cleanup_nvme 00:05:45.859 02:25:19 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:05:45.859 02:25:19 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:45.859 02:25:19 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:05:45.859 02:25:19 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:05:45.859 02:25:19 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:46.118 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:05:46.118 /dev/nvme0n1: 8 bytes were erased at offset 0x3a3817d5e00 (gpt): 45 46 49 20 50 41 52 54 00:05:46.118 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:05:46.118 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:05:46.118 02:25:19 -- setup/devices.sh@12 -- # cleanup_dm 00:05:46.118 02:25:19 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:05:46.118 02:25:19 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:05:46.118 02:25:19 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:46.118 02:25:19 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:05:46.118 02:25:19 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:05:46.118 02:25:19 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:05:46.118 00:05:46.118 real 0m25.236s 00:05:46.118 user 0m6.999s 00:05:46.118 sys 0m13.006s 00:05:46.118 02:25:19 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:46.118 02:25:19 -- common/autotest_common.sh@10 -- # set +x 00:05:46.118 ************************************ 00:05:46.118 END TEST devices 00:05:46.118 ************************************ 00:05:46.118 00:05:46.118 real 1m31.895s 00:05:46.118 user 0m26.657s 00:05:46.118 sys 0m48.582s 00:05:46.118 02:25:19 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:46.118 02:25:19 -- common/autotest_common.sh@10 -- # set +x 00:05:46.118 ************************************ 00:05:46.118 END TEST setup.sh 00:05:46.118 ************************************ 00:05:46.118 02:25:19 -- spdk/autotest.sh@128 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh status 00:05:49.440 Hugepages 00:05:49.440 node hugesize free / total 00:05:49.440 node0 1048576kB 0 / 0 00:05:49.440 node0 2048kB 2048 / 2048 00:05:49.440 node1 1048576kB 0 / 0 00:05:49.440 node1 2048kB 0 / 0 00:05:49.440 00:05:49.440 Type BDF Vendor Device NUMA Driver Device Block devices 00:05:49.440 I/OAT 0000:00:04.0 8086 2021 0 ioatdma - - 00:05:49.440 I/OAT 0000:00:04.1 8086 2021 0 ioatdma - - 00:05:49.440 I/OAT 0000:00:04.2 8086 2021 0 ioatdma - - 00:05:49.440 I/OAT 0000:00:04.3 8086 2021 0 ioatdma - - 00:05:49.440 I/OAT 0000:00:04.4 8086 2021 0 ioatdma - - 00:05:49.440 I/OAT 0000:00:04.5 8086 2021 0 ioatdma - - 00:05:49.440 I/OAT 0000:00:04.6 8086 2021 0 ioatdma - - 00:05:49.440 I/OAT 0000:00:04.7 8086 2021 0 ioatdma - - 00:05:49.440 NVMe 0000:5f:00.0 8086 0a54 0 nvme nvme0 nvme0n1 00:05:49.440 I/OAT 0000:80:04.0 8086 2021 1 ioatdma - - 00:05:49.440 I/OAT 0000:80:04.1 8086 2021 1 ioatdma - - 00:05:49.440 I/OAT 0000:80:04.2 8086 2021 1 ioatdma - - 00:05:49.440 I/OAT 0000:80:04.3 8086 2021 1 ioatdma - - 00:05:49.440 I/OAT 0000:80:04.4 8086 2021 1 ioatdma - - 00:05:49.440 I/OAT 0000:80:04.5 8086 2021 1 ioatdma - - 00:05:49.440 I/OAT 0000:80:04.6 8086 2021 1 ioatdma - - 00:05:49.440 I/OAT 0000:80:04.7 8086 2021 1 ioatdma - - 00:05:49.440 02:25:22 -- spdk/autotest.sh@130 -- # uname -s 00:05:49.440 02:25:22 -- spdk/autotest.sh@130 -- # [[ Linux == Linux ]] 00:05:49.440 02:25:22 -- spdk/autotest.sh@132 -- # nvme_namespace_revert 00:05:49.440 02:25:22 -- common/autotest_common.sh@1517 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:05:52.734 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:05:52.734 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:05:52.734 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:05:52.734 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:05:52.734 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:05:52.734 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:05:52.734 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:05:52.734 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:05:52.734 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:05:52.734 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:05:52.734 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:05:52.734 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:05:52.734 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:05:52.734 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:05:52.734 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:05:52.734 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:05:56.022 0000:5f:00.0 (8086 0a54): nvme -> vfio-pci 00:05:56.022 02:25:29 -- common/autotest_common.sh@1518 -- # sleep 1 00:05:56.958 02:25:30 -- common/autotest_common.sh@1519 -- # bdfs=() 00:05:56.958 02:25:30 -- common/autotest_common.sh@1519 -- # local bdfs 00:05:56.958 02:25:30 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:05:56.958 02:25:30 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:05:56.958 02:25:30 -- common/autotest_common.sh@1499 -- # bdfs=() 00:05:56.958 02:25:30 -- common/autotest_common.sh@1499 -- # local bdfs 00:05:56.958 02:25:30 -- common/autotest_common.sh@1500 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:05:56.958 02:25:30 -- common/autotest_common.sh@1500 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/gen_nvme.sh 00:05:56.958 02:25:30 -- common/autotest_common.sh@1500 -- # jq -r '.config[].params.traddr' 00:05:57.215 02:25:30 -- common/autotest_common.sh@1501 -- # (( 1 == 0 )) 00:05:57.216 02:25:30 -- common/autotest_common.sh@1505 -- # printf '%s\n' 0000:5f:00.0 00:05:57.216 02:25:30 -- common/autotest_common.sh@1522 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:06:00.573 Waiting for block devices as requested 00:06:00.573 0000:5f:00.0 (8086 0a54): vfio-pci -> nvme 00:06:00.573 0000:00:04.7 (8086 2021): vfio-pci -> ioatdma 00:06:00.573 0000:00:04.6 (8086 2021): vfio-pci -> ioatdma 00:06:00.573 0000:00:04.5 (8086 2021): vfio-pci -> ioatdma 00:06:00.573 0000:00:04.4 (8086 2021): vfio-pci -> ioatdma 00:06:00.573 0000:00:04.3 (8086 2021): vfio-pci -> ioatdma 00:06:00.573 0000:00:04.2 (8086 2021): vfio-pci -> ioatdma 00:06:00.831 0000:00:04.1 (8086 2021): vfio-pci -> ioatdma 00:06:00.831 0000:00:04.0 (8086 2021): vfio-pci -> ioatdma 00:06:00.831 0000:80:04.7 (8086 2021): vfio-pci -> ioatdma 00:06:01.089 0000:80:04.6 (8086 2021): vfio-pci -> ioatdma 00:06:01.089 0000:80:04.5 (8086 2021): vfio-pci -> ioatdma 00:06:01.089 0000:80:04.4 (8086 2021): vfio-pci -> ioatdma 00:06:01.347 0000:80:04.3 (8086 2021): vfio-pci -> ioatdma 00:06:01.347 0000:80:04.2 (8086 2021): vfio-pci -> ioatdma 00:06:01.347 0000:80:04.1 (8086 2021): vfio-pci -> ioatdma 00:06:01.605 0000:80:04.0 (8086 2021): vfio-pci -> ioatdma 00:06:01.605 02:25:35 -- common/autotest_common.sh@1524 -- # for bdf in "${bdfs[@]}" 00:06:01.605 02:25:35 -- common/autotest_common.sh@1525 -- # get_nvme_ctrlr_from_bdf 0000:5f:00.0 00:06:01.605 02:25:35 -- common/autotest_common.sh@1488 -- # readlink -f /sys/class/nvme/nvme0 00:06:01.605 02:25:35 -- common/autotest_common.sh@1488 -- # grep 0000:5f:00.0/nvme/nvme 00:06:01.605 02:25:35 -- common/autotest_common.sh@1488 -- # bdf_sysfs_path=/sys/devices/pci0000:5d/0000:5d:03.0/0000:5f:00.0/nvme/nvme0 00:06:01.605 02:25:35 -- common/autotest_common.sh@1489 -- # [[ -z /sys/devices/pci0000:5d/0000:5d:03.0/0000:5f:00.0/nvme/nvme0 ]] 00:06:01.605 02:25:35 -- common/autotest_common.sh@1493 -- # basename /sys/devices/pci0000:5d/0000:5d:03.0/0000:5f:00.0/nvme/nvme0 00:06:01.605 02:25:35 -- common/autotest_common.sh@1493 -- # printf '%s\n' nvme0 00:06:01.605 02:25:35 -- common/autotest_common.sh@1525 -- # nvme_ctrlr=/dev/nvme0 00:06:01.605 02:25:35 -- common/autotest_common.sh@1526 -- # [[ -z /dev/nvme0 ]] 00:06:01.605 02:25:35 -- common/autotest_common.sh@1531 -- # nvme id-ctrl /dev/nvme0 00:06:01.605 02:25:35 -- common/autotest_common.sh@1531 -- # cut -d: -f2 00:06:01.605 02:25:35 -- common/autotest_common.sh@1531 -- # grep oacs 00:06:01.605 02:25:35 -- common/autotest_common.sh@1531 -- # oacs=' 0xe' 00:06:01.605 02:25:35 -- common/autotest_common.sh@1532 -- # oacs_ns_manage=8 00:06:01.605 02:25:35 -- common/autotest_common.sh@1534 -- # [[ 8 -ne 0 ]] 00:06:01.605 02:25:35 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:06:01.605 02:25:35 -- common/autotest_common.sh@1540 -- # grep unvmcap 00:06:01.605 02:25:35 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:06:01.605 02:25:35 -- common/autotest_common.sh@1540 -- # unvmcap=' 0' 00:06:01.605 02:25:35 -- common/autotest_common.sh@1541 -- # [[ 0 -eq 0 ]] 00:06:01.605 02:25:35 -- common/autotest_common.sh@1543 -- # continue 00:06:01.605 02:25:35 -- spdk/autotest.sh@135 -- # timing_exit pre_cleanup 00:06:01.605 02:25:35 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:01.605 02:25:35 -- common/autotest_common.sh@10 -- # set +x 00:06:01.605 02:25:35 -- spdk/autotest.sh@138 -- # timing_enter afterboot 00:06:01.605 02:25:35 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:01.605 02:25:35 -- common/autotest_common.sh@10 -- # set +x 00:06:01.605 02:25:35 -- spdk/autotest.sh@139 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:06:04.893 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:06:04.893 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:06:04.893 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:06:04.893 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:06:04.893 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:06:04.893 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:06:04.893 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:06:04.893 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:06:04.893 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:06:04.893 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:06:04.893 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:06:04.893 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:06:04.893 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:06:04.893 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:06:04.893 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:06:04.893 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:06:08.184 0000:5f:00.0 (8086 0a54): nvme -> vfio-pci 00:06:08.184 02:25:41 -- spdk/autotest.sh@140 -- # timing_exit afterboot 00:06:08.184 02:25:41 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:08.184 02:25:41 -- common/autotest_common.sh@10 -- # set +x 00:06:08.184 02:25:41 -- spdk/autotest.sh@144 -- # opal_revert_cleanup 00:06:08.184 02:25:41 -- common/autotest_common.sh@1577 -- # mapfile -t bdfs 00:06:08.184 02:25:41 -- common/autotest_common.sh@1577 -- # get_nvme_bdfs_by_id 0x0a54 00:06:08.184 02:25:41 -- common/autotest_common.sh@1563 -- # bdfs=() 00:06:08.184 02:25:41 -- common/autotest_common.sh@1563 -- # local bdfs 00:06:08.184 02:25:41 -- common/autotest_common.sh@1565 -- # get_nvme_bdfs 00:06:08.184 02:25:41 -- common/autotest_common.sh@1499 -- # bdfs=() 00:06:08.184 02:25:41 -- common/autotest_common.sh@1499 -- # local bdfs 00:06:08.184 02:25:41 -- common/autotest_common.sh@1500 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:06:08.184 02:25:41 -- common/autotest_common.sh@1500 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/gen_nvme.sh 00:06:08.184 02:25:41 -- common/autotest_common.sh@1500 -- # jq -r '.config[].params.traddr' 00:06:08.184 02:25:41 -- common/autotest_common.sh@1501 -- # (( 1 == 0 )) 00:06:08.184 02:25:41 -- common/autotest_common.sh@1505 -- # printf '%s\n' 0000:5f:00.0 00:06:08.184 02:25:41 -- common/autotest_common.sh@1565 -- # for bdf in $(get_nvme_bdfs) 00:06:08.184 02:25:41 -- common/autotest_common.sh@1566 -- # cat /sys/bus/pci/devices/0000:5f:00.0/device 00:06:08.184 02:25:41 -- common/autotest_common.sh@1566 -- # device=0x0a54 00:06:08.184 02:25:41 -- common/autotest_common.sh@1567 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:06:08.184 02:25:41 -- common/autotest_common.sh@1568 -- # bdfs+=($bdf) 00:06:08.184 02:25:41 -- common/autotest_common.sh@1572 -- # printf '%s\n' 0000:5f:00.0 00:06:08.184 02:25:41 -- common/autotest_common.sh@1578 -- # [[ -z 0000:5f:00.0 ]] 00:06:08.184 02:25:41 -- common/autotest_common.sh@1583 -- # spdk_tgt_pid=1414616 00:06:08.184 02:25:41 -- common/autotest_common.sh@1584 -- # waitforlisten 1414616 00:06:08.184 02:25:41 -- common/autotest_common.sh@1582 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:06:08.184 02:25:41 -- common/autotest_common.sh@817 -- # '[' -z 1414616 ']' 00:06:08.184 02:25:41 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:08.184 02:25:41 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:08.184 02:25:41 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:08.184 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:08.184 02:25:41 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:08.184 02:25:41 -- common/autotest_common.sh@10 -- # set +x 00:06:08.184 [2024-04-27 02:25:41.765607] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:06:08.184 [2024-04-27 02:25:41.765662] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1414616 ] 00:06:08.184 EAL: No free 2048 kB hugepages reported on node 1 00:06:08.443 [2024-04-27 02:25:41.837426] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:08.443 [2024-04-27 02:25:41.927758] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:09.012 02:25:42 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:09.012 02:25:42 -- common/autotest_common.sh@850 -- # return 0 00:06:09.012 02:25:42 -- common/autotest_common.sh@1586 -- # bdf_id=0 00:06:09.012 02:25:42 -- common/autotest_common.sh@1587 -- # for bdf in "${bdfs[@]}" 00:06:09.012 02:25:42 -- common/autotest_common.sh@1588 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:5f:00.0 00:06:12.300 nvme0n1 00:06:12.300 02:25:45 -- common/autotest_common.sh@1590 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:06:12.300 [2024-04-27 02:25:45.706933] vbdev_opal_rpc.c: 125:rpc_bdev_nvme_opal_revert: *ERROR*: nvme0 not support opal 00:06:12.300 request: 00:06:12.300 { 00:06:12.300 "nvme_ctrlr_name": "nvme0", 00:06:12.300 "password": "test", 00:06:12.300 "method": "bdev_nvme_opal_revert", 00:06:12.300 "req_id": 1 00:06:12.300 } 00:06:12.300 Got JSON-RPC error response 00:06:12.300 response: 00:06:12.300 { 00:06:12.300 "code": -32602, 00:06:12.300 "message": "Invalid parameters" 00:06:12.300 } 00:06:12.300 02:25:45 -- common/autotest_common.sh@1590 -- # true 00:06:12.300 02:25:45 -- common/autotest_common.sh@1591 -- # (( ++bdf_id )) 00:06:12.300 02:25:45 -- common/autotest_common.sh@1594 -- # killprocess 1414616 00:06:12.300 02:25:45 -- common/autotest_common.sh@936 -- # '[' -z 1414616 ']' 00:06:12.301 02:25:45 -- common/autotest_common.sh@940 -- # kill -0 1414616 00:06:12.301 02:25:45 -- common/autotest_common.sh@941 -- # uname 00:06:12.301 02:25:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:12.301 02:25:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1414616 00:06:12.301 02:25:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:12.301 02:25:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:12.301 02:25:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1414616' 00:06:12.301 killing process with pid 1414616 00:06:12.301 02:25:45 -- common/autotest_common.sh@955 -- # kill 1414616 00:06:12.301 02:25:45 -- common/autotest_common.sh@960 -- # wait 1414616 00:06:16.523 02:25:49 -- spdk/autotest.sh@150 -- # '[' 0 -eq 1 ']' 00:06:16.523 02:25:49 -- spdk/autotest.sh@154 -- # '[' 1 -eq 1 ']' 00:06:16.523 02:25:49 -- spdk/autotest.sh@155 -- # [[ 0 -eq 1 ]] 00:06:16.523 02:25:49 -- spdk/autotest.sh@155 -- # [[ 0 -eq 1 ]] 00:06:16.523 02:25:49 -- spdk/autotest.sh@162 -- # timing_enter lib 00:06:16.523 02:25:49 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:16.523 02:25:49 -- common/autotest_common.sh@10 -- # set +x 00:06:16.523 02:25:49 -- spdk/autotest.sh@164 -- # run_test env /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/env.sh 00:06:16.523 02:25:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:16.523 02:25:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:16.523 02:25:49 -- common/autotest_common.sh@10 -- # set +x 00:06:16.523 ************************************ 00:06:16.523 START TEST env 00:06:16.523 ************************************ 00:06:16.523 02:25:49 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/env.sh 00:06:16.523 * Looking for test storage... 00:06:16.523 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env 00:06:16.523 02:25:50 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/memory/memory_ut 00:06:16.523 02:25:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:16.523 02:25:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:16.523 02:25:50 -- common/autotest_common.sh@10 -- # set +x 00:06:16.782 ************************************ 00:06:16.782 START TEST env_memory 00:06:16.782 ************************************ 00:06:16.782 02:25:50 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/memory/memory_ut 00:06:16.782 00:06:16.782 00:06:16.782 CUnit - A unit testing framework for C - Version 2.1-3 00:06:16.782 http://cunit.sourceforge.net/ 00:06:16.782 00:06:16.782 00:06:16.782 Suite: memory 00:06:16.782 Test: alloc and free memory map ...[2024-04-27 02:25:50.256791] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:06:16.782 passed 00:06:16.782 Test: mem map translation ...[2024-04-27 02:25:50.276731] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:06:16.782 [2024-04-27 02:25:50.276747] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:06:16.782 [2024-04-27 02:25:50.276785] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:06:16.782 [2024-04-27 02:25:50.276794] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:06:16.782 passed 00:06:16.782 Test: mem map registration ...[2024-04-27 02:25:50.315662] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:06:16.782 [2024-04-27 02:25:50.315678] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:06:16.782 passed 00:06:16.782 Test: mem map adjacent registrations ...passed 00:06:16.782 00:06:16.782 Run Summary: Type Total Ran Passed Failed Inactive 00:06:16.782 suites 1 1 n/a 0 0 00:06:16.782 tests 4 4 4 0 0 00:06:16.782 asserts 152 152 152 0 n/a 00:06:16.782 00:06:16.782 Elapsed time = 0.140 seconds 00:06:16.782 00:06:16.782 real 0m0.154s 00:06:16.782 user 0m0.143s 00:06:16.782 sys 0m0.010s 00:06:16.782 02:25:50 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:16.782 02:25:50 -- common/autotest_common.sh@10 -- # set +x 00:06:16.782 ************************************ 00:06:16.782 END TEST env_memory 00:06:16.782 ************************************ 00:06:17.041 02:25:50 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/vtophys/vtophys 00:06:17.041 02:25:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:17.041 02:25:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:17.041 02:25:50 -- common/autotest_common.sh@10 -- # set +x 00:06:17.041 ************************************ 00:06:17.041 START TEST env_vtophys 00:06:17.041 ************************************ 00:06:17.041 02:25:50 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/vtophys/vtophys 00:06:17.041 EAL: lib.eal log level changed from notice to debug 00:06:17.041 EAL: Detected lcore 0 as core 0 on socket 0 00:06:17.041 EAL: Detected lcore 1 as core 1 on socket 0 00:06:17.041 EAL: Detected lcore 2 as core 2 on socket 0 00:06:17.041 EAL: Detected lcore 3 as core 3 on socket 0 00:06:17.041 EAL: Detected lcore 4 as core 4 on socket 0 00:06:17.041 EAL: Detected lcore 5 as core 8 on socket 0 00:06:17.041 EAL: Detected lcore 6 as core 9 on socket 0 00:06:17.041 EAL: Detected lcore 7 as core 10 on socket 0 00:06:17.041 EAL: Detected lcore 8 as core 11 on socket 0 00:06:17.041 EAL: Detected lcore 9 as core 16 on socket 0 00:06:17.041 EAL: Detected lcore 10 as core 17 on socket 0 00:06:17.041 EAL: Detected lcore 11 as core 18 on socket 0 00:06:17.041 EAL: Detected lcore 12 as core 19 on socket 0 00:06:17.041 EAL: Detected lcore 13 as core 20 on socket 0 00:06:17.041 EAL: Detected lcore 14 as core 24 on socket 0 00:06:17.041 EAL: Detected lcore 15 as core 25 on socket 0 00:06:17.041 EAL: Detected lcore 16 as core 26 on socket 0 00:06:17.041 EAL: Detected lcore 17 as core 27 on socket 0 00:06:17.041 EAL: Detected lcore 18 as core 0 on socket 1 00:06:17.041 EAL: Detected lcore 19 as core 1 on socket 1 00:06:17.041 EAL: Detected lcore 20 as core 2 on socket 1 00:06:17.041 EAL: Detected lcore 21 as core 3 on socket 1 00:06:17.041 EAL: Detected lcore 22 as core 4 on socket 1 00:06:17.041 EAL: Detected lcore 23 as core 8 on socket 1 00:06:17.041 EAL: Detected lcore 24 as core 9 on socket 1 00:06:17.041 EAL: Detected lcore 25 as core 10 on socket 1 00:06:17.042 EAL: Detected lcore 26 as core 11 on socket 1 00:06:17.042 EAL: Detected lcore 27 as core 16 on socket 1 00:06:17.042 EAL: Detected lcore 28 as core 17 on socket 1 00:06:17.042 EAL: Detected lcore 29 as core 18 on socket 1 00:06:17.042 EAL: Detected lcore 30 as core 19 on socket 1 00:06:17.042 EAL: Detected lcore 31 as core 20 on socket 1 00:06:17.042 EAL: Detected lcore 32 as core 24 on socket 1 00:06:17.042 EAL: Detected lcore 33 as core 25 on socket 1 00:06:17.042 EAL: Detected lcore 34 as core 26 on socket 1 00:06:17.042 EAL: Detected lcore 35 as core 27 on socket 1 00:06:17.042 EAL: Detected lcore 36 as core 0 on socket 0 00:06:17.042 EAL: Detected lcore 37 as core 1 on socket 0 00:06:17.042 EAL: Detected lcore 38 as core 2 on socket 0 00:06:17.042 EAL: Detected lcore 39 as core 3 on socket 0 00:06:17.042 EAL: Detected lcore 40 as core 4 on socket 0 00:06:17.042 EAL: Detected lcore 41 as core 8 on socket 0 00:06:17.042 EAL: Detected lcore 42 as core 9 on socket 0 00:06:17.042 EAL: Detected lcore 43 as core 10 on socket 0 00:06:17.042 EAL: Detected lcore 44 as core 11 on socket 0 00:06:17.042 EAL: Detected lcore 45 as core 16 on socket 0 00:06:17.042 EAL: Detected lcore 46 as core 17 on socket 0 00:06:17.042 EAL: Detected lcore 47 as core 18 on socket 0 00:06:17.042 EAL: Detected lcore 48 as core 19 on socket 0 00:06:17.042 EAL: Detected lcore 49 as core 20 on socket 0 00:06:17.042 EAL: Detected lcore 50 as core 24 on socket 0 00:06:17.042 EAL: Detected lcore 51 as core 25 on socket 0 00:06:17.042 EAL: Detected lcore 52 as core 26 on socket 0 00:06:17.042 EAL: Detected lcore 53 as core 27 on socket 0 00:06:17.042 EAL: Detected lcore 54 as core 0 on socket 1 00:06:17.042 EAL: Detected lcore 55 as core 1 on socket 1 00:06:17.042 EAL: Detected lcore 56 as core 2 on socket 1 00:06:17.042 EAL: Detected lcore 57 as core 3 on socket 1 00:06:17.042 EAL: Detected lcore 58 as core 4 on socket 1 00:06:17.042 EAL: Detected lcore 59 as core 8 on socket 1 00:06:17.042 EAL: Detected lcore 60 as core 9 on socket 1 00:06:17.042 EAL: Detected lcore 61 as core 10 on socket 1 00:06:17.042 EAL: Detected lcore 62 as core 11 on socket 1 00:06:17.042 EAL: Detected lcore 63 as core 16 on socket 1 00:06:17.042 EAL: Detected lcore 64 as core 17 on socket 1 00:06:17.042 EAL: Detected lcore 65 as core 18 on socket 1 00:06:17.042 EAL: Detected lcore 66 as core 19 on socket 1 00:06:17.042 EAL: Detected lcore 67 as core 20 on socket 1 00:06:17.042 EAL: Detected lcore 68 as core 24 on socket 1 00:06:17.042 EAL: Detected lcore 69 as core 25 on socket 1 00:06:17.042 EAL: Detected lcore 70 as core 26 on socket 1 00:06:17.042 EAL: Detected lcore 71 as core 27 on socket 1 00:06:17.042 EAL: Maximum logical cores by configuration: 128 00:06:17.042 EAL: Detected CPU lcores: 72 00:06:17.042 EAL: Detected NUMA nodes: 2 00:06:17.042 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:06:17.042 EAL: Detected shared linkage of DPDK 00:06:17.042 EAL: No shared files mode enabled, IPC will be disabled 00:06:17.042 EAL: Bus pci wants IOVA as 'DC' 00:06:17.042 EAL: Buses did not request a specific IOVA mode. 00:06:17.042 EAL: IOMMU is available, selecting IOVA as VA mode. 00:06:17.042 EAL: Selected IOVA mode 'VA' 00:06:17.042 EAL: No free 2048 kB hugepages reported on node 1 00:06:17.042 EAL: Probing VFIO support... 00:06:17.042 EAL: IOMMU type 1 (Type 1) is supported 00:06:17.042 EAL: IOMMU type 7 (sPAPR) is not supported 00:06:17.042 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:06:17.042 EAL: VFIO support initialized 00:06:17.042 EAL: Ask a virtual area of 0x2e000 bytes 00:06:17.042 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:06:17.042 EAL: Setting up physically contiguous memory... 00:06:17.042 EAL: Setting maximum number of open files to 524288 00:06:17.042 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:06:17.042 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:06:17.042 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:06:17.042 EAL: Ask a virtual area of 0x61000 bytes 00:06:17.042 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:06:17.042 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:06:17.042 EAL: Ask a virtual area of 0x400000000 bytes 00:06:17.042 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:06:17.042 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:06:17.042 EAL: Ask a virtual area of 0x61000 bytes 00:06:17.042 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:06:17.042 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:06:17.042 EAL: Ask a virtual area of 0x400000000 bytes 00:06:17.042 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:06:17.042 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:06:17.042 EAL: Ask a virtual area of 0x61000 bytes 00:06:17.042 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:06:17.042 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:06:17.042 EAL: Ask a virtual area of 0x400000000 bytes 00:06:17.042 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:06:17.042 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:06:17.042 EAL: Ask a virtual area of 0x61000 bytes 00:06:17.042 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:06:17.042 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:06:17.042 EAL: Ask a virtual area of 0x400000000 bytes 00:06:17.042 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:06:17.042 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:06:17.042 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:06:17.042 EAL: Ask a virtual area of 0x61000 bytes 00:06:17.042 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:06:17.042 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:06:17.042 EAL: Ask a virtual area of 0x400000000 bytes 00:06:17.042 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:06:17.042 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:06:17.042 EAL: Ask a virtual area of 0x61000 bytes 00:06:17.042 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:06:17.042 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:06:17.042 EAL: Ask a virtual area of 0x400000000 bytes 00:06:17.042 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:06:17.042 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:06:17.042 EAL: Ask a virtual area of 0x61000 bytes 00:06:17.042 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:06:17.042 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:06:17.042 EAL: Ask a virtual area of 0x400000000 bytes 00:06:17.042 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:06:17.042 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:06:17.042 EAL: Ask a virtual area of 0x61000 bytes 00:06:17.042 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:06:17.042 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:06:17.042 EAL: Ask a virtual area of 0x400000000 bytes 00:06:17.042 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:06:17.042 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:06:17.042 EAL: Hugepages will be freed exactly as allocated. 00:06:17.042 EAL: No shared files mode enabled, IPC is disabled 00:06:17.042 EAL: No shared files mode enabled, IPC is disabled 00:06:17.042 EAL: TSC frequency is ~2300000 KHz 00:06:17.042 EAL: Main lcore 0 is ready (tid=7f750c176a00;cpuset=[0]) 00:06:17.042 EAL: Trying to obtain current memory policy. 00:06:17.042 EAL: Setting policy MPOL_PREFERRED for socket 0 00:06:17.042 EAL: Restoring previous memory policy: 0 00:06:17.042 EAL: request: mp_malloc_sync 00:06:17.042 EAL: No shared files mode enabled, IPC is disabled 00:06:17.042 EAL: Heap on socket 0 was expanded by 2MB 00:06:17.042 EAL: No shared files mode enabled, IPC is disabled 00:06:17.042 EAL: No PCI address specified using 'addr=' in: bus=pci 00:06:17.042 EAL: Mem event callback 'spdk:(nil)' registered 00:06:17.302 00:06:17.302 00:06:17.302 CUnit - A unit testing framework for C - Version 2.1-3 00:06:17.302 http://cunit.sourceforge.net/ 00:06:17.302 00:06:17.302 00:06:17.302 Suite: components_suite 00:06:17.302 Test: vtophys_malloc_test ...passed 00:06:17.302 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:06:17.302 EAL: Setting policy MPOL_PREFERRED for socket 0 00:06:17.302 EAL: Restoring previous memory policy: 4 00:06:17.302 EAL: Calling mem event callback 'spdk:(nil)' 00:06:17.302 EAL: request: mp_malloc_sync 00:06:17.302 EAL: No shared files mode enabled, IPC is disabled 00:06:17.302 EAL: Heap on socket 0 was expanded by 4MB 00:06:17.302 EAL: Calling mem event callback 'spdk:(nil)' 00:06:17.302 EAL: request: mp_malloc_sync 00:06:17.302 EAL: No shared files mode enabled, IPC is disabled 00:06:17.302 EAL: Heap on socket 0 was shrunk by 4MB 00:06:17.302 EAL: Trying to obtain current memory policy. 00:06:17.302 EAL: Setting policy MPOL_PREFERRED for socket 0 00:06:17.302 EAL: Restoring previous memory policy: 4 00:06:17.302 EAL: Calling mem event callback 'spdk:(nil)' 00:06:17.302 EAL: request: mp_malloc_sync 00:06:17.302 EAL: No shared files mode enabled, IPC is disabled 00:06:17.302 EAL: Heap on socket 0 was expanded by 6MB 00:06:17.302 EAL: Calling mem event callback 'spdk:(nil)' 00:06:17.302 EAL: request: mp_malloc_sync 00:06:17.302 EAL: No shared files mode enabled, IPC is disabled 00:06:17.302 EAL: Heap on socket 0 was shrunk by 6MB 00:06:17.302 EAL: Trying to obtain current memory policy. 00:06:17.303 EAL: Setting policy MPOL_PREFERRED for socket 0 00:06:17.303 EAL: Restoring previous memory policy: 4 00:06:17.303 EAL: Calling mem event callback 'spdk:(nil)' 00:06:17.303 EAL: request: mp_malloc_sync 00:06:17.303 EAL: No shared files mode enabled, IPC is disabled 00:06:17.303 EAL: Heap on socket 0 was expanded by 10MB 00:06:17.303 EAL: Calling mem event callback 'spdk:(nil)' 00:06:17.303 EAL: request: mp_malloc_sync 00:06:17.303 EAL: No shared files mode enabled, IPC is disabled 00:06:17.303 EAL: Heap on socket 0 was shrunk by 10MB 00:06:17.303 EAL: Trying to obtain current memory policy. 00:06:17.303 EAL: Setting policy MPOL_PREFERRED for socket 0 00:06:17.303 EAL: Restoring previous memory policy: 4 00:06:17.303 EAL: Calling mem event callback 'spdk:(nil)' 00:06:17.303 EAL: request: mp_malloc_sync 00:06:17.303 EAL: No shared files mode enabled, IPC is disabled 00:06:17.303 EAL: Heap on socket 0 was expanded by 18MB 00:06:17.303 EAL: Calling mem event callback 'spdk:(nil)' 00:06:17.303 EAL: request: mp_malloc_sync 00:06:17.303 EAL: No shared files mode enabled, IPC is disabled 00:06:17.303 EAL: Heap on socket 0 was shrunk by 18MB 00:06:17.303 EAL: Trying to obtain current memory policy. 00:06:17.303 EAL: Setting policy MPOL_PREFERRED for socket 0 00:06:17.303 EAL: Restoring previous memory policy: 4 00:06:17.303 EAL: Calling mem event callback 'spdk:(nil)' 00:06:17.303 EAL: request: mp_malloc_sync 00:06:17.303 EAL: No shared files mode enabled, IPC is disabled 00:06:17.303 EAL: Heap on socket 0 was expanded by 34MB 00:06:17.303 EAL: Calling mem event callback 'spdk:(nil)' 00:06:17.303 EAL: request: mp_malloc_sync 00:06:17.303 EAL: No shared files mode enabled, IPC is disabled 00:06:17.303 EAL: Heap on socket 0 was shrunk by 34MB 00:06:17.303 EAL: Trying to obtain current memory policy. 00:06:17.303 EAL: Setting policy MPOL_PREFERRED for socket 0 00:06:17.303 EAL: Restoring previous memory policy: 4 00:06:17.303 EAL: Calling mem event callback 'spdk:(nil)' 00:06:17.303 EAL: request: mp_malloc_sync 00:06:17.303 EAL: No shared files mode enabled, IPC is disabled 00:06:17.303 EAL: Heap on socket 0 was expanded by 66MB 00:06:17.303 EAL: Calling mem event callback 'spdk:(nil)' 00:06:17.303 EAL: request: mp_malloc_sync 00:06:17.303 EAL: No shared files mode enabled, IPC is disabled 00:06:17.303 EAL: Heap on socket 0 was shrunk by 66MB 00:06:17.303 EAL: Trying to obtain current memory policy. 00:06:17.303 EAL: Setting policy MPOL_PREFERRED for socket 0 00:06:17.303 EAL: Restoring previous memory policy: 4 00:06:17.303 EAL: Calling mem event callback 'spdk:(nil)' 00:06:17.303 EAL: request: mp_malloc_sync 00:06:17.303 EAL: No shared files mode enabled, IPC is disabled 00:06:17.303 EAL: Heap on socket 0 was expanded by 130MB 00:06:17.303 EAL: Calling mem event callback 'spdk:(nil)' 00:06:17.303 EAL: request: mp_malloc_sync 00:06:17.303 EAL: No shared files mode enabled, IPC is disabled 00:06:17.303 EAL: Heap on socket 0 was shrunk by 130MB 00:06:17.303 EAL: Trying to obtain current memory policy. 00:06:17.303 EAL: Setting policy MPOL_PREFERRED for socket 0 00:06:17.303 EAL: Restoring previous memory policy: 4 00:06:17.303 EAL: Calling mem event callback 'spdk:(nil)' 00:06:17.303 EAL: request: mp_malloc_sync 00:06:17.303 EAL: No shared files mode enabled, IPC is disabled 00:06:17.303 EAL: Heap on socket 0 was expanded by 258MB 00:06:17.303 EAL: Calling mem event callback 'spdk:(nil)' 00:06:17.563 EAL: request: mp_malloc_sync 00:06:17.563 EAL: No shared files mode enabled, IPC is disabled 00:06:17.563 EAL: Heap on socket 0 was shrunk by 258MB 00:06:17.563 EAL: Trying to obtain current memory policy. 00:06:17.563 EAL: Setting policy MPOL_PREFERRED for socket 0 00:06:17.563 EAL: Restoring previous memory policy: 4 00:06:17.563 EAL: Calling mem event callback 'spdk:(nil)' 00:06:17.563 EAL: request: mp_malloc_sync 00:06:17.563 EAL: No shared files mode enabled, IPC is disabled 00:06:17.563 EAL: Heap on socket 0 was expanded by 514MB 00:06:17.563 EAL: Calling mem event callback 'spdk:(nil)' 00:06:17.822 EAL: request: mp_malloc_sync 00:06:17.822 EAL: No shared files mode enabled, IPC is disabled 00:06:17.822 EAL: Heap on socket 0 was shrunk by 514MB 00:06:17.822 EAL: Trying to obtain current memory policy. 00:06:17.822 EAL: Setting policy MPOL_PREFERRED for socket 0 00:06:18.081 EAL: Restoring previous memory policy: 4 00:06:18.081 EAL: Calling mem event callback 'spdk:(nil)' 00:06:18.081 EAL: request: mp_malloc_sync 00:06:18.081 EAL: No shared files mode enabled, IPC is disabled 00:06:18.081 EAL: Heap on socket 0 was expanded by 1026MB 00:06:18.081 EAL: Calling mem event callback 'spdk:(nil)' 00:06:18.341 EAL: request: mp_malloc_sync 00:06:18.341 EAL: No shared files mode enabled, IPC is disabled 00:06:18.341 EAL: Heap on socket 0 was shrunk by 1026MB 00:06:18.341 passed 00:06:18.341 00:06:18.341 Run Summary: Type Total Ran Passed Failed Inactive 00:06:18.341 suites 1 1 n/a 0 0 00:06:18.341 tests 2 2 2 0 0 00:06:18.341 asserts 497 497 497 0 n/a 00:06:18.341 00:06:18.341 Elapsed time = 1.134 seconds 00:06:18.341 EAL: Calling mem event callback 'spdk:(nil)' 00:06:18.341 EAL: request: mp_malloc_sync 00:06:18.341 EAL: No shared files mode enabled, IPC is disabled 00:06:18.341 EAL: Heap on socket 0 was shrunk by 2MB 00:06:18.341 EAL: No shared files mode enabled, IPC is disabled 00:06:18.341 EAL: No shared files mode enabled, IPC is disabled 00:06:18.341 EAL: No shared files mode enabled, IPC is disabled 00:06:18.341 00:06:18.341 real 0m1.269s 00:06:18.341 user 0m0.742s 00:06:18.341 sys 0m0.496s 00:06:18.341 02:25:51 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:18.341 02:25:51 -- common/autotest_common.sh@10 -- # set +x 00:06:18.341 ************************************ 00:06:18.341 END TEST env_vtophys 00:06:18.341 ************************************ 00:06:18.341 02:25:51 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/pci/pci_ut 00:06:18.341 02:25:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:18.341 02:25:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:18.341 02:25:51 -- common/autotest_common.sh@10 -- # set +x 00:06:18.600 ************************************ 00:06:18.600 START TEST env_pci 00:06:18.600 ************************************ 00:06:18.600 02:25:52 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/pci/pci_ut 00:06:18.600 00:06:18.600 00:06:18.600 CUnit - A unit testing framework for C - Version 2.1-3 00:06:18.600 http://cunit.sourceforge.net/ 00:06:18.600 00:06:18.600 00:06:18.600 Suite: pci 00:06:18.600 Test: pci_hook ...[2024-04-27 02:25:52.052237] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 1416043 has claimed it 00:06:18.600 EAL: Cannot find device (10000:00:01.0) 00:06:18.600 EAL: Failed to attach device on primary process 00:06:18.600 passed 00:06:18.600 00:06:18.600 Run Summary: Type Total Ran Passed Failed Inactive 00:06:18.600 suites 1 1 n/a 0 0 00:06:18.600 tests 1 1 1 0 0 00:06:18.600 asserts 25 25 25 0 n/a 00:06:18.600 00:06:18.600 Elapsed time = 0.033 seconds 00:06:18.600 00:06:18.600 real 0m0.057s 00:06:18.600 user 0m0.021s 00:06:18.600 sys 0m0.036s 00:06:18.600 02:25:52 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:18.600 02:25:52 -- common/autotest_common.sh@10 -- # set +x 00:06:18.600 ************************************ 00:06:18.600 END TEST env_pci 00:06:18.600 ************************************ 00:06:18.600 02:25:52 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:06:18.600 02:25:52 -- env/env.sh@15 -- # uname 00:06:18.600 02:25:52 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:06:18.600 02:25:52 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:06:18.600 02:25:52 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:06:18.600 02:25:52 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:06:18.600 02:25:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:18.600 02:25:52 -- common/autotest_common.sh@10 -- # set +x 00:06:18.859 ************************************ 00:06:18.859 START TEST env_dpdk_post_init 00:06:18.859 ************************************ 00:06:18.859 02:25:52 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:06:18.859 EAL: Detected CPU lcores: 72 00:06:18.859 EAL: Detected NUMA nodes: 2 00:06:18.859 EAL: Detected shared linkage of DPDK 00:06:18.859 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:06:18.859 EAL: Selected IOVA mode 'VA' 00:06:18.859 EAL: No free 2048 kB hugepages reported on node 1 00:06:18.859 EAL: VFIO support initialized 00:06:18.859 TELEMETRY: No legacy callbacks, legacy socket not created 00:06:18.859 EAL: Using IOMMU type 1 (Type 1) 00:06:18.859 EAL: Ignore mapping IO port bar(1) 00:06:18.859 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.0 (socket 0) 00:06:18.859 EAL: Ignore mapping IO port bar(1) 00:06:18.859 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.1 (socket 0) 00:06:18.859 EAL: Ignore mapping IO port bar(1) 00:06:18.859 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.2 (socket 0) 00:06:18.859 EAL: Ignore mapping IO port bar(1) 00:06:18.859 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.3 (socket 0) 00:06:18.859 EAL: Ignore mapping IO port bar(1) 00:06:18.859 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.4 (socket 0) 00:06:18.859 EAL: Ignore mapping IO port bar(1) 00:06:18.859 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.5 (socket 0) 00:06:18.859 EAL: Ignore mapping IO port bar(1) 00:06:18.859 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.6 (socket 0) 00:06:19.119 EAL: Ignore mapping IO port bar(1) 00:06:19.119 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.7 (socket 0) 00:06:19.686 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:5f:00.0 (socket 0) 00:06:19.686 EAL: Ignore mapping IO port bar(1) 00:06:19.686 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.0 (socket 1) 00:06:19.686 EAL: Ignore mapping IO port bar(1) 00:06:19.686 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.1 (socket 1) 00:06:19.686 EAL: Ignore mapping IO port bar(1) 00:06:19.686 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.2 (socket 1) 00:06:19.686 EAL: Ignore mapping IO port bar(1) 00:06:19.686 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.3 (socket 1) 00:06:19.686 EAL: Ignore mapping IO port bar(1) 00:06:19.686 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.4 (socket 1) 00:06:19.686 EAL: Ignore mapping IO port bar(1) 00:06:19.686 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.5 (socket 1) 00:06:19.686 EAL: Ignore mapping IO port bar(1) 00:06:19.686 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.6 (socket 1) 00:06:19.945 EAL: Ignore mapping IO port bar(1) 00:06:19.945 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.7 (socket 1) 00:06:25.228 EAL: Releasing PCI mapped resource for 0000:5f:00.0 00:06:25.228 EAL: Calling pci_unmap_resource for 0000:5f:00.0 at 0x202001020000 00:06:25.488 Starting DPDK initialization... 00:06:25.488 Starting SPDK post initialization... 00:06:25.488 SPDK NVMe probe 00:06:25.488 Attaching to 0000:5f:00.0 00:06:25.488 Attached to 0000:5f:00.0 00:06:25.488 Cleaning up... 00:06:25.488 00:06:25.488 real 0m6.664s 00:06:25.488 user 0m5.074s 00:06:25.488 sys 0m0.658s 00:06:25.488 02:25:58 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:25.488 02:25:58 -- common/autotest_common.sh@10 -- # set +x 00:06:25.488 ************************************ 00:06:25.488 END TEST env_dpdk_post_init 00:06:25.488 ************************************ 00:06:25.488 02:25:58 -- env/env.sh@26 -- # uname 00:06:25.488 02:25:58 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:06:25.488 02:25:58 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:06:25.488 02:25:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:25.488 02:25:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:25.488 02:25:58 -- common/autotest_common.sh@10 -- # set +x 00:06:25.748 ************************************ 00:06:25.748 START TEST env_mem_callbacks 00:06:25.748 ************************************ 00:06:25.748 02:25:59 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:06:25.748 EAL: Detected CPU lcores: 72 00:06:25.748 EAL: Detected NUMA nodes: 2 00:06:25.748 EAL: Detected shared linkage of DPDK 00:06:25.748 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:06:25.748 EAL: Selected IOVA mode 'VA' 00:06:25.748 EAL: No free 2048 kB hugepages reported on node 1 00:06:25.748 EAL: VFIO support initialized 00:06:25.748 TELEMETRY: No legacy callbacks, legacy socket not created 00:06:25.748 00:06:25.748 00:06:25.748 CUnit - A unit testing framework for C - Version 2.1-3 00:06:25.748 http://cunit.sourceforge.net/ 00:06:25.748 00:06:25.748 00:06:25.748 Suite: memory 00:06:25.748 Test: test ... 00:06:25.748 register 0x200000200000 2097152 00:06:25.748 malloc 3145728 00:06:25.748 register 0x200000400000 4194304 00:06:25.748 buf 0x200000500000 len 3145728 PASSED 00:06:25.748 malloc 64 00:06:25.748 buf 0x2000004fff40 len 64 PASSED 00:06:25.748 malloc 4194304 00:06:25.748 register 0x200000800000 6291456 00:06:25.748 buf 0x200000a00000 len 4194304 PASSED 00:06:25.748 free 0x200000500000 3145728 00:06:25.748 free 0x2000004fff40 64 00:06:25.748 unregister 0x200000400000 4194304 PASSED 00:06:25.748 free 0x200000a00000 4194304 00:06:25.748 unregister 0x200000800000 6291456 PASSED 00:06:25.748 malloc 8388608 00:06:25.748 register 0x200000400000 10485760 00:06:25.748 buf 0x200000600000 len 8388608 PASSED 00:06:25.748 free 0x200000600000 8388608 00:06:25.748 unregister 0x200000400000 10485760 PASSED 00:06:25.748 passed 00:06:25.748 00:06:25.748 Run Summary: Type Total Ran Passed Failed Inactive 00:06:25.748 suites 1 1 n/a 0 0 00:06:25.748 tests 1 1 1 0 0 00:06:25.748 asserts 15 15 15 0 n/a 00:06:25.748 00:06:25.748 Elapsed time = 0.006 seconds 00:06:25.748 00:06:25.748 real 0m0.067s 00:06:25.748 user 0m0.020s 00:06:25.748 sys 0m0.047s 00:06:25.748 02:25:59 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:25.748 02:25:59 -- common/autotest_common.sh@10 -- # set +x 00:06:25.748 ************************************ 00:06:25.748 END TEST env_mem_callbacks 00:06:25.748 ************************************ 00:06:25.748 00:06:25.748 real 0m9.293s 00:06:25.748 user 0m6.343s 00:06:25.748 sys 0m1.901s 00:06:25.748 02:25:59 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:25.748 02:25:59 -- common/autotest_common.sh@10 -- # set +x 00:06:25.748 ************************************ 00:06:25.748 END TEST env 00:06:25.748 ************************************ 00:06:25.748 02:25:59 -- spdk/autotest.sh@165 -- # run_test rpc /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/rpc.sh 00:06:25.748 02:25:59 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:25.748 02:25:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:25.748 02:25:59 -- common/autotest_common.sh@10 -- # set +x 00:06:26.007 ************************************ 00:06:26.007 START TEST rpc 00:06:26.007 ************************************ 00:06:26.007 02:25:59 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/rpc.sh 00:06:26.007 * Looking for test storage... 00:06:26.007 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc 00:06:26.007 02:25:59 -- rpc/rpc.sh@65 -- # spdk_pid=1417251 00:06:26.007 02:25:59 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:06:26.007 02:25:59 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:06:26.007 02:25:59 -- rpc/rpc.sh@67 -- # waitforlisten 1417251 00:06:26.007 02:25:59 -- common/autotest_common.sh@817 -- # '[' -z 1417251 ']' 00:06:26.007 02:25:59 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:26.007 02:25:59 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:26.007 02:25:59 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:26.007 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:26.007 02:25:59 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:26.007 02:25:59 -- common/autotest_common.sh@10 -- # set +x 00:06:26.008 [2024-04-27 02:25:59.592051] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:06:26.008 [2024-04-27 02:25:59.592118] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1417251 ] 00:06:26.008 EAL: No free 2048 kB hugepages reported on node 1 00:06:26.267 [2024-04-27 02:25:59.665321] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:26.267 [2024-04-27 02:25:59.754788] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:06:26.267 [2024-04-27 02:25:59.754828] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 1417251' to capture a snapshot of events at runtime. 00:06:26.267 [2024-04-27 02:25:59.754838] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:06:26.267 [2024-04-27 02:25:59.754847] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:06:26.267 [2024-04-27 02:25:59.754855] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid1417251 for offline analysis/debug. 00:06:26.267 [2024-04-27 02:25:59.754880] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:26.837 02:26:00 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:26.837 02:26:00 -- common/autotest_common.sh@850 -- # return 0 00:06:26.837 02:26:00 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc 00:06:26.837 02:26:00 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc 00:06:26.837 02:26:00 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:06:26.837 02:26:00 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:06:26.837 02:26:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:26.837 02:26:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:26.837 02:26:00 -- common/autotest_common.sh@10 -- # set +x 00:06:27.107 ************************************ 00:06:27.107 START TEST rpc_integrity 00:06:27.107 ************************************ 00:06:27.107 02:26:00 -- common/autotest_common.sh@1111 -- # rpc_integrity 00:06:27.107 02:26:00 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:06:27.107 02:26:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:27.107 02:26:00 -- common/autotest_common.sh@10 -- # set +x 00:06:27.107 02:26:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:27.107 02:26:00 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:06:27.107 02:26:00 -- rpc/rpc.sh@13 -- # jq length 00:06:27.107 02:26:00 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:06:27.107 02:26:00 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:06:27.107 02:26:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:27.107 02:26:00 -- common/autotest_common.sh@10 -- # set +x 00:06:27.107 02:26:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:27.108 02:26:00 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:06:27.108 02:26:00 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:06:27.108 02:26:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:27.108 02:26:00 -- common/autotest_common.sh@10 -- # set +x 00:06:27.108 02:26:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:27.108 02:26:00 -- rpc/rpc.sh@16 -- # bdevs='[ 00:06:27.108 { 00:06:27.108 "name": "Malloc0", 00:06:27.108 "aliases": [ 00:06:27.108 "bb6a56bf-c9fa-4cf8-bdf6-6f70a5baaa69" 00:06:27.108 ], 00:06:27.108 "product_name": "Malloc disk", 00:06:27.108 "block_size": 512, 00:06:27.108 "num_blocks": 16384, 00:06:27.108 "uuid": "bb6a56bf-c9fa-4cf8-bdf6-6f70a5baaa69", 00:06:27.108 "assigned_rate_limits": { 00:06:27.108 "rw_ios_per_sec": 0, 00:06:27.108 "rw_mbytes_per_sec": 0, 00:06:27.108 "r_mbytes_per_sec": 0, 00:06:27.108 "w_mbytes_per_sec": 0 00:06:27.108 }, 00:06:27.108 "claimed": false, 00:06:27.108 "zoned": false, 00:06:27.108 "supported_io_types": { 00:06:27.108 "read": true, 00:06:27.108 "write": true, 00:06:27.108 "unmap": true, 00:06:27.108 "write_zeroes": true, 00:06:27.108 "flush": true, 00:06:27.108 "reset": true, 00:06:27.108 "compare": false, 00:06:27.108 "compare_and_write": false, 00:06:27.108 "abort": true, 00:06:27.108 "nvme_admin": false, 00:06:27.108 "nvme_io": false 00:06:27.108 }, 00:06:27.108 "memory_domains": [ 00:06:27.108 { 00:06:27.108 "dma_device_id": "system", 00:06:27.108 "dma_device_type": 1 00:06:27.108 }, 00:06:27.108 { 00:06:27.108 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:27.108 "dma_device_type": 2 00:06:27.108 } 00:06:27.109 ], 00:06:27.109 "driver_specific": {} 00:06:27.109 } 00:06:27.109 ]' 00:06:27.109 02:26:00 -- rpc/rpc.sh@17 -- # jq length 00:06:27.109 02:26:00 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:06:27.109 02:26:00 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:06:27.109 02:26:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:27.109 02:26:00 -- common/autotest_common.sh@10 -- # set +x 00:06:27.109 [2024-04-27 02:26:00.657941] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:06:27.109 [2024-04-27 02:26:00.657973] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:06:27.109 [2024-04-27 02:26:00.657987] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0xf0e320 00:06:27.109 [2024-04-27 02:26:00.657996] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:06:27.109 [2024-04-27 02:26:00.659115] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:06:27.109 [2024-04-27 02:26:00.659138] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:06:27.109 Passthru0 00:06:27.109 02:26:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:27.109 02:26:00 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:06:27.109 02:26:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:27.109 02:26:00 -- common/autotest_common.sh@10 -- # set +x 00:06:27.109 02:26:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:27.109 02:26:00 -- rpc/rpc.sh@20 -- # bdevs='[ 00:06:27.109 { 00:06:27.109 "name": "Malloc0", 00:06:27.109 "aliases": [ 00:06:27.109 "bb6a56bf-c9fa-4cf8-bdf6-6f70a5baaa69" 00:06:27.109 ], 00:06:27.109 "product_name": "Malloc disk", 00:06:27.109 "block_size": 512, 00:06:27.109 "num_blocks": 16384, 00:06:27.109 "uuid": "bb6a56bf-c9fa-4cf8-bdf6-6f70a5baaa69", 00:06:27.109 "assigned_rate_limits": { 00:06:27.109 "rw_ios_per_sec": 0, 00:06:27.109 "rw_mbytes_per_sec": 0, 00:06:27.109 "r_mbytes_per_sec": 0, 00:06:27.109 "w_mbytes_per_sec": 0 00:06:27.110 }, 00:06:27.110 "claimed": true, 00:06:27.110 "claim_type": "exclusive_write", 00:06:27.110 "zoned": false, 00:06:27.110 "supported_io_types": { 00:06:27.110 "read": true, 00:06:27.110 "write": true, 00:06:27.110 "unmap": true, 00:06:27.110 "write_zeroes": true, 00:06:27.110 "flush": true, 00:06:27.110 "reset": true, 00:06:27.110 "compare": false, 00:06:27.110 "compare_and_write": false, 00:06:27.110 "abort": true, 00:06:27.110 "nvme_admin": false, 00:06:27.110 "nvme_io": false 00:06:27.110 }, 00:06:27.110 "memory_domains": [ 00:06:27.110 { 00:06:27.110 "dma_device_id": "system", 00:06:27.110 "dma_device_type": 1 00:06:27.110 }, 00:06:27.110 { 00:06:27.110 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:27.110 "dma_device_type": 2 00:06:27.110 } 00:06:27.110 ], 00:06:27.110 "driver_specific": {} 00:06:27.110 }, 00:06:27.110 { 00:06:27.110 "name": "Passthru0", 00:06:27.110 "aliases": [ 00:06:27.110 "44a92075-265e-5faa-86c0-bf4a5236a10c" 00:06:27.110 ], 00:06:27.110 "product_name": "passthru", 00:06:27.110 "block_size": 512, 00:06:27.110 "num_blocks": 16384, 00:06:27.110 "uuid": "44a92075-265e-5faa-86c0-bf4a5236a10c", 00:06:27.110 "assigned_rate_limits": { 00:06:27.110 "rw_ios_per_sec": 0, 00:06:27.110 "rw_mbytes_per_sec": 0, 00:06:27.110 "r_mbytes_per_sec": 0, 00:06:27.110 "w_mbytes_per_sec": 0 00:06:27.110 }, 00:06:27.110 "claimed": false, 00:06:27.110 "zoned": false, 00:06:27.110 "supported_io_types": { 00:06:27.110 "read": true, 00:06:27.110 "write": true, 00:06:27.110 "unmap": true, 00:06:27.110 "write_zeroes": true, 00:06:27.110 "flush": true, 00:06:27.110 "reset": true, 00:06:27.110 "compare": false, 00:06:27.110 "compare_and_write": false, 00:06:27.110 "abort": true, 00:06:27.110 "nvme_admin": false, 00:06:27.111 "nvme_io": false 00:06:27.111 }, 00:06:27.111 "memory_domains": [ 00:06:27.111 { 00:06:27.111 "dma_device_id": "system", 00:06:27.111 "dma_device_type": 1 00:06:27.111 }, 00:06:27.111 { 00:06:27.111 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:27.111 "dma_device_type": 2 00:06:27.111 } 00:06:27.111 ], 00:06:27.111 "driver_specific": { 00:06:27.111 "passthru": { 00:06:27.111 "name": "Passthru0", 00:06:27.111 "base_bdev_name": "Malloc0" 00:06:27.111 } 00:06:27.111 } 00:06:27.111 } 00:06:27.111 ]' 00:06:27.111 02:26:00 -- rpc/rpc.sh@21 -- # jq length 00:06:27.376 02:26:00 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:06:27.376 02:26:00 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:06:27.376 02:26:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:27.376 02:26:00 -- common/autotest_common.sh@10 -- # set +x 00:06:27.376 02:26:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:27.376 02:26:00 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:06:27.376 02:26:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:27.376 02:26:00 -- common/autotest_common.sh@10 -- # set +x 00:06:27.376 02:26:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:27.376 02:26:00 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:06:27.376 02:26:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:27.376 02:26:00 -- common/autotest_common.sh@10 -- # set +x 00:06:27.376 02:26:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:27.376 02:26:00 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:06:27.376 02:26:00 -- rpc/rpc.sh@26 -- # jq length 00:06:27.376 02:26:00 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:06:27.376 00:06:27.376 real 0m0.291s 00:06:27.376 user 0m0.177s 00:06:27.376 sys 0m0.053s 00:06:27.376 02:26:00 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:27.376 02:26:00 -- common/autotest_common.sh@10 -- # set +x 00:06:27.376 ************************************ 00:06:27.376 END TEST rpc_integrity 00:06:27.376 ************************************ 00:06:27.376 02:26:00 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:06:27.376 02:26:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:27.376 02:26:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:27.376 02:26:00 -- common/autotest_common.sh@10 -- # set +x 00:06:27.635 ************************************ 00:06:27.635 START TEST rpc_plugins 00:06:27.635 ************************************ 00:06:27.635 02:26:01 -- common/autotest_common.sh@1111 -- # rpc_plugins 00:06:27.635 02:26:01 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:06:27.635 02:26:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:27.635 02:26:01 -- common/autotest_common.sh@10 -- # set +x 00:06:27.635 02:26:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:27.635 02:26:01 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:06:27.635 02:26:01 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:06:27.635 02:26:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:27.635 02:26:01 -- common/autotest_common.sh@10 -- # set +x 00:06:27.635 02:26:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:27.635 02:26:01 -- rpc/rpc.sh@31 -- # bdevs='[ 00:06:27.635 { 00:06:27.635 "name": "Malloc1", 00:06:27.635 "aliases": [ 00:06:27.635 "c260d938-8a48-4a30-8235-3a79692b8405" 00:06:27.635 ], 00:06:27.635 "product_name": "Malloc disk", 00:06:27.635 "block_size": 4096, 00:06:27.635 "num_blocks": 256, 00:06:27.635 "uuid": "c260d938-8a48-4a30-8235-3a79692b8405", 00:06:27.635 "assigned_rate_limits": { 00:06:27.635 "rw_ios_per_sec": 0, 00:06:27.635 "rw_mbytes_per_sec": 0, 00:06:27.635 "r_mbytes_per_sec": 0, 00:06:27.635 "w_mbytes_per_sec": 0 00:06:27.635 }, 00:06:27.635 "claimed": false, 00:06:27.635 "zoned": false, 00:06:27.635 "supported_io_types": { 00:06:27.635 "read": true, 00:06:27.635 "write": true, 00:06:27.635 "unmap": true, 00:06:27.635 "write_zeroes": true, 00:06:27.635 "flush": true, 00:06:27.635 "reset": true, 00:06:27.635 "compare": false, 00:06:27.635 "compare_and_write": false, 00:06:27.635 "abort": true, 00:06:27.635 "nvme_admin": false, 00:06:27.635 "nvme_io": false 00:06:27.635 }, 00:06:27.635 "memory_domains": [ 00:06:27.635 { 00:06:27.635 "dma_device_id": "system", 00:06:27.635 "dma_device_type": 1 00:06:27.635 }, 00:06:27.635 { 00:06:27.635 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:27.635 "dma_device_type": 2 00:06:27.635 } 00:06:27.635 ], 00:06:27.635 "driver_specific": {} 00:06:27.635 } 00:06:27.635 ]' 00:06:27.635 02:26:01 -- rpc/rpc.sh@32 -- # jq length 00:06:27.635 02:26:01 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:06:27.635 02:26:01 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:06:27.635 02:26:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:27.635 02:26:01 -- common/autotest_common.sh@10 -- # set +x 00:06:27.635 02:26:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:27.635 02:26:01 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:06:27.635 02:26:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:27.635 02:26:01 -- common/autotest_common.sh@10 -- # set +x 00:06:27.635 02:26:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:27.635 02:26:01 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:06:27.635 02:26:01 -- rpc/rpc.sh@36 -- # jq length 00:06:27.635 02:26:01 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:06:27.635 00:06:27.635 real 0m0.147s 00:06:27.635 user 0m0.091s 00:06:27.635 sys 0m0.023s 00:06:27.635 02:26:01 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:27.635 02:26:01 -- common/autotest_common.sh@10 -- # set +x 00:06:27.635 ************************************ 00:06:27.635 END TEST rpc_plugins 00:06:27.635 ************************************ 00:06:27.636 02:26:01 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:06:27.636 02:26:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:27.636 02:26:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:27.636 02:26:01 -- common/autotest_common.sh@10 -- # set +x 00:06:27.895 ************************************ 00:06:27.895 START TEST rpc_trace_cmd_test 00:06:27.895 ************************************ 00:06:27.895 02:26:01 -- common/autotest_common.sh@1111 -- # rpc_trace_cmd_test 00:06:27.895 02:26:01 -- rpc/rpc.sh@40 -- # local info 00:06:27.895 02:26:01 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:06:27.895 02:26:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:27.895 02:26:01 -- common/autotest_common.sh@10 -- # set +x 00:06:27.895 02:26:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:27.895 02:26:01 -- rpc/rpc.sh@42 -- # info='{ 00:06:27.895 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid1417251", 00:06:27.895 "tpoint_group_mask": "0x8", 00:06:27.895 "iscsi_conn": { 00:06:27.895 "mask": "0x2", 00:06:27.895 "tpoint_mask": "0x0" 00:06:27.895 }, 00:06:27.895 "scsi": { 00:06:27.895 "mask": "0x4", 00:06:27.895 "tpoint_mask": "0x0" 00:06:27.895 }, 00:06:27.895 "bdev": { 00:06:27.895 "mask": "0x8", 00:06:27.895 "tpoint_mask": "0xffffffffffffffff" 00:06:27.895 }, 00:06:27.895 "nvmf_rdma": { 00:06:27.895 "mask": "0x10", 00:06:27.895 "tpoint_mask": "0x0" 00:06:27.895 }, 00:06:27.895 "nvmf_tcp": { 00:06:27.895 "mask": "0x20", 00:06:27.895 "tpoint_mask": "0x0" 00:06:27.895 }, 00:06:27.895 "ftl": { 00:06:27.895 "mask": "0x40", 00:06:27.895 "tpoint_mask": "0x0" 00:06:27.895 }, 00:06:27.895 "blobfs": { 00:06:27.895 "mask": "0x80", 00:06:27.895 "tpoint_mask": "0x0" 00:06:27.895 }, 00:06:27.895 "dsa": { 00:06:27.895 "mask": "0x200", 00:06:27.895 "tpoint_mask": "0x0" 00:06:27.895 }, 00:06:27.895 "thread": { 00:06:27.895 "mask": "0x400", 00:06:27.895 "tpoint_mask": "0x0" 00:06:27.895 }, 00:06:27.895 "nvme_pcie": { 00:06:27.895 "mask": "0x800", 00:06:27.895 "tpoint_mask": "0x0" 00:06:27.895 }, 00:06:27.895 "iaa": { 00:06:27.895 "mask": "0x1000", 00:06:27.895 "tpoint_mask": "0x0" 00:06:27.895 }, 00:06:27.895 "nvme_tcp": { 00:06:27.895 "mask": "0x2000", 00:06:27.895 "tpoint_mask": "0x0" 00:06:27.895 }, 00:06:27.895 "bdev_nvme": { 00:06:27.895 "mask": "0x4000", 00:06:27.895 "tpoint_mask": "0x0" 00:06:27.895 }, 00:06:27.895 "sock": { 00:06:27.895 "mask": "0x8000", 00:06:27.895 "tpoint_mask": "0x0" 00:06:27.895 } 00:06:27.895 }' 00:06:27.895 02:26:01 -- rpc/rpc.sh@43 -- # jq length 00:06:27.895 02:26:01 -- rpc/rpc.sh@43 -- # '[' 16 -gt 2 ']' 00:06:27.895 02:26:01 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:06:27.895 02:26:01 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:06:27.895 02:26:01 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:06:27.895 02:26:01 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:06:27.895 02:26:01 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:06:28.155 02:26:01 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:06:28.155 02:26:01 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:06:28.155 02:26:01 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:06:28.155 00:06:28.155 real 0m0.219s 00:06:28.155 user 0m0.171s 00:06:28.155 sys 0m0.041s 00:06:28.155 02:26:01 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:28.155 02:26:01 -- common/autotest_common.sh@10 -- # set +x 00:06:28.155 ************************************ 00:06:28.155 END TEST rpc_trace_cmd_test 00:06:28.155 ************************************ 00:06:28.155 02:26:01 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:06:28.155 02:26:01 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:06:28.155 02:26:01 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:06:28.155 02:26:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:28.155 02:26:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:28.155 02:26:01 -- common/autotest_common.sh@10 -- # set +x 00:06:28.414 ************************************ 00:06:28.414 START TEST rpc_daemon_integrity 00:06:28.414 ************************************ 00:06:28.414 02:26:01 -- common/autotest_common.sh@1111 -- # rpc_integrity 00:06:28.414 02:26:01 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:06:28.414 02:26:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:28.414 02:26:01 -- common/autotest_common.sh@10 -- # set +x 00:06:28.414 02:26:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:28.414 02:26:01 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:06:28.414 02:26:01 -- rpc/rpc.sh@13 -- # jq length 00:06:28.414 02:26:01 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:06:28.414 02:26:01 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:06:28.414 02:26:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:28.414 02:26:01 -- common/autotest_common.sh@10 -- # set +x 00:06:28.414 02:26:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:28.414 02:26:01 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:06:28.414 02:26:01 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:06:28.414 02:26:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:28.414 02:26:01 -- common/autotest_common.sh@10 -- # set +x 00:06:28.414 02:26:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:28.414 02:26:01 -- rpc/rpc.sh@16 -- # bdevs='[ 00:06:28.414 { 00:06:28.414 "name": "Malloc2", 00:06:28.414 "aliases": [ 00:06:28.414 "571b8944-5f2b-4536-b2c2-a9100f38b1b8" 00:06:28.414 ], 00:06:28.414 "product_name": "Malloc disk", 00:06:28.414 "block_size": 512, 00:06:28.414 "num_blocks": 16384, 00:06:28.414 "uuid": "571b8944-5f2b-4536-b2c2-a9100f38b1b8", 00:06:28.414 "assigned_rate_limits": { 00:06:28.414 "rw_ios_per_sec": 0, 00:06:28.414 "rw_mbytes_per_sec": 0, 00:06:28.414 "r_mbytes_per_sec": 0, 00:06:28.414 "w_mbytes_per_sec": 0 00:06:28.414 }, 00:06:28.414 "claimed": false, 00:06:28.414 "zoned": false, 00:06:28.414 "supported_io_types": { 00:06:28.414 "read": true, 00:06:28.414 "write": true, 00:06:28.414 "unmap": true, 00:06:28.414 "write_zeroes": true, 00:06:28.414 "flush": true, 00:06:28.414 "reset": true, 00:06:28.414 "compare": false, 00:06:28.414 "compare_and_write": false, 00:06:28.414 "abort": true, 00:06:28.414 "nvme_admin": false, 00:06:28.414 "nvme_io": false 00:06:28.414 }, 00:06:28.414 "memory_domains": [ 00:06:28.414 { 00:06:28.414 "dma_device_id": "system", 00:06:28.414 "dma_device_type": 1 00:06:28.414 }, 00:06:28.414 { 00:06:28.414 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:28.414 "dma_device_type": 2 00:06:28.414 } 00:06:28.414 ], 00:06:28.414 "driver_specific": {} 00:06:28.414 } 00:06:28.414 ]' 00:06:28.414 02:26:01 -- rpc/rpc.sh@17 -- # jq length 00:06:28.414 02:26:01 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:06:28.414 02:26:01 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:06:28.414 02:26:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:28.414 02:26:01 -- common/autotest_common.sh@10 -- # set +x 00:06:28.414 [2024-04-27 02:26:01.953660] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:06:28.414 [2024-04-27 02:26:01.953694] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:06:28.414 [2024-04-27 02:26:01.953712] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0xf0e0a0 00:06:28.414 [2024-04-27 02:26:01.953721] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:06:28.414 [2024-04-27 02:26:01.954712] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:06:28.414 [2024-04-27 02:26:01.954733] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:06:28.414 Passthru0 00:06:28.414 02:26:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:28.414 02:26:01 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:06:28.414 02:26:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:28.414 02:26:01 -- common/autotest_common.sh@10 -- # set +x 00:06:28.414 02:26:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:28.414 02:26:01 -- rpc/rpc.sh@20 -- # bdevs='[ 00:06:28.414 { 00:06:28.414 "name": "Malloc2", 00:06:28.414 "aliases": [ 00:06:28.414 "571b8944-5f2b-4536-b2c2-a9100f38b1b8" 00:06:28.414 ], 00:06:28.414 "product_name": "Malloc disk", 00:06:28.414 "block_size": 512, 00:06:28.414 "num_blocks": 16384, 00:06:28.414 "uuid": "571b8944-5f2b-4536-b2c2-a9100f38b1b8", 00:06:28.414 "assigned_rate_limits": { 00:06:28.414 "rw_ios_per_sec": 0, 00:06:28.414 "rw_mbytes_per_sec": 0, 00:06:28.414 "r_mbytes_per_sec": 0, 00:06:28.414 "w_mbytes_per_sec": 0 00:06:28.414 }, 00:06:28.414 "claimed": true, 00:06:28.414 "claim_type": "exclusive_write", 00:06:28.414 "zoned": false, 00:06:28.414 "supported_io_types": { 00:06:28.414 "read": true, 00:06:28.414 "write": true, 00:06:28.414 "unmap": true, 00:06:28.414 "write_zeroes": true, 00:06:28.414 "flush": true, 00:06:28.414 "reset": true, 00:06:28.414 "compare": false, 00:06:28.414 "compare_and_write": false, 00:06:28.414 "abort": true, 00:06:28.414 "nvme_admin": false, 00:06:28.414 "nvme_io": false 00:06:28.414 }, 00:06:28.414 "memory_domains": [ 00:06:28.414 { 00:06:28.414 "dma_device_id": "system", 00:06:28.414 "dma_device_type": 1 00:06:28.414 }, 00:06:28.414 { 00:06:28.414 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:28.414 "dma_device_type": 2 00:06:28.414 } 00:06:28.414 ], 00:06:28.414 "driver_specific": {} 00:06:28.414 }, 00:06:28.414 { 00:06:28.414 "name": "Passthru0", 00:06:28.414 "aliases": [ 00:06:28.414 "22a9f949-66cc-5d02-95a4-bddd1c303b5a" 00:06:28.414 ], 00:06:28.414 "product_name": "passthru", 00:06:28.414 "block_size": 512, 00:06:28.414 "num_blocks": 16384, 00:06:28.414 "uuid": "22a9f949-66cc-5d02-95a4-bddd1c303b5a", 00:06:28.414 "assigned_rate_limits": { 00:06:28.414 "rw_ios_per_sec": 0, 00:06:28.414 "rw_mbytes_per_sec": 0, 00:06:28.414 "r_mbytes_per_sec": 0, 00:06:28.414 "w_mbytes_per_sec": 0 00:06:28.414 }, 00:06:28.414 "claimed": false, 00:06:28.414 "zoned": false, 00:06:28.414 "supported_io_types": { 00:06:28.414 "read": true, 00:06:28.414 "write": true, 00:06:28.414 "unmap": true, 00:06:28.414 "write_zeroes": true, 00:06:28.414 "flush": true, 00:06:28.414 "reset": true, 00:06:28.414 "compare": false, 00:06:28.414 "compare_and_write": false, 00:06:28.414 "abort": true, 00:06:28.414 "nvme_admin": false, 00:06:28.414 "nvme_io": false 00:06:28.414 }, 00:06:28.414 "memory_domains": [ 00:06:28.414 { 00:06:28.415 "dma_device_id": "system", 00:06:28.415 "dma_device_type": 1 00:06:28.415 }, 00:06:28.415 { 00:06:28.415 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:28.415 "dma_device_type": 2 00:06:28.415 } 00:06:28.415 ], 00:06:28.415 "driver_specific": { 00:06:28.415 "passthru": { 00:06:28.415 "name": "Passthru0", 00:06:28.415 "base_bdev_name": "Malloc2" 00:06:28.415 } 00:06:28.415 } 00:06:28.415 } 00:06:28.415 ]' 00:06:28.415 02:26:01 -- rpc/rpc.sh@21 -- # jq length 00:06:28.415 02:26:02 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:06:28.415 02:26:02 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:06:28.415 02:26:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:28.415 02:26:02 -- common/autotest_common.sh@10 -- # set +x 00:06:28.415 02:26:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:28.415 02:26:02 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:06:28.415 02:26:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:28.415 02:26:02 -- common/autotest_common.sh@10 -- # set +x 00:06:28.415 02:26:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:28.415 02:26:02 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:06:28.415 02:26:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:28.415 02:26:02 -- common/autotest_common.sh@10 -- # set +x 00:06:28.673 02:26:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:28.673 02:26:02 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:06:28.673 02:26:02 -- rpc/rpc.sh@26 -- # jq length 00:06:28.673 02:26:02 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:06:28.673 00:06:28.673 real 0m0.257s 00:06:28.673 user 0m0.148s 00:06:28.673 sys 0m0.049s 00:06:28.673 02:26:02 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:28.673 02:26:02 -- common/autotest_common.sh@10 -- # set +x 00:06:28.673 ************************************ 00:06:28.673 END TEST rpc_daemon_integrity 00:06:28.673 ************************************ 00:06:28.673 02:26:02 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:06:28.673 02:26:02 -- rpc/rpc.sh@84 -- # killprocess 1417251 00:06:28.673 02:26:02 -- common/autotest_common.sh@936 -- # '[' -z 1417251 ']' 00:06:28.673 02:26:02 -- common/autotest_common.sh@940 -- # kill -0 1417251 00:06:28.673 02:26:02 -- common/autotest_common.sh@941 -- # uname 00:06:28.673 02:26:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:28.673 02:26:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1417251 00:06:28.673 02:26:02 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:28.673 02:26:02 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:28.673 02:26:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1417251' 00:06:28.673 killing process with pid 1417251 00:06:28.673 02:26:02 -- common/autotest_common.sh@955 -- # kill 1417251 00:06:28.673 02:26:02 -- common/autotest_common.sh@960 -- # wait 1417251 00:06:28.933 00:06:28.933 real 0m3.075s 00:06:28.933 user 0m3.840s 00:06:28.933 sys 0m1.097s 00:06:28.933 02:26:02 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:28.933 02:26:02 -- common/autotest_common.sh@10 -- # set +x 00:06:28.933 ************************************ 00:06:28.933 END TEST rpc 00:06:28.933 ************************************ 00:06:28.933 02:26:02 -- spdk/autotest.sh@166 -- # run_test skip_rpc /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/skip_rpc.sh 00:06:28.933 02:26:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:28.933 02:26:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:28.933 02:26:02 -- common/autotest_common.sh@10 -- # set +x 00:06:29.193 ************************************ 00:06:29.193 START TEST skip_rpc 00:06:29.193 ************************************ 00:06:29.193 02:26:02 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/skip_rpc.sh 00:06:29.452 * Looking for test storage... 00:06:29.452 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc 00:06:29.452 02:26:02 -- rpc/skip_rpc.sh@11 -- # CONFIG_PATH=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/config.json 00:06:29.452 02:26:02 -- rpc/skip_rpc.sh@12 -- # LOG_PATH=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/log.txt 00:06:29.452 02:26:02 -- rpc/skip_rpc.sh@73 -- # run_test skip_rpc test_skip_rpc 00:06:29.452 02:26:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:29.452 02:26:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:29.452 02:26:02 -- common/autotest_common.sh@10 -- # set +x 00:06:29.452 ************************************ 00:06:29.452 START TEST skip_rpc 00:06:29.452 ************************************ 00:06:29.452 02:26:02 -- common/autotest_common.sh@1111 -- # test_skip_rpc 00:06:29.452 02:26:02 -- rpc/skip_rpc.sh@16 -- # local spdk_pid=1417860 00:06:29.452 02:26:02 -- rpc/skip_rpc.sh@18 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:06:29.452 02:26:02 -- rpc/skip_rpc.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 00:06:29.452 02:26:02 -- rpc/skip_rpc.sh@19 -- # sleep 5 00:06:29.452 [2024-04-27 02:26:03.011450] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:06:29.452 [2024-04-27 02:26:03.011499] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1417860 ] 00:06:29.452 EAL: No free 2048 kB hugepages reported on node 1 00:06:29.710 [2024-04-27 02:26:03.081878] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:29.710 [2024-04-27 02:26:03.163566] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:34.981 02:26:07 -- rpc/skip_rpc.sh@21 -- # NOT rpc_cmd spdk_get_version 00:06:34.981 02:26:07 -- common/autotest_common.sh@638 -- # local es=0 00:06:34.981 02:26:07 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd spdk_get_version 00:06:34.981 02:26:07 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:06:34.981 02:26:07 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:34.981 02:26:07 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:06:34.981 02:26:07 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:34.981 02:26:07 -- common/autotest_common.sh@641 -- # rpc_cmd spdk_get_version 00:06:34.981 02:26:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:34.981 02:26:07 -- common/autotest_common.sh@10 -- # set +x 00:06:34.981 02:26:07 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:06:34.981 02:26:07 -- common/autotest_common.sh@641 -- # es=1 00:06:34.981 02:26:07 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:06:34.981 02:26:07 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:06:34.981 02:26:07 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:06:34.981 02:26:07 -- rpc/skip_rpc.sh@22 -- # trap - SIGINT SIGTERM EXIT 00:06:34.981 02:26:07 -- rpc/skip_rpc.sh@23 -- # killprocess 1417860 00:06:34.981 02:26:07 -- common/autotest_common.sh@936 -- # '[' -z 1417860 ']' 00:06:34.981 02:26:07 -- common/autotest_common.sh@940 -- # kill -0 1417860 00:06:34.981 02:26:07 -- common/autotest_common.sh@941 -- # uname 00:06:34.981 02:26:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:34.981 02:26:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1417860 00:06:34.981 02:26:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:34.981 02:26:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:34.981 02:26:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1417860' 00:06:34.981 killing process with pid 1417860 00:06:34.981 02:26:08 -- common/autotest_common.sh@955 -- # kill 1417860 00:06:34.981 02:26:08 -- common/autotest_common.sh@960 -- # wait 1417860 00:06:34.981 00:06:34.981 real 0m5.433s 00:06:34.981 user 0m5.165s 00:06:34.981 sys 0m0.305s 00:06:34.981 02:26:08 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:34.981 02:26:08 -- common/autotest_common.sh@10 -- # set +x 00:06:34.981 ************************************ 00:06:34.981 END TEST skip_rpc 00:06:34.981 ************************************ 00:06:34.981 02:26:08 -- rpc/skip_rpc.sh@74 -- # run_test skip_rpc_with_json test_skip_rpc_with_json 00:06:34.981 02:26:08 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:34.981 02:26:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:34.981 02:26:08 -- common/autotest_common.sh@10 -- # set +x 00:06:34.981 ************************************ 00:06:34.981 START TEST skip_rpc_with_json 00:06:34.981 ************************************ 00:06:34.981 02:26:08 -- common/autotest_common.sh@1111 -- # test_skip_rpc_with_json 00:06:34.981 02:26:08 -- rpc/skip_rpc.sh@44 -- # gen_json_config 00:06:34.981 02:26:08 -- rpc/skip_rpc.sh@28 -- # local spdk_pid=1418625 00:06:34.981 02:26:08 -- rpc/skip_rpc.sh@30 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:06:34.981 02:26:08 -- rpc/skip_rpc.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:34.981 02:26:08 -- rpc/skip_rpc.sh@31 -- # waitforlisten 1418625 00:06:34.981 02:26:08 -- common/autotest_common.sh@817 -- # '[' -z 1418625 ']' 00:06:35.241 02:26:08 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:35.241 02:26:08 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:35.241 02:26:08 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:35.241 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:35.241 02:26:08 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:35.241 02:26:08 -- common/autotest_common.sh@10 -- # set +x 00:06:35.241 [2024-04-27 02:26:08.653847] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:06:35.241 [2024-04-27 02:26:08.653905] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1418625 ] 00:06:35.241 EAL: No free 2048 kB hugepages reported on node 1 00:06:35.241 [2024-04-27 02:26:08.725063] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:35.241 [2024-04-27 02:26:08.810931] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:36.213 02:26:09 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:36.213 02:26:09 -- common/autotest_common.sh@850 -- # return 0 00:06:36.213 02:26:09 -- rpc/skip_rpc.sh@34 -- # rpc_cmd nvmf_get_transports --trtype tcp 00:06:36.213 02:26:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:36.213 02:26:09 -- common/autotest_common.sh@10 -- # set +x 00:06:36.213 [2024-04-27 02:26:09.449880] nvmf_rpc.c:2513:rpc_nvmf_get_transports: *ERROR*: transport 'tcp' does not exist 00:06:36.213 request: 00:06:36.213 { 00:06:36.213 "trtype": "tcp", 00:06:36.213 "method": "nvmf_get_transports", 00:06:36.213 "req_id": 1 00:06:36.213 } 00:06:36.213 Got JSON-RPC error response 00:06:36.213 response: 00:06:36.213 { 00:06:36.213 "code": -19, 00:06:36.213 "message": "No such device" 00:06:36.213 } 00:06:36.213 02:26:09 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:06:36.213 02:26:09 -- rpc/skip_rpc.sh@34 -- # rpc_cmd nvmf_create_transport -t tcp 00:06:36.213 02:26:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:36.213 02:26:09 -- common/autotest_common.sh@10 -- # set +x 00:06:36.213 [2024-04-27 02:26:09.461988] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:36.213 02:26:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:36.213 02:26:09 -- rpc/skip_rpc.sh@36 -- # rpc_cmd save_config 00:06:36.213 02:26:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:36.213 02:26:09 -- common/autotest_common.sh@10 -- # set +x 00:06:36.213 02:26:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:36.213 02:26:09 -- rpc/skip_rpc.sh@37 -- # cat /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/config.json 00:06:36.213 { 00:06:36.213 "subsystems": [ 00:06:36.213 { 00:06:36.213 "subsystem": "keyring", 00:06:36.213 "config": [] 00:06:36.213 }, 00:06:36.213 { 00:06:36.213 "subsystem": "iobuf", 00:06:36.213 "config": [ 00:06:36.213 { 00:06:36.213 "method": "iobuf_set_options", 00:06:36.213 "params": { 00:06:36.213 "small_pool_count": 8192, 00:06:36.213 "large_pool_count": 1024, 00:06:36.213 "small_bufsize": 8192, 00:06:36.213 "large_bufsize": 135168 00:06:36.213 } 00:06:36.213 } 00:06:36.213 ] 00:06:36.213 }, 00:06:36.213 { 00:06:36.213 "subsystem": "sock", 00:06:36.213 "config": [ 00:06:36.213 { 00:06:36.213 "method": "sock_impl_set_options", 00:06:36.213 "params": { 00:06:36.213 "impl_name": "posix", 00:06:36.213 "recv_buf_size": 2097152, 00:06:36.213 "send_buf_size": 2097152, 00:06:36.213 "enable_recv_pipe": true, 00:06:36.213 "enable_quickack": false, 00:06:36.213 "enable_placement_id": 0, 00:06:36.213 "enable_zerocopy_send_server": true, 00:06:36.213 "enable_zerocopy_send_client": false, 00:06:36.213 "zerocopy_threshold": 0, 00:06:36.213 "tls_version": 0, 00:06:36.213 "enable_ktls": false 00:06:36.213 } 00:06:36.213 }, 00:06:36.213 { 00:06:36.213 "method": "sock_impl_set_options", 00:06:36.213 "params": { 00:06:36.213 "impl_name": "ssl", 00:06:36.213 "recv_buf_size": 4096, 00:06:36.213 "send_buf_size": 4096, 00:06:36.213 "enable_recv_pipe": true, 00:06:36.213 "enable_quickack": false, 00:06:36.213 "enable_placement_id": 0, 00:06:36.213 "enable_zerocopy_send_server": true, 00:06:36.213 "enable_zerocopy_send_client": false, 00:06:36.214 "zerocopy_threshold": 0, 00:06:36.214 "tls_version": 0, 00:06:36.214 "enable_ktls": false 00:06:36.214 } 00:06:36.214 } 00:06:36.214 ] 00:06:36.214 }, 00:06:36.214 { 00:06:36.214 "subsystem": "vmd", 00:06:36.214 "config": [] 00:06:36.214 }, 00:06:36.214 { 00:06:36.214 "subsystem": "accel", 00:06:36.214 "config": [ 00:06:36.214 { 00:06:36.214 "method": "accel_set_options", 00:06:36.214 "params": { 00:06:36.214 "small_cache_size": 128, 00:06:36.214 "large_cache_size": 16, 00:06:36.214 "task_count": 2048, 00:06:36.214 "sequence_count": 2048, 00:06:36.214 "buf_count": 2048 00:06:36.214 } 00:06:36.214 } 00:06:36.214 ] 00:06:36.214 }, 00:06:36.214 { 00:06:36.214 "subsystem": "bdev", 00:06:36.214 "config": [ 00:06:36.214 { 00:06:36.214 "method": "bdev_set_options", 00:06:36.214 "params": { 00:06:36.214 "bdev_io_pool_size": 65535, 00:06:36.214 "bdev_io_cache_size": 256, 00:06:36.214 "bdev_auto_examine": true, 00:06:36.214 "iobuf_small_cache_size": 128, 00:06:36.214 "iobuf_large_cache_size": 16 00:06:36.214 } 00:06:36.214 }, 00:06:36.214 { 00:06:36.214 "method": "bdev_raid_set_options", 00:06:36.214 "params": { 00:06:36.214 "process_window_size_kb": 1024 00:06:36.214 } 00:06:36.214 }, 00:06:36.214 { 00:06:36.214 "method": "bdev_iscsi_set_options", 00:06:36.214 "params": { 00:06:36.214 "timeout_sec": 30 00:06:36.214 } 00:06:36.214 }, 00:06:36.214 { 00:06:36.214 "method": "bdev_nvme_set_options", 00:06:36.214 "params": { 00:06:36.214 "action_on_timeout": "none", 00:06:36.214 "timeout_us": 0, 00:06:36.214 "timeout_admin_us": 0, 00:06:36.214 "keep_alive_timeout_ms": 10000, 00:06:36.214 "arbitration_burst": 0, 00:06:36.214 "low_priority_weight": 0, 00:06:36.214 "medium_priority_weight": 0, 00:06:36.214 "high_priority_weight": 0, 00:06:36.214 "nvme_adminq_poll_period_us": 10000, 00:06:36.214 "nvme_ioq_poll_period_us": 0, 00:06:36.214 "io_queue_requests": 0, 00:06:36.214 "delay_cmd_submit": true, 00:06:36.214 "transport_retry_count": 4, 00:06:36.214 "bdev_retry_count": 3, 00:06:36.214 "transport_ack_timeout": 0, 00:06:36.214 "ctrlr_loss_timeout_sec": 0, 00:06:36.214 "reconnect_delay_sec": 0, 00:06:36.214 "fast_io_fail_timeout_sec": 0, 00:06:36.214 "disable_auto_failback": false, 00:06:36.214 "generate_uuids": false, 00:06:36.214 "transport_tos": 0, 00:06:36.214 "nvme_error_stat": false, 00:06:36.214 "rdma_srq_size": 0, 00:06:36.214 "io_path_stat": false, 00:06:36.214 "allow_accel_sequence": false, 00:06:36.214 "rdma_max_cq_size": 0, 00:06:36.214 "rdma_cm_event_timeout_ms": 0, 00:06:36.214 "dhchap_digests": [ 00:06:36.214 "sha256", 00:06:36.214 "sha384", 00:06:36.214 "sha512" 00:06:36.214 ], 00:06:36.214 "dhchap_dhgroups": [ 00:06:36.214 "null", 00:06:36.214 "ffdhe2048", 00:06:36.214 "ffdhe3072", 00:06:36.214 "ffdhe4096", 00:06:36.214 "ffdhe6144", 00:06:36.214 "ffdhe8192" 00:06:36.214 ] 00:06:36.214 } 00:06:36.214 }, 00:06:36.214 { 00:06:36.214 "method": "bdev_nvme_set_hotplug", 00:06:36.214 "params": { 00:06:36.214 "period_us": 100000, 00:06:36.214 "enable": false 00:06:36.214 } 00:06:36.214 }, 00:06:36.214 { 00:06:36.214 "method": "bdev_wait_for_examine" 00:06:36.214 } 00:06:36.214 ] 00:06:36.214 }, 00:06:36.214 { 00:06:36.214 "subsystem": "scsi", 00:06:36.214 "config": null 00:06:36.214 }, 00:06:36.214 { 00:06:36.214 "subsystem": "scheduler", 00:06:36.214 "config": [ 00:06:36.214 { 00:06:36.214 "method": "framework_set_scheduler", 00:06:36.214 "params": { 00:06:36.214 "name": "static" 00:06:36.214 } 00:06:36.214 } 00:06:36.214 ] 00:06:36.214 }, 00:06:36.214 { 00:06:36.214 "subsystem": "vhost_scsi", 00:06:36.214 "config": [] 00:06:36.214 }, 00:06:36.214 { 00:06:36.214 "subsystem": "vhost_blk", 00:06:36.214 "config": [] 00:06:36.214 }, 00:06:36.214 { 00:06:36.214 "subsystem": "ublk", 00:06:36.214 "config": [] 00:06:36.214 }, 00:06:36.214 { 00:06:36.214 "subsystem": "nbd", 00:06:36.214 "config": [] 00:06:36.214 }, 00:06:36.214 { 00:06:36.214 "subsystem": "nvmf", 00:06:36.214 "config": [ 00:06:36.214 { 00:06:36.214 "method": "nvmf_set_config", 00:06:36.214 "params": { 00:06:36.214 "discovery_filter": "match_any", 00:06:36.214 "admin_cmd_passthru": { 00:06:36.214 "identify_ctrlr": false 00:06:36.214 } 00:06:36.214 } 00:06:36.214 }, 00:06:36.214 { 00:06:36.214 "method": "nvmf_set_max_subsystems", 00:06:36.214 "params": { 00:06:36.214 "max_subsystems": 1024 00:06:36.214 } 00:06:36.214 }, 00:06:36.214 { 00:06:36.214 "method": "nvmf_set_crdt", 00:06:36.214 "params": { 00:06:36.214 "crdt1": 0, 00:06:36.214 "crdt2": 0, 00:06:36.214 "crdt3": 0 00:06:36.214 } 00:06:36.214 }, 00:06:36.214 { 00:06:36.214 "method": "nvmf_create_transport", 00:06:36.214 "params": { 00:06:36.214 "trtype": "TCP", 00:06:36.214 "max_queue_depth": 128, 00:06:36.214 "max_io_qpairs_per_ctrlr": 127, 00:06:36.214 "in_capsule_data_size": 4096, 00:06:36.214 "max_io_size": 131072, 00:06:36.214 "io_unit_size": 131072, 00:06:36.214 "max_aq_depth": 128, 00:06:36.214 "num_shared_buffers": 511, 00:06:36.214 "buf_cache_size": 4294967295, 00:06:36.214 "dif_insert_or_strip": false, 00:06:36.214 "zcopy": false, 00:06:36.214 "c2h_success": true, 00:06:36.214 "sock_priority": 0, 00:06:36.214 "abort_timeout_sec": 1, 00:06:36.214 "ack_timeout": 0, 00:06:36.214 "data_wr_pool_size": 0 00:06:36.214 } 00:06:36.214 } 00:06:36.214 ] 00:06:36.214 }, 00:06:36.214 { 00:06:36.214 "subsystem": "iscsi", 00:06:36.214 "config": [ 00:06:36.214 { 00:06:36.214 "method": "iscsi_set_options", 00:06:36.214 "params": { 00:06:36.214 "node_base": "iqn.2016-06.io.spdk", 00:06:36.214 "max_sessions": 128, 00:06:36.214 "max_connections_per_session": 2, 00:06:36.214 "max_queue_depth": 64, 00:06:36.214 "default_time2wait": 2, 00:06:36.214 "default_time2retain": 20, 00:06:36.214 "first_burst_length": 8192, 00:06:36.214 "immediate_data": true, 00:06:36.214 "allow_duplicated_isid": false, 00:06:36.214 "error_recovery_level": 0, 00:06:36.214 "nop_timeout": 60, 00:06:36.214 "nop_in_interval": 30, 00:06:36.214 "disable_chap": false, 00:06:36.214 "require_chap": false, 00:06:36.214 "mutual_chap": false, 00:06:36.214 "chap_group": 0, 00:06:36.214 "max_large_datain_per_connection": 64, 00:06:36.214 "max_r2t_per_connection": 4, 00:06:36.214 "pdu_pool_size": 36864, 00:06:36.214 "immediate_data_pool_size": 16384, 00:06:36.214 "data_out_pool_size": 2048 00:06:36.214 } 00:06:36.214 } 00:06:36.214 ] 00:06:36.214 } 00:06:36.214 ] 00:06:36.214 } 00:06:36.214 02:26:09 -- rpc/skip_rpc.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:06:36.214 02:26:09 -- rpc/skip_rpc.sh@40 -- # killprocess 1418625 00:06:36.214 02:26:09 -- common/autotest_common.sh@936 -- # '[' -z 1418625 ']' 00:06:36.214 02:26:09 -- common/autotest_common.sh@940 -- # kill -0 1418625 00:06:36.214 02:26:09 -- common/autotest_common.sh@941 -- # uname 00:06:36.214 02:26:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:36.214 02:26:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1418625 00:06:36.214 02:26:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:36.214 02:26:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:36.214 02:26:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1418625' 00:06:36.214 killing process with pid 1418625 00:06:36.214 02:26:09 -- common/autotest_common.sh@955 -- # kill 1418625 00:06:36.214 02:26:09 -- common/autotest_common.sh@960 -- # wait 1418625 00:06:36.475 02:26:10 -- rpc/skip_rpc.sh@47 -- # local spdk_pid=1418816 00:06:36.475 02:26:10 -- rpc/skip_rpc.sh@48 -- # sleep 5 00:06:36.475 02:26:10 -- rpc/skip_rpc.sh@46 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --json /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/config.json 00:06:41.745 02:26:15 -- rpc/skip_rpc.sh@50 -- # killprocess 1418816 00:06:41.745 02:26:15 -- common/autotest_common.sh@936 -- # '[' -z 1418816 ']' 00:06:41.745 02:26:15 -- common/autotest_common.sh@940 -- # kill -0 1418816 00:06:41.745 02:26:15 -- common/autotest_common.sh@941 -- # uname 00:06:41.746 02:26:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:41.746 02:26:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1418816 00:06:41.746 02:26:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:41.746 02:26:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:41.746 02:26:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1418816' 00:06:41.746 killing process with pid 1418816 00:06:41.746 02:26:15 -- common/autotest_common.sh@955 -- # kill 1418816 00:06:41.746 02:26:15 -- common/autotest_common.sh@960 -- # wait 1418816 00:06:42.004 02:26:15 -- rpc/skip_rpc.sh@51 -- # grep -q 'TCP Transport Init' /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/log.txt 00:06:42.004 02:26:15 -- rpc/skip_rpc.sh@52 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/log.txt 00:06:42.004 00:06:42.004 real 0m6.901s 00:06:42.004 user 0m6.630s 00:06:42.004 sys 0m0.695s 00:06:42.004 02:26:15 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:42.004 02:26:15 -- common/autotest_common.sh@10 -- # set +x 00:06:42.004 ************************************ 00:06:42.004 END TEST skip_rpc_with_json 00:06:42.004 ************************************ 00:06:42.004 02:26:15 -- rpc/skip_rpc.sh@75 -- # run_test skip_rpc_with_delay test_skip_rpc_with_delay 00:06:42.004 02:26:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:42.004 02:26:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:42.004 02:26:15 -- common/autotest_common.sh@10 -- # set +x 00:06:42.263 ************************************ 00:06:42.263 START TEST skip_rpc_with_delay 00:06:42.263 ************************************ 00:06:42.263 02:26:15 -- common/autotest_common.sh@1111 -- # test_skip_rpc_with_delay 00:06:42.263 02:26:15 -- rpc/skip_rpc.sh@57 -- # NOT /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:06:42.263 02:26:15 -- common/autotest_common.sh@638 -- # local es=0 00:06:42.263 02:26:15 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:06:42.263 02:26:15 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:06:42.263 02:26:15 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:42.263 02:26:15 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:06:42.263 02:26:15 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:42.263 02:26:15 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:06:42.263 02:26:15 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:42.263 02:26:15 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:06:42.263 02:26:15 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt ]] 00:06:42.263 02:26:15 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:06:42.263 [2024-04-27 02:26:15.741512] app.c: 751:spdk_app_start: *ERROR*: Cannot use '--wait-for-rpc' if no RPC server is going to be started. 00:06:42.263 [2024-04-27 02:26:15.741597] app.c: 630:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 0, errno: 2 00:06:42.263 02:26:15 -- common/autotest_common.sh@641 -- # es=1 00:06:42.263 02:26:15 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:06:42.263 02:26:15 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:06:42.263 02:26:15 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:06:42.263 00:06:42.263 real 0m0.070s 00:06:42.263 user 0m0.044s 00:06:42.263 sys 0m0.026s 00:06:42.263 02:26:15 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:42.263 02:26:15 -- common/autotest_common.sh@10 -- # set +x 00:06:42.263 ************************************ 00:06:42.263 END TEST skip_rpc_with_delay 00:06:42.263 ************************************ 00:06:42.263 02:26:15 -- rpc/skip_rpc.sh@77 -- # uname 00:06:42.263 02:26:15 -- rpc/skip_rpc.sh@77 -- # '[' Linux '!=' FreeBSD ']' 00:06:42.263 02:26:15 -- rpc/skip_rpc.sh@78 -- # run_test exit_on_failed_rpc_init test_exit_on_failed_rpc_init 00:06:42.263 02:26:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:42.263 02:26:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:42.263 02:26:15 -- common/autotest_common.sh@10 -- # set +x 00:06:42.522 ************************************ 00:06:42.522 START TEST exit_on_failed_rpc_init 00:06:42.522 ************************************ 00:06:42.522 02:26:15 -- common/autotest_common.sh@1111 -- # test_exit_on_failed_rpc_init 00:06:42.522 02:26:15 -- rpc/skip_rpc.sh@62 -- # local spdk_pid=1419745 00:06:42.522 02:26:15 -- rpc/skip_rpc.sh@63 -- # waitforlisten 1419745 00:06:42.522 02:26:15 -- rpc/skip_rpc.sh@61 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:42.522 02:26:15 -- common/autotest_common.sh@817 -- # '[' -z 1419745 ']' 00:06:42.522 02:26:15 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:42.522 02:26:15 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:42.522 02:26:15 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:42.522 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:42.522 02:26:15 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:42.522 02:26:15 -- common/autotest_common.sh@10 -- # set +x 00:06:42.522 [2024-04-27 02:26:15.998260] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:06:42.522 [2024-04-27 02:26:15.998308] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1419745 ] 00:06:42.522 EAL: No free 2048 kB hugepages reported on node 1 00:06:42.522 [2024-04-27 02:26:16.069901] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:42.781 [2024-04-27 02:26:16.159579] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:43.349 02:26:16 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:43.349 02:26:16 -- common/autotest_common.sh@850 -- # return 0 00:06:43.349 02:26:16 -- rpc/skip_rpc.sh@65 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:06:43.349 02:26:16 -- rpc/skip_rpc.sh@67 -- # NOT /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x2 00:06:43.349 02:26:16 -- common/autotest_common.sh@638 -- # local es=0 00:06:43.349 02:26:16 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x2 00:06:43.349 02:26:16 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:06:43.349 02:26:16 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:43.349 02:26:16 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:06:43.349 02:26:16 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:43.349 02:26:16 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:06:43.349 02:26:16 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:43.349 02:26:16 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:06:43.349 02:26:16 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt ]] 00:06:43.349 02:26:16 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x2 00:06:43.349 [2024-04-27 02:26:16.840588] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:06:43.349 [2024-04-27 02:26:16.840643] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1419799 ] 00:06:43.349 EAL: No free 2048 kB hugepages reported on node 1 00:06:43.349 [2024-04-27 02:26:16.911563] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:43.608 [2024-04-27 02:26:16.995746] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:43.608 [2024-04-27 02:26:16.995827] rpc.c: 180:_spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:06:43.608 [2024-04-27 02:26:16.995838] rpc.c: 166:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:06:43.608 [2024-04-27 02:26:16.995847] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:06:43.608 02:26:17 -- common/autotest_common.sh@641 -- # es=234 00:06:43.608 02:26:17 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:06:43.608 02:26:17 -- common/autotest_common.sh@650 -- # es=106 00:06:43.608 02:26:17 -- common/autotest_common.sh@651 -- # case "$es" in 00:06:43.608 02:26:17 -- common/autotest_common.sh@658 -- # es=1 00:06:43.608 02:26:17 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:06:43.608 02:26:17 -- rpc/skip_rpc.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:06:43.608 02:26:17 -- rpc/skip_rpc.sh@70 -- # killprocess 1419745 00:06:43.608 02:26:17 -- common/autotest_common.sh@936 -- # '[' -z 1419745 ']' 00:06:43.608 02:26:17 -- common/autotest_common.sh@940 -- # kill -0 1419745 00:06:43.608 02:26:17 -- common/autotest_common.sh@941 -- # uname 00:06:43.608 02:26:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:43.608 02:26:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1419745 00:06:43.608 02:26:17 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:43.608 02:26:17 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:43.608 02:26:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1419745' 00:06:43.608 killing process with pid 1419745 00:06:43.608 02:26:17 -- common/autotest_common.sh@955 -- # kill 1419745 00:06:43.608 02:26:17 -- common/autotest_common.sh@960 -- # wait 1419745 00:06:44.176 00:06:44.176 real 0m1.571s 00:06:44.176 user 0m1.784s 00:06:44.176 sys 0m0.459s 00:06:44.176 02:26:17 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:44.176 02:26:17 -- common/autotest_common.sh@10 -- # set +x 00:06:44.177 ************************************ 00:06:44.177 END TEST exit_on_failed_rpc_init 00:06:44.177 ************************************ 00:06:44.177 02:26:17 -- rpc/skip_rpc.sh@81 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/config.json 00:06:44.177 00:06:44.177 real 0m14.843s 00:06:44.177 user 0m13.902s 00:06:44.177 sys 0m2.005s 00:06:44.177 02:26:17 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:44.177 02:26:17 -- common/autotest_common.sh@10 -- # set +x 00:06:44.177 ************************************ 00:06:44.177 END TEST skip_rpc 00:06:44.177 ************************************ 00:06:44.177 02:26:17 -- spdk/autotest.sh@167 -- # run_test rpc_client /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:06:44.177 02:26:17 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:44.177 02:26:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:44.177 02:26:17 -- common/autotest_common.sh@10 -- # set +x 00:06:44.177 ************************************ 00:06:44.177 START TEST rpc_client 00:06:44.177 ************************************ 00:06:44.177 02:26:17 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:06:44.436 * Looking for test storage... 00:06:44.436 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_client 00:06:44.437 02:26:17 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:06:44.437 OK 00:06:44.437 02:26:17 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:06:44.437 00:06:44.437 real 0m0.141s 00:06:44.437 user 0m0.053s 00:06:44.437 sys 0m0.098s 00:06:44.437 02:26:17 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:44.437 02:26:17 -- common/autotest_common.sh@10 -- # set +x 00:06:44.437 ************************************ 00:06:44.437 END TEST rpc_client 00:06:44.437 ************************************ 00:06:44.437 02:26:17 -- spdk/autotest.sh@168 -- # run_test json_config /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_config.sh 00:06:44.437 02:26:17 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:44.437 02:26:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:44.437 02:26:17 -- common/autotest_common.sh@10 -- # set +x 00:06:44.696 ************************************ 00:06:44.696 START TEST json_config 00:06:44.696 ************************************ 00:06:44.696 02:26:18 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_config.sh 00:06:44.696 02:26:18 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:06:44.696 02:26:18 -- nvmf/common.sh@7 -- # uname -s 00:06:44.696 02:26:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:44.696 02:26:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:44.696 02:26:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:44.696 02:26:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:44.696 02:26:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:44.696 02:26:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:44.696 02:26:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:44.696 02:26:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:44.696 02:26:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:44.696 02:26:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:44.696 02:26:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:06:44.696 02:26:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:06:44.696 02:26:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:44.696 02:26:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:44.696 02:26:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:06:44.696 02:26:18 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:06:44.696 02:26:18 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:06:44.696 02:26:18 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:44.696 02:26:18 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:44.696 02:26:18 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:44.696 02:26:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:44.696 02:26:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:44.696 02:26:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:44.696 02:26:18 -- paths/export.sh@5 -- # export PATH 00:06:44.696 02:26:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:44.696 02:26:18 -- nvmf/common.sh@47 -- # : 0 00:06:44.696 02:26:18 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:06:44.696 02:26:18 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:06:44.696 02:26:18 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:06:44.696 02:26:18 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:44.696 02:26:18 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:44.696 02:26:18 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:06:44.696 02:26:18 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:06:44.696 02:26:18 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:06:44.696 02:26:18 -- json_config/json_config.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/common.sh 00:06:44.696 02:26:18 -- json_config/json_config.sh@11 -- # [[ 0 -eq 1 ]] 00:06:44.696 02:26:18 -- json_config/json_config.sh@15 -- # [[ 0 -ne 1 ]] 00:06:44.696 02:26:18 -- json_config/json_config.sh@15 -- # [[ 0 -eq 1 ]] 00:06:44.696 02:26:18 -- json_config/json_config.sh@26 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:06:44.696 02:26:18 -- json_config/json_config.sh@31 -- # app_pid=(['target']='' ['initiator']='') 00:06:44.696 02:26:18 -- json_config/json_config.sh@31 -- # declare -A app_pid 00:06:44.696 02:26:18 -- json_config/json_config.sh@32 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:06:44.696 02:26:18 -- json_config/json_config.sh@32 -- # declare -A app_socket 00:06:44.696 02:26:18 -- json_config/json_config.sh@33 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:06:44.696 02:26:18 -- json_config/json_config.sh@33 -- # declare -A app_params 00:06:44.697 02:26:18 -- json_config/json_config.sh@34 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_initiator_config.json') 00:06:44.697 02:26:18 -- json_config/json_config.sh@34 -- # declare -A configs_path 00:06:44.697 02:26:18 -- json_config/json_config.sh@40 -- # last_event_id=0 00:06:44.697 02:26:18 -- json_config/json_config.sh@355 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:06:44.697 02:26:18 -- json_config/json_config.sh@356 -- # echo 'INFO: JSON configuration test init' 00:06:44.697 INFO: JSON configuration test init 00:06:44.697 02:26:18 -- json_config/json_config.sh@357 -- # json_config_test_init 00:06:44.697 02:26:18 -- json_config/json_config.sh@262 -- # timing_enter json_config_test_init 00:06:44.697 02:26:18 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:44.697 02:26:18 -- common/autotest_common.sh@10 -- # set +x 00:06:44.697 02:26:18 -- json_config/json_config.sh@263 -- # timing_enter json_config_setup_target 00:06:44.697 02:26:18 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:44.697 02:26:18 -- common/autotest_common.sh@10 -- # set +x 00:06:44.697 02:26:18 -- json_config/json_config.sh@265 -- # json_config_test_start_app target --wait-for-rpc 00:06:44.697 02:26:18 -- json_config/common.sh@9 -- # local app=target 00:06:44.697 02:26:18 -- json_config/common.sh@10 -- # shift 00:06:44.697 02:26:18 -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:06:44.697 02:26:18 -- json_config/common.sh@13 -- # [[ -z '' ]] 00:06:44.697 02:26:18 -- json_config/common.sh@15 -- # local app_extra_params= 00:06:44.697 02:26:18 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:06:44.697 02:26:18 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:06:44.697 02:26:18 -- json_config/common.sh@22 -- # app_pid["$app"]=1420108 00:06:44.697 02:26:18 -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:06:44.697 Waiting for target to run... 00:06:44.697 02:26:18 -- json_config/common.sh@25 -- # waitforlisten 1420108 /var/tmp/spdk_tgt.sock 00:06:44.697 02:26:18 -- common/autotest_common.sh@817 -- # '[' -z 1420108 ']' 00:06:44.697 02:26:18 -- json_config/common.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:06:44.697 02:26:18 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:06:44.697 02:26:18 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:44.697 02:26:18 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:06:44.697 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:06:44.697 02:26:18 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:44.697 02:26:18 -- common/autotest_common.sh@10 -- # set +x 00:06:44.697 [2024-04-27 02:26:18.267736] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:06:44.697 [2024-04-27 02:26:18.267801] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1420108 ] 00:06:44.697 EAL: No free 2048 kB hugepages reported on node 1 00:06:44.956 [2024-04-27 02:26:18.569688] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:45.214 [2024-04-27 02:26:18.642973] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:45.473 02:26:19 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:45.473 02:26:19 -- common/autotest_common.sh@850 -- # return 0 00:06:45.473 02:26:19 -- json_config/common.sh@26 -- # echo '' 00:06:45.473 00:06:45.473 02:26:19 -- json_config/json_config.sh@269 -- # create_accel_config 00:06:45.473 02:26:19 -- json_config/json_config.sh@93 -- # timing_enter create_accel_config 00:06:45.473 02:26:19 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:45.473 02:26:19 -- common/autotest_common.sh@10 -- # set +x 00:06:45.473 02:26:19 -- json_config/json_config.sh@95 -- # [[ 0 -eq 1 ]] 00:06:45.473 02:26:19 -- json_config/json_config.sh@101 -- # timing_exit create_accel_config 00:06:45.473 02:26:19 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:45.473 02:26:19 -- common/autotest_common.sh@10 -- # set +x 00:06:45.732 02:26:19 -- json_config/json_config.sh@273 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:06:45.732 02:26:19 -- json_config/json_config.sh@274 -- # tgt_rpc load_config 00:06:45.732 02:26:19 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:06:49.020 02:26:22 -- json_config/json_config.sh@276 -- # tgt_check_notification_types 00:06:49.020 02:26:22 -- json_config/json_config.sh@43 -- # timing_enter tgt_check_notification_types 00:06:49.020 02:26:22 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:49.020 02:26:22 -- common/autotest_common.sh@10 -- # set +x 00:06:49.020 02:26:22 -- json_config/json_config.sh@45 -- # local ret=0 00:06:49.020 02:26:22 -- json_config/json_config.sh@46 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:06:49.020 02:26:22 -- json_config/json_config.sh@46 -- # local enabled_types 00:06:49.020 02:26:22 -- json_config/json_config.sh@48 -- # tgt_rpc notify_get_types 00:06:49.020 02:26:22 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:06:49.020 02:26:22 -- json_config/json_config.sh@48 -- # jq -r '.[]' 00:06:49.020 02:26:22 -- json_config/json_config.sh@48 -- # get_types=('bdev_register' 'bdev_unregister') 00:06:49.020 02:26:22 -- json_config/json_config.sh@48 -- # local get_types 00:06:49.020 02:26:22 -- json_config/json_config.sh@49 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:06:49.020 02:26:22 -- json_config/json_config.sh@54 -- # timing_exit tgt_check_notification_types 00:06:49.020 02:26:22 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:49.020 02:26:22 -- common/autotest_common.sh@10 -- # set +x 00:06:49.020 02:26:22 -- json_config/json_config.sh@55 -- # return 0 00:06:49.020 02:26:22 -- json_config/json_config.sh@278 -- # [[ 0 -eq 1 ]] 00:06:49.020 02:26:22 -- json_config/json_config.sh@282 -- # [[ 0 -eq 1 ]] 00:06:49.020 02:26:22 -- json_config/json_config.sh@286 -- # [[ 0 -eq 1 ]] 00:06:49.020 02:26:22 -- json_config/json_config.sh@290 -- # [[ 1 -eq 1 ]] 00:06:49.020 02:26:22 -- json_config/json_config.sh@291 -- # create_nvmf_subsystem_config 00:06:49.020 02:26:22 -- json_config/json_config.sh@230 -- # timing_enter create_nvmf_subsystem_config 00:06:49.020 02:26:22 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:49.020 02:26:22 -- common/autotest_common.sh@10 -- # set +x 00:06:49.020 02:26:22 -- json_config/json_config.sh@232 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:06:49.020 02:26:22 -- json_config/json_config.sh@233 -- # [[ rdma == \r\d\m\a ]] 00:06:49.020 02:26:22 -- json_config/json_config.sh@234 -- # TEST_TRANSPORT=rdma 00:06:49.020 02:26:22 -- json_config/json_config.sh@234 -- # nvmftestinit 00:06:49.020 02:26:22 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:06:49.020 02:26:22 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:49.020 02:26:22 -- nvmf/common.sh@437 -- # prepare_net_devs 00:06:49.020 02:26:22 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:06:49.020 02:26:22 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:06:49.020 02:26:22 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:49.020 02:26:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:06:49.020 02:26:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:49.020 02:26:22 -- nvmf/common.sh@403 -- # [[ phy-fallback != virt ]] 00:06:49.020 02:26:22 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:06:49.020 02:26:22 -- nvmf/common.sh@285 -- # xtrace_disable 00:06:49.020 02:26:22 -- common/autotest_common.sh@10 -- # set +x 00:06:55.589 02:26:28 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:55.589 02:26:28 -- nvmf/common.sh@291 -- # pci_devs=() 00:06:55.589 02:26:28 -- nvmf/common.sh@291 -- # local -a pci_devs 00:06:55.589 02:26:28 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:06:55.589 02:26:28 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:06:55.589 02:26:28 -- nvmf/common.sh@293 -- # pci_drivers=() 00:06:55.589 02:26:28 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:06:55.589 02:26:28 -- nvmf/common.sh@295 -- # net_devs=() 00:06:55.589 02:26:28 -- nvmf/common.sh@295 -- # local -ga net_devs 00:06:55.589 02:26:28 -- nvmf/common.sh@296 -- # e810=() 00:06:55.589 02:26:28 -- nvmf/common.sh@296 -- # local -ga e810 00:06:55.589 02:26:28 -- nvmf/common.sh@297 -- # x722=() 00:06:55.589 02:26:28 -- nvmf/common.sh@297 -- # local -ga x722 00:06:55.589 02:26:28 -- nvmf/common.sh@298 -- # mlx=() 00:06:55.589 02:26:28 -- nvmf/common.sh@298 -- # local -ga mlx 00:06:55.589 02:26:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:55.589 02:26:28 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:55.589 02:26:28 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:55.589 02:26:28 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:55.589 02:26:28 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:55.589 02:26:28 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:55.589 02:26:28 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:55.589 02:26:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:55.589 02:26:28 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:55.589 02:26:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:55.589 02:26:28 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:55.589 02:26:28 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:06:55.589 02:26:28 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:06:55.589 02:26:28 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:06:55.589 02:26:28 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:06:55.589 02:26:28 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:06:55.589 02:26:28 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:06:55.589 02:26:28 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:06:55.589 02:26:28 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:06:55.589 02:26:28 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:06:55.589 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:06:55.589 02:26:28 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:06:55.589 02:26:28 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:06:55.589 02:26:28 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:06:55.589 02:26:28 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:06:55.589 02:26:28 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:06:55.589 02:26:28 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:06:55.589 02:26:28 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:06:55.589 02:26:28 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:06:55.589 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:06:55.589 02:26:28 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:06:55.589 02:26:28 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:06:55.589 02:26:28 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:06:55.589 02:26:28 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:06:55.589 02:26:28 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:06:55.589 02:26:28 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:06:55.589 02:26:28 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:06:55.589 02:26:28 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:06:55.589 02:26:28 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:06:55.589 02:26:28 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:55.590 02:26:28 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:06:55.590 02:26:28 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:55.590 02:26:28 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:06:55.590 Found net devices under 0000:18:00.0: mlx_0_0 00:06:55.590 02:26:28 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:06:55.590 02:26:28 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:06:55.590 02:26:28 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:55.590 02:26:28 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:06:55.590 02:26:28 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:55.590 02:26:28 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:06:55.590 Found net devices under 0000:18:00.1: mlx_0_1 00:06:55.590 02:26:28 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:06:55.590 02:26:28 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:06:55.590 02:26:28 -- nvmf/common.sh@403 -- # is_hw=yes 00:06:55.590 02:26:28 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:06:55.590 02:26:28 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:06:55.590 02:26:28 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:06:55.590 02:26:28 -- nvmf/common.sh@409 -- # rdma_device_init 00:06:55.590 02:26:28 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:06:55.590 02:26:28 -- nvmf/common.sh@58 -- # uname 00:06:55.590 02:26:28 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:06:55.590 02:26:28 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:06:55.590 02:26:28 -- nvmf/common.sh@63 -- # modprobe ib_core 00:06:55.590 02:26:28 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:06:55.590 02:26:28 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:06:55.590 02:26:28 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:06:55.590 02:26:28 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:06:55.590 02:26:28 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:06:55.590 02:26:28 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:06:55.590 02:26:28 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:06:55.590 02:26:28 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:06:55.590 02:26:28 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:06:55.590 02:26:28 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:06:55.590 02:26:28 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:06:55.590 02:26:28 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:06:55.590 02:26:28 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:06:55.590 02:26:28 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:06:55.590 02:26:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:55.590 02:26:28 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:06:55.590 02:26:28 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:06:55.590 02:26:28 -- nvmf/common.sh@105 -- # continue 2 00:06:55.590 02:26:28 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:06:55.590 02:26:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:55.590 02:26:28 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:06:55.590 02:26:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:55.590 02:26:28 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:06:55.590 02:26:28 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:06:55.590 02:26:28 -- nvmf/common.sh@105 -- # continue 2 00:06:55.590 02:26:28 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:06:55.590 02:26:28 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:06:55.590 02:26:28 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:06:55.590 02:26:28 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:06:55.590 02:26:28 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:06:55.590 02:26:28 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:06:55.590 02:26:28 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:06:55.590 02:26:28 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:06:55.590 02:26:28 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:06:55.590 60: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:06:55.590 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:06:55.590 altname enp24s0f0np0 00:06:55.590 altname ens785f0np0 00:06:55.590 inet 192.168.100.8/24 scope global mlx_0_0 00:06:55.590 valid_lft forever preferred_lft forever 00:06:55.590 02:26:28 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:06:55.590 02:26:28 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:06:55.590 02:26:28 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:06:55.590 02:26:28 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:06:55.590 02:26:28 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:06:55.590 02:26:28 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:06:55.590 02:26:28 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:06:55.590 02:26:28 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:06:55.590 02:26:28 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:06:55.590 61: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:06:55.590 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:06:55.590 altname enp24s0f1np1 00:06:55.590 altname ens785f1np1 00:06:55.590 inet 192.168.100.9/24 scope global mlx_0_1 00:06:55.590 valid_lft forever preferred_lft forever 00:06:55.590 02:26:28 -- nvmf/common.sh@411 -- # return 0 00:06:55.590 02:26:28 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:06:55.590 02:26:28 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:06:55.590 02:26:28 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:06:55.590 02:26:28 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:06:55.590 02:26:28 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:06:55.590 02:26:28 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:06:55.590 02:26:28 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:06:55.590 02:26:28 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:06:55.590 02:26:28 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:06:55.590 02:26:28 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:06:55.590 02:26:28 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:06:55.590 02:26:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:55.590 02:26:28 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:06:55.590 02:26:28 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:06:55.590 02:26:28 -- nvmf/common.sh@105 -- # continue 2 00:06:55.590 02:26:28 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:06:55.590 02:26:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:55.590 02:26:28 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:06:55.590 02:26:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:55.590 02:26:28 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:06:55.590 02:26:28 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:06:55.590 02:26:28 -- nvmf/common.sh@105 -- # continue 2 00:06:55.590 02:26:28 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:06:55.590 02:26:28 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:06:55.590 02:26:28 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:06:55.590 02:26:28 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:06:55.590 02:26:28 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:06:55.590 02:26:28 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:06:55.590 02:26:28 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:06:55.590 02:26:28 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:06:55.590 02:26:28 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:06:55.590 02:26:28 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:06:55.590 02:26:28 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:06:55.590 02:26:28 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:06:55.590 02:26:29 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:06:55.590 192.168.100.9' 00:06:55.590 02:26:29 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:06:55.590 192.168.100.9' 00:06:55.590 02:26:29 -- nvmf/common.sh@446 -- # head -n 1 00:06:55.590 02:26:29 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:06:55.590 02:26:29 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:06:55.590 192.168.100.9' 00:06:55.590 02:26:29 -- nvmf/common.sh@447 -- # tail -n +2 00:06:55.590 02:26:29 -- nvmf/common.sh@447 -- # head -n 1 00:06:55.590 02:26:29 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:06:55.590 02:26:29 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:06:55.590 02:26:29 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:06:55.590 02:26:29 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:06:55.590 02:26:29 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:06:55.590 02:26:29 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:06:55.590 02:26:29 -- json_config/json_config.sh@237 -- # [[ -z 192.168.100.8 ]] 00:06:55.590 02:26:29 -- json_config/json_config.sh@242 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:06:55.590 02:26:29 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:06:55.850 MallocForNvmf0 00:06:55.850 02:26:29 -- json_config/json_config.sh@243 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:06:55.850 02:26:29 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:06:55.850 MallocForNvmf1 00:06:55.850 02:26:29 -- json_config/json_config.sh@245 -- # tgt_rpc nvmf_create_transport -t rdma -u 8192 -c 0 00:06:55.850 02:26:29 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t rdma -u 8192 -c 0 00:06:56.109 [2024-04-27 02:26:29.578572] rdma.c:2712:nvmf_rdma_create: *WARNING*: In capsule data size is set to 256, this is minimum size required to support msdbd=16 00:06:56.109 [2024-04-27 02:26:29.605358] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x9fe4a0/0xb2b380) succeed. 00:06:56.109 [2024-04-27 02:26:29.616885] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xa00690/0xa0b240) succeed. 00:06:56.109 02:26:29 -- json_config/json_config.sh@246 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:56.109 02:26:29 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:56.368 02:26:29 -- json_config/json_config.sh@247 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:06:56.368 02:26:29 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:06:56.628 02:26:30 -- json_config/json_config.sh@248 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:06:56.628 02:26:30 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:06:56.628 02:26:30 -- json_config/json_config.sh@249 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:06:56.628 02:26:30 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:06:56.887 [2024-04-27 02:26:30.341588] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:06:56.887 02:26:30 -- json_config/json_config.sh@251 -- # timing_exit create_nvmf_subsystem_config 00:06:56.887 02:26:30 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:56.887 02:26:30 -- common/autotest_common.sh@10 -- # set +x 00:06:56.887 02:26:30 -- json_config/json_config.sh@293 -- # timing_exit json_config_setup_target 00:06:56.887 02:26:30 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:56.887 02:26:30 -- common/autotest_common.sh@10 -- # set +x 00:06:56.887 02:26:30 -- json_config/json_config.sh@295 -- # [[ 0 -eq 1 ]] 00:06:56.887 02:26:30 -- json_config/json_config.sh@300 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:06:56.887 02:26:30 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:06:57.145 MallocBdevForConfigChangeCheck 00:06:57.145 02:26:30 -- json_config/json_config.sh@302 -- # timing_exit json_config_test_init 00:06:57.145 02:26:30 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:57.145 02:26:30 -- common/autotest_common.sh@10 -- # set +x 00:06:57.145 02:26:30 -- json_config/json_config.sh@359 -- # tgt_rpc save_config 00:06:57.145 02:26:30 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:06:57.404 02:26:30 -- json_config/json_config.sh@361 -- # echo 'INFO: shutting down applications...' 00:06:57.404 INFO: shutting down applications... 00:06:57.404 02:26:30 -- json_config/json_config.sh@362 -- # [[ 0 -eq 1 ]] 00:06:57.404 02:26:30 -- json_config/json_config.sh@368 -- # json_config_clear target 00:06:57.404 02:26:30 -- json_config/json_config.sh@332 -- # [[ -n 22 ]] 00:06:57.404 02:26:30 -- json_config/json_config.sh@333 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:07:01.597 Calling clear_iscsi_subsystem 00:07:01.597 Calling clear_nvmf_subsystem 00:07:01.597 Calling clear_nbd_subsystem 00:07:01.597 Calling clear_ublk_subsystem 00:07:01.597 Calling clear_vhost_blk_subsystem 00:07:01.597 Calling clear_vhost_scsi_subsystem 00:07:01.597 Calling clear_bdev_subsystem 00:07:01.597 02:26:34 -- json_config/json_config.sh@337 -- # local config_filter=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py 00:07:01.597 02:26:34 -- json_config/json_config.sh@343 -- # count=100 00:07:01.597 02:26:34 -- json_config/json_config.sh@344 -- # '[' 100 -gt 0 ']' 00:07:01.597 02:26:34 -- json_config/json_config.sh@345 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:07:01.597 02:26:34 -- json_config/json_config.sh@345 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:07:01.597 02:26:34 -- json_config/json_config.sh@345 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:07:01.858 02:26:35 -- json_config/json_config.sh@345 -- # break 00:07:01.858 02:26:35 -- json_config/json_config.sh@350 -- # '[' 100 -eq 0 ']' 00:07:01.858 02:26:35 -- json_config/json_config.sh@369 -- # json_config_test_shutdown_app target 00:07:01.858 02:26:35 -- json_config/common.sh@31 -- # local app=target 00:07:01.858 02:26:35 -- json_config/common.sh@34 -- # [[ -n 22 ]] 00:07:01.858 02:26:35 -- json_config/common.sh@35 -- # [[ -n 1420108 ]] 00:07:01.858 02:26:35 -- json_config/common.sh@38 -- # kill -SIGINT 1420108 00:07:01.858 02:26:35 -- json_config/common.sh@40 -- # (( i = 0 )) 00:07:01.858 02:26:35 -- json_config/common.sh@40 -- # (( i < 30 )) 00:07:01.858 02:26:35 -- json_config/common.sh@41 -- # kill -0 1420108 00:07:01.858 02:26:35 -- json_config/common.sh@45 -- # sleep 0.5 00:07:01.858 [2024-04-27 02:26:35.339058] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:07:02.178 02:26:35 -- json_config/common.sh@40 -- # (( i++ )) 00:07:02.178 02:26:35 -- json_config/common.sh@40 -- # (( i < 30 )) 00:07:02.178 02:26:35 -- json_config/common.sh@41 -- # kill -0 1420108 00:07:02.178 02:26:35 -- json_config/common.sh@42 -- # app_pid["$app"]= 00:07:02.178 02:26:35 -- json_config/common.sh@43 -- # break 00:07:02.178 02:26:35 -- json_config/common.sh@48 -- # [[ -n '' ]] 00:07:02.178 02:26:35 -- json_config/common.sh@53 -- # echo 'SPDK target shutdown done' 00:07:02.178 SPDK target shutdown done 00:07:02.178 02:26:35 -- json_config/json_config.sh@371 -- # echo 'INFO: relaunching applications...' 00:07:02.178 INFO: relaunching applications... 00:07:02.178 02:26:35 -- json_config/json_config.sh@372 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:07:02.178 02:26:35 -- json_config/common.sh@9 -- # local app=target 00:07:02.178 02:26:35 -- json_config/common.sh@10 -- # shift 00:07:02.178 02:26:35 -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:07:02.178 02:26:35 -- json_config/common.sh@13 -- # [[ -z '' ]] 00:07:02.178 02:26:35 -- json_config/common.sh@15 -- # local app_extra_params= 00:07:02.178 02:26:35 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:07:02.178 02:26:35 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:07:02.178 02:26:35 -- json_config/common.sh@22 -- # app_pid["$app"]=1424524 00:07:02.178 02:26:35 -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:07:02.178 Waiting for target to run... 00:07:02.178 02:26:35 -- json_config/common.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:07:02.178 02:26:35 -- json_config/common.sh@25 -- # waitforlisten 1424524 /var/tmp/spdk_tgt.sock 00:07:02.178 02:26:35 -- common/autotest_common.sh@817 -- # '[' -z 1424524 ']' 00:07:02.178 02:26:35 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:07:02.178 02:26:35 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:02.178 02:26:35 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:07:02.178 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:07:02.178 02:26:35 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:02.178 02:26:35 -- common/autotest_common.sh@10 -- # set +x 00:07:02.178 [2024-04-27 02:26:35.789177] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:07:02.178 [2024-04-27 02:26:35.789244] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1424524 ] 00:07:02.437 EAL: No free 2048 kB hugepages reported on node 1 00:07:03.006 [2024-04-27 02:26:36.340822] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:03.006 [2024-04-27 02:26:36.422049] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:06.295 [2024-04-27 02:26:39.452233] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x115d490/0x10e36c0) succeed. 00:07:06.295 [2024-04-27 02:26:39.463122] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x115c480/0xfc3580) succeed. 00:07:06.295 [2024-04-27 02:26:39.516909] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:07:06.554 02:26:39 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:06.554 02:26:39 -- common/autotest_common.sh@850 -- # return 0 00:07:06.554 02:26:39 -- json_config/common.sh@26 -- # echo '' 00:07:06.554 00:07:06.554 02:26:39 -- json_config/json_config.sh@373 -- # [[ 0 -eq 1 ]] 00:07:06.554 02:26:39 -- json_config/json_config.sh@377 -- # echo 'INFO: Checking if target configuration is the same...' 00:07:06.554 INFO: Checking if target configuration is the same... 00:07:06.554 02:26:39 -- json_config/json_config.sh@378 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:07:06.554 02:26:39 -- json_config/json_config.sh@378 -- # tgt_rpc save_config 00:07:06.554 02:26:39 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:07:06.554 + '[' 2 -ne 2 ']' 00:07:06.554 +++ dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_diff.sh 00:07:06.554 ++ readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/../.. 00:07:06.554 + rootdir=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:07:06.554 +++ basename /dev/fd/62 00:07:06.554 ++ mktemp /tmp/62.XXX 00:07:06.554 + tmp_file_1=/tmp/62.NRf 00:07:06.554 +++ basename /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:07:06.554 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:07:06.554 + tmp_file_2=/tmp/spdk_tgt_config.json.0Zo 00:07:06.555 + ret=0 00:07:06.555 + /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:07:06.814 + /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:07:06.814 + diff -u /tmp/62.NRf /tmp/spdk_tgt_config.json.0Zo 00:07:06.814 + echo 'INFO: JSON config files are the same' 00:07:06.814 INFO: JSON config files are the same 00:07:06.814 + rm /tmp/62.NRf /tmp/spdk_tgt_config.json.0Zo 00:07:06.814 + exit 0 00:07:06.814 02:26:40 -- json_config/json_config.sh@379 -- # [[ 0 -eq 1 ]] 00:07:06.814 02:26:40 -- json_config/json_config.sh@384 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:07:06.814 INFO: changing configuration and checking if this can be detected... 00:07:06.814 02:26:40 -- json_config/json_config.sh@386 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:07:06.814 02:26:40 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:07:07.074 02:26:40 -- json_config/json_config.sh@387 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:07:07.074 02:26:40 -- json_config/json_config.sh@387 -- # tgt_rpc save_config 00:07:07.074 02:26:40 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:07:07.074 + '[' 2 -ne 2 ']' 00:07:07.074 +++ dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_diff.sh 00:07:07.074 ++ readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/../.. 00:07:07.074 + rootdir=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:07:07.074 +++ basename /dev/fd/62 00:07:07.074 ++ mktemp /tmp/62.XXX 00:07:07.074 + tmp_file_1=/tmp/62.GYR 00:07:07.074 +++ basename /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:07:07.074 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:07:07.074 + tmp_file_2=/tmp/spdk_tgt_config.json.RHl 00:07:07.074 + ret=0 00:07:07.074 + /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:07:07.333 + /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:07:07.333 + diff -u /tmp/62.GYR /tmp/spdk_tgt_config.json.RHl 00:07:07.333 + ret=1 00:07:07.333 + echo '=== Start of file: /tmp/62.GYR ===' 00:07:07.333 + cat /tmp/62.GYR 00:07:07.333 + echo '=== End of file: /tmp/62.GYR ===' 00:07:07.333 + echo '' 00:07:07.333 + echo '=== Start of file: /tmp/spdk_tgt_config.json.RHl ===' 00:07:07.333 + cat /tmp/spdk_tgt_config.json.RHl 00:07:07.333 + echo '=== End of file: /tmp/spdk_tgt_config.json.RHl ===' 00:07:07.333 + echo '' 00:07:07.333 + rm /tmp/62.GYR /tmp/spdk_tgt_config.json.RHl 00:07:07.333 + exit 1 00:07:07.333 02:26:40 -- json_config/json_config.sh@391 -- # echo 'INFO: configuration change detected.' 00:07:07.333 INFO: configuration change detected. 00:07:07.333 02:26:40 -- json_config/json_config.sh@394 -- # json_config_test_fini 00:07:07.333 02:26:40 -- json_config/json_config.sh@306 -- # timing_enter json_config_test_fini 00:07:07.333 02:26:40 -- common/autotest_common.sh@710 -- # xtrace_disable 00:07:07.333 02:26:40 -- common/autotest_common.sh@10 -- # set +x 00:07:07.333 02:26:40 -- json_config/json_config.sh@307 -- # local ret=0 00:07:07.333 02:26:40 -- json_config/json_config.sh@309 -- # [[ -n '' ]] 00:07:07.333 02:26:40 -- json_config/json_config.sh@317 -- # [[ -n 1424524 ]] 00:07:07.333 02:26:40 -- json_config/json_config.sh@320 -- # cleanup_bdev_subsystem_config 00:07:07.333 02:26:40 -- json_config/json_config.sh@184 -- # timing_enter cleanup_bdev_subsystem_config 00:07:07.333 02:26:40 -- common/autotest_common.sh@710 -- # xtrace_disable 00:07:07.333 02:26:40 -- common/autotest_common.sh@10 -- # set +x 00:07:07.333 02:26:40 -- json_config/json_config.sh@186 -- # [[ 0 -eq 1 ]] 00:07:07.333 02:26:40 -- json_config/json_config.sh@193 -- # uname -s 00:07:07.333 02:26:40 -- json_config/json_config.sh@193 -- # [[ Linux = Linux ]] 00:07:07.333 02:26:40 -- json_config/json_config.sh@194 -- # rm -f /sample_aio 00:07:07.333 02:26:40 -- json_config/json_config.sh@197 -- # [[ 0 -eq 1 ]] 00:07:07.333 02:26:40 -- json_config/json_config.sh@201 -- # timing_exit cleanup_bdev_subsystem_config 00:07:07.333 02:26:40 -- common/autotest_common.sh@716 -- # xtrace_disable 00:07:07.333 02:26:40 -- common/autotest_common.sh@10 -- # set +x 00:07:07.333 02:26:40 -- json_config/json_config.sh@323 -- # killprocess 1424524 00:07:07.333 02:26:40 -- common/autotest_common.sh@936 -- # '[' -z 1424524 ']' 00:07:07.333 02:26:40 -- common/autotest_common.sh@940 -- # kill -0 1424524 00:07:07.333 02:26:40 -- common/autotest_common.sh@941 -- # uname 00:07:07.333 02:26:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:07.593 02:26:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1424524 00:07:07.593 02:26:40 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:07.593 02:26:40 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:07.593 02:26:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1424524' 00:07:07.593 killing process with pid 1424524 00:07:07.593 02:26:40 -- common/autotest_common.sh@955 -- # kill 1424524 00:07:07.593 02:26:40 -- common/autotest_common.sh@960 -- # wait 1424524 00:07:07.593 [2024-04-27 02:26:41.111731] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:07:11.793 02:26:44 -- json_config/json_config.sh@326 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:07:11.793 02:26:44 -- json_config/json_config.sh@327 -- # timing_exit json_config_test_fini 00:07:11.793 02:26:44 -- common/autotest_common.sh@716 -- # xtrace_disable 00:07:11.793 02:26:44 -- common/autotest_common.sh@10 -- # set +x 00:07:11.793 02:26:44 -- json_config/json_config.sh@328 -- # return 0 00:07:11.793 02:26:44 -- json_config/json_config.sh@396 -- # echo 'INFO: Success' 00:07:11.793 INFO: Success 00:07:11.793 02:26:44 -- json_config/json_config.sh@1 -- # nvmftestfini 00:07:11.793 02:26:44 -- nvmf/common.sh@477 -- # nvmfcleanup 00:07:11.793 02:26:44 -- nvmf/common.sh@117 -- # sync 00:07:11.793 02:26:44 -- nvmf/common.sh@119 -- # '[' '' == tcp ']' 00:07:11.793 02:26:44 -- nvmf/common.sh@119 -- # '[' '' == rdma ']' 00:07:11.793 02:26:44 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:07:11.793 02:26:44 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:07:11.793 02:26:44 -- nvmf/common.sh@484 -- # [[ '' == \t\c\p ]] 00:07:11.793 00:07:11.793 real 0m26.883s 00:07:11.793 user 0m29.226s 00:07:11.793 sys 0m7.417s 00:07:11.793 02:26:44 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:11.793 02:26:44 -- common/autotest_common.sh@10 -- # set +x 00:07:11.793 ************************************ 00:07:11.793 END TEST json_config 00:07:11.793 ************************************ 00:07:11.793 02:26:45 -- spdk/autotest.sh@169 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:07:11.793 02:26:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:11.793 02:26:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:11.793 02:26:45 -- common/autotest_common.sh@10 -- # set +x 00:07:11.793 ************************************ 00:07:11.793 START TEST json_config_extra_key 00:07:11.793 ************************************ 00:07:11.793 02:26:45 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:07:11.793 02:26:45 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:07:11.793 02:26:45 -- nvmf/common.sh@7 -- # uname -s 00:07:11.793 02:26:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:11.793 02:26:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:11.793 02:26:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:11.793 02:26:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:11.793 02:26:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:11.793 02:26:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:11.793 02:26:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:11.793 02:26:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:11.793 02:26:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:11.793 02:26:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:11.793 02:26:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:07:11.793 02:26:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:07:11.793 02:26:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:11.793 02:26:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:11.793 02:26:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:07:11.793 02:26:45 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:07:11.793 02:26:45 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:07:11.793 02:26:45 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:11.793 02:26:45 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:11.793 02:26:45 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:11.793 02:26:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:11.793 02:26:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:11.793 02:26:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:11.793 02:26:45 -- paths/export.sh@5 -- # export PATH 00:07:11.793 02:26:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:11.793 02:26:45 -- nvmf/common.sh@47 -- # : 0 00:07:11.793 02:26:45 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:07:11.793 02:26:45 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:07:11.793 02:26:45 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:07:11.793 02:26:45 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:11.793 02:26:45 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:11.793 02:26:45 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:07:11.793 02:26:45 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:07:11.793 02:26:45 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:07:11.793 02:26:45 -- json_config/json_config_extra_key.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/common.sh 00:07:11.793 02:26:45 -- json_config/json_config_extra_key.sh@17 -- # app_pid=(['target']='') 00:07:11.793 02:26:45 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_pid 00:07:11.793 02:26:45 -- json_config/json_config_extra_key.sh@18 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:07:11.794 02:26:45 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_socket 00:07:11.794 02:26:45 -- json_config/json_config_extra_key.sh@19 -- # app_params=(['target']='-m 0x1 -s 1024') 00:07:11.794 02:26:45 -- json_config/json_config_extra_key.sh@19 -- # declare -A app_params 00:07:11.794 02:26:45 -- json_config/json_config_extra_key.sh@20 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/extra_key.json') 00:07:11.794 02:26:45 -- json_config/json_config_extra_key.sh@20 -- # declare -A configs_path 00:07:11.794 02:26:45 -- json_config/json_config_extra_key.sh@22 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:07:11.794 02:26:45 -- json_config/json_config_extra_key.sh@24 -- # echo 'INFO: launching applications...' 00:07:11.794 INFO: launching applications... 00:07:11.794 02:26:45 -- json_config/json_config_extra_key.sh@25 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/extra_key.json 00:07:11.794 02:26:45 -- json_config/common.sh@9 -- # local app=target 00:07:11.794 02:26:45 -- json_config/common.sh@10 -- # shift 00:07:11.794 02:26:45 -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:07:11.794 02:26:45 -- json_config/common.sh@13 -- # [[ -z '' ]] 00:07:11.794 02:26:45 -- json_config/common.sh@15 -- # local app_extra_params= 00:07:11.794 02:26:45 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:07:11.794 02:26:45 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:07:11.794 02:26:45 -- json_config/common.sh@22 -- # app_pid["$app"]=1425929 00:07:11.794 02:26:45 -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:07:11.794 Waiting for target to run... 00:07:11.794 02:26:45 -- json_config/common.sh@25 -- # waitforlisten 1425929 /var/tmp/spdk_tgt.sock 00:07:11.794 02:26:45 -- common/autotest_common.sh@817 -- # '[' -z 1425929 ']' 00:07:11.794 02:26:45 -- json_config/common.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/extra_key.json 00:07:11.794 02:26:45 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:07:11.794 02:26:45 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:11.794 02:26:45 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:07:11.794 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:07:11.794 02:26:45 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:11.794 02:26:45 -- common/autotest_common.sh@10 -- # set +x 00:07:11.794 [2024-04-27 02:26:45.368739] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:07:11.794 [2024-04-27 02:26:45.368806] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1425929 ] 00:07:11.794 EAL: No free 2048 kB hugepages reported on node 1 00:07:12.363 [2024-04-27 02:26:45.900590] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:12.622 [2024-04-27 02:26:45.991060] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:12.622 02:26:46 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:12.622 02:26:46 -- common/autotest_common.sh@850 -- # return 0 00:07:12.622 02:26:46 -- json_config/common.sh@26 -- # echo '' 00:07:12.622 00:07:12.622 02:26:46 -- json_config/json_config_extra_key.sh@27 -- # echo 'INFO: shutting down applications...' 00:07:12.622 INFO: shutting down applications... 00:07:12.622 02:26:46 -- json_config/json_config_extra_key.sh@28 -- # json_config_test_shutdown_app target 00:07:12.622 02:26:46 -- json_config/common.sh@31 -- # local app=target 00:07:12.622 02:26:46 -- json_config/common.sh@34 -- # [[ -n 22 ]] 00:07:12.622 02:26:46 -- json_config/common.sh@35 -- # [[ -n 1425929 ]] 00:07:12.622 02:26:46 -- json_config/common.sh@38 -- # kill -SIGINT 1425929 00:07:12.622 02:26:46 -- json_config/common.sh@40 -- # (( i = 0 )) 00:07:12.622 02:26:46 -- json_config/common.sh@40 -- # (( i < 30 )) 00:07:12.622 02:26:46 -- json_config/common.sh@41 -- # kill -0 1425929 00:07:12.622 02:26:46 -- json_config/common.sh@45 -- # sleep 0.5 00:07:13.191 02:26:46 -- json_config/common.sh@40 -- # (( i++ )) 00:07:13.191 02:26:46 -- json_config/common.sh@40 -- # (( i < 30 )) 00:07:13.191 02:26:46 -- json_config/common.sh@41 -- # kill -0 1425929 00:07:13.191 02:26:46 -- json_config/common.sh@42 -- # app_pid["$app"]= 00:07:13.191 02:26:46 -- json_config/common.sh@43 -- # break 00:07:13.191 02:26:46 -- json_config/common.sh@48 -- # [[ -n '' ]] 00:07:13.191 02:26:46 -- json_config/common.sh@53 -- # echo 'SPDK target shutdown done' 00:07:13.191 SPDK target shutdown done 00:07:13.191 02:26:46 -- json_config/json_config_extra_key.sh@30 -- # echo Success 00:07:13.191 Success 00:07:13.191 00:07:13.191 real 0m1.460s 00:07:13.191 user 0m1.024s 00:07:13.191 sys 0m0.645s 00:07:13.191 02:26:46 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:13.191 02:26:46 -- common/autotest_common.sh@10 -- # set +x 00:07:13.191 ************************************ 00:07:13.191 END TEST json_config_extra_key 00:07:13.191 ************************************ 00:07:13.191 02:26:46 -- spdk/autotest.sh@170 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:07:13.191 02:26:46 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:13.191 02:26:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:13.191 02:26:46 -- common/autotest_common.sh@10 -- # set +x 00:07:13.449 ************************************ 00:07:13.449 START TEST alias_rpc 00:07:13.449 ************************************ 00:07:13.449 02:26:46 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:07:13.449 * Looking for test storage... 00:07:13.449 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/alias_rpc 00:07:13.449 02:26:46 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:07:13.449 02:26:46 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=1426243 00:07:13.449 02:26:46 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 1426243 00:07:13.449 02:26:46 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:07:13.449 02:26:46 -- common/autotest_common.sh@817 -- # '[' -z 1426243 ']' 00:07:13.449 02:26:46 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:13.449 02:26:46 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:13.449 02:26:46 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:13.449 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:13.449 02:26:46 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:13.449 02:26:46 -- common/autotest_common.sh@10 -- # set +x 00:07:13.449 [2024-04-27 02:26:46.997565] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:07:13.449 [2024-04-27 02:26:46.997629] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1426243 ] 00:07:13.449 EAL: No free 2048 kB hugepages reported on node 1 00:07:13.449 [2024-04-27 02:26:47.070530] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:13.709 [2024-04-27 02:26:47.157057] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:14.276 02:26:47 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:14.276 02:26:47 -- common/autotest_common.sh@850 -- # return 0 00:07:14.276 02:26:47 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py load_config -i 00:07:14.534 02:26:48 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 1426243 00:07:14.534 02:26:48 -- common/autotest_common.sh@936 -- # '[' -z 1426243 ']' 00:07:14.534 02:26:48 -- common/autotest_common.sh@940 -- # kill -0 1426243 00:07:14.534 02:26:48 -- common/autotest_common.sh@941 -- # uname 00:07:14.534 02:26:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:14.534 02:26:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1426243 00:07:14.534 02:26:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:14.534 02:26:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:14.534 02:26:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1426243' 00:07:14.534 killing process with pid 1426243 00:07:14.534 02:26:48 -- common/autotest_common.sh@955 -- # kill 1426243 00:07:14.534 02:26:48 -- common/autotest_common.sh@960 -- # wait 1426243 00:07:15.103 00:07:15.103 real 0m1.577s 00:07:15.103 user 0m1.663s 00:07:15.103 sys 0m0.474s 00:07:15.103 02:26:48 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:15.103 02:26:48 -- common/autotest_common.sh@10 -- # set +x 00:07:15.103 ************************************ 00:07:15.103 END TEST alias_rpc 00:07:15.103 ************************************ 00:07:15.103 02:26:48 -- spdk/autotest.sh@172 -- # [[ 0 -eq 0 ]] 00:07:15.103 02:26:48 -- spdk/autotest.sh@173 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/tcp.sh 00:07:15.103 02:26:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:15.103 02:26:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:15.103 02:26:48 -- common/autotest_common.sh@10 -- # set +x 00:07:15.103 ************************************ 00:07:15.103 START TEST spdkcli_tcp 00:07:15.103 ************************************ 00:07:15.103 02:26:48 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/tcp.sh 00:07:15.103 * Looking for test storage... 00:07:15.103 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli 00:07:15.103 02:26:48 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/common.sh 00:07:15.103 02:26:48 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:07:15.103 02:26:48 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/clear_config.py 00:07:15.103 02:26:48 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:07:15.103 02:26:48 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:07:15.103 02:26:48 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:07:15.103 02:26:48 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:07:15.103 02:26:48 -- common/autotest_common.sh@710 -- # xtrace_disable 00:07:15.103 02:26:48 -- common/autotest_common.sh@10 -- # set +x 00:07:15.103 02:26:48 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=1426584 00:07:15.103 02:26:48 -- spdkcli/tcp.sh@27 -- # waitforlisten 1426584 00:07:15.103 02:26:48 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:07:15.103 02:26:48 -- common/autotest_common.sh@817 -- # '[' -z 1426584 ']' 00:07:15.103 02:26:48 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:15.103 02:26:48 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:15.363 02:26:48 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:15.363 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:15.363 02:26:48 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:15.363 02:26:48 -- common/autotest_common.sh@10 -- # set +x 00:07:15.363 [2024-04-27 02:26:48.775757] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:07:15.363 [2024-04-27 02:26:48.775818] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1426584 ] 00:07:15.363 EAL: No free 2048 kB hugepages reported on node 1 00:07:15.363 [2024-04-27 02:26:48.847587] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:07:15.363 [2024-04-27 02:26:48.925715] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:15.363 [2024-04-27 02:26:48.925718] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:16.300 02:26:49 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:16.300 02:26:49 -- common/autotest_common.sh@850 -- # return 0 00:07:16.300 02:26:49 -- spdkcli/tcp.sh@31 -- # socat_pid=1426633 00:07:16.300 02:26:49 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:07:16.300 02:26:49 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:07:16.300 [ 00:07:16.300 "bdev_malloc_delete", 00:07:16.300 "bdev_malloc_create", 00:07:16.300 "bdev_null_resize", 00:07:16.300 "bdev_null_delete", 00:07:16.300 "bdev_null_create", 00:07:16.300 "bdev_nvme_cuse_unregister", 00:07:16.300 "bdev_nvme_cuse_register", 00:07:16.300 "bdev_opal_new_user", 00:07:16.300 "bdev_opal_set_lock_state", 00:07:16.300 "bdev_opal_delete", 00:07:16.300 "bdev_opal_get_info", 00:07:16.300 "bdev_opal_create", 00:07:16.300 "bdev_nvme_opal_revert", 00:07:16.300 "bdev_nvme_opal_init", 00:07:16.300 "bdev_nvme_send_cmd", 00:07:16.300 "bdev_nvme_get_path_iostat", 00:07:16.300 "bdev_nvme_get_mdns_discovery_info", 00:07:16.300 "bdev_nvme_stop_mdns_discovery", 00:07:16.300 "bdev_nvme_start_mdns_discovery", 00:07:16.300 "bdev_nvme_set_multipath_policy", 00:07:16.300 "bdev_nvme_set_preferred_path", 00:07:16.300 "bdev_nvme_get_io_paths", 00:07:16.300 "bdev_nvme_remove_error_injection", 00:07:16.300 "bdev_nvme_add_error_injection", 00:07:16.300 "bdev_nvme_get_discovery_info", 00:07:16.300 "bdev_nvme_stop_discovery", 00:07:16.300 "bdev_nvme_start_discovery", 00:07:16.300 "bdev_nvme_get_controller_health_info", 00:07:16.300 "bdev_nvme_disable_controller", 00:07:16.300 "bdev_nvme_enable_controller", 00:07:16.300 "bdev_nvme_reset_controller", 00:07:16.300 "bdev_nvme_get_transport_statistics", 00:07:16.300 "bdev_nvme_apply_firmware", 00:07:16.300 "bdev_nvme_detach_controller", 00:07:16.300 "bdev_nvme_get_controllers", 00:07:16.301 "bdev_nvme_attach_controller", 00:07:16.301 "bdev_nvme_set_hotplug", 00:07:16.301 "bdev_nvme_set_options", 00:07:16.301 "bdev_passthru_delete", 00:07:16.301 "bdev_passthru_create", 00:07:16.301 "bdev_lvol_grow_lvstore", 00:07:16.301 "bdev_lvol_get_lvols", 00:07:16.301 "bdev_lvol_get_lvstores", 00:07:16.301 "bdev_lvol_delete", 00:07:16.301 "bdev_lvol_set_read_only", 00:07:16.301 "bdev_lvol_resize", 00:07:16.301 "bdev_lvol_decouple_parent", 00:07:16.301 "bdev_lvol_inflate", 00:07:16.301 "bdev_lvol_rename", 00:07:16.301 "bdev_lvol_clone_bdev", 00:07:16.301 "bdev_lvol_clone", 00:07:16.301 "bdev_lvol_snapshot", 00:07:16.301 "bdev_lvol_create", 00:07:16.301 "bdev_lvol_delete_lvstore", 00:07:16.301 "bdev_lvol_rename_lvstore", 00:07:16.301 "bdev_lvol_create_lvstore", 00:07:16.301 "bdev_raid_set_options", 00:07:16.301 "bdev_raid_remove_base_bdev", 00:07:16.301 "bdev_raid_add_base_bdev", 00:07:16.301 "bdev_raid_delete", 00:07:16.301 "bdev_raid_create", 00:07:16.301 "bdev_raid_get_bdevs", 00:07:16.301 "bdev_error_inject_error", 00:07:16.301 "bdev_error_delete", 00:07:16.301 "bdev_error_create", 00:07:16.301 "bdev_split_delete", 00:07:16.301 "bdev_split_create", 00:07:16.301 "bdev_delay_delete", 00:07:16.301 "bdev_delay_create", 00:07:16.301 "bdev_delay_update_latency", 00:07:16.301 "bdev_zone_block_delete", 00:07:16.301 "bdev_zone_block_create", 00:07:16.301 "blobfs_create", 00:07:16.301 "blobfs_detect", 00:07:16.301 "blobfs_set_cache_size", 00:07:16.301 "bdev_aio_delete", 00:07:16.301 "bdev_aio_rescan", 00:07:16.301 "bdev_aio_create", 00:07:16.301 "bdev_ftl_set_property", 00:07:16.301 "bdev_ftl_get_properties", 00:07:16.301 "bdev_ftl_get_stats", 00:07:16.301 "bdev_ftl_unmap", 00:07:16.301 "bdev_ftl_unload", 00:07:16.301 "bdev_ftl_delete", 00:07:16.301 "bdev_ftl_load", 00:07:16.301 "bdev_ftl_create", 00:07:16.301 "bdev_virtio_attach_controller", 00:07:16.301 "bdev_virtio_scsi_get_devices", 00:07:16.301 "bdev_virtio_detach_controller", 00:07:16.301 "bdev_virtio_blk_set_hotplug", 00:07:16.301 "bdev_iscsi_delete", 00:07:16.301 "bdev_iscsi_create", 00:07:16.301 "bdev_iscsi_set_options", 00:07:16.301 "accel_error_inject_error", 00:07:16.301 "ioat_scan_accel_module", 00:07:16.301 "dsa_scan_accel_module", 00:07:16.301 "iaa_scan_accel_module", 00:07:16.301 "keyring_file_remove_key", 00:07:16.301 "keyring_file_add_key", 00:07:16.301 "iscsi_get_histogram", 00:07:16.301 "iscsi_enable_histogram", 00:07:16.301 "iscsi_set_options", 00:07:16.301 "iscsi_get_auth_groups", 00:07:16.301 "iscsi_auth_group_remove_secret", 00:07:16.301 "iscsi_auth_group_add_secret", 00:07:16.301 "iscsi_delete_auth_group", 00:07:16.301 "iscsi_create_auth_group", 00:07:16.301 "iscsi_set_discovery_auth", 00:07:16.301 "iscsi_get_options", 00:07:16.301 "iscsi_target_node_request_logout", 00:07:16.301 "iscsi_target_node_set_redirect", 00:07:16.301 "iscsi_target_node_set_auth", 00:07:16.301 "iscsi_target_node_add_lun", 00:07:16.301 "iscsi_get_stats", 00:07:16.301 "iscsi_get_connections", 00:07:16.301 "iscsi_portal_group_set_auth", 00:07:16.301 "iscsi_start_portal_group", 00:07:16.301 "iscsi_delete_portal_group", 00:07:16.301 "iscsi_create_portal_group", 00:07:16.301 "iscsi_get_portal_groups", 00:07:16.301 "iscsi_delete_target_node", 00:07:16.301 "iscsi_target_node_remove_pg_ig_maps", 00:07:16.301 "iscsi_target_node_add_pg_ig_maps", 00:07:16.301 "iscsi_create_target_node", 00:07:16.301 "iscsi_get_target_nodes", 00:07:16.301 "iscsi_delete_initiator_group", 00:07:16.301 "iscsi_initiator_group_remove_initiators", 00:07:16.301 "iscsi_initiator_group_add_initiators", 00:07:16.301 "iscsi_create_initiator_group", 00:07:16.301 "iscsi_get_initiator_groups", 00:07:16.301 "nvmf_set_crdt", 00:07:16.301 "nvmf_set_config", 00:07:16.301 "nvmf_set_max_subsystems", 00:07:16.301 "nvmf_subsystem_get_listeners", 00:07:16.301 "nvmf_subsystem_get_qpairs", 00:07:16.301 "nvmf_subsystem_get_controllers", 00:07:16.301 "nvmf_get_stats", 00:07:16.301 "nvmf_get_transports", 00:07:16.301 "nvmf_create_transport", 00:07:16.301 "nvmf_get_targets", 00:07:16.301 "nvmf_delete_target", 00:07:16.301 "nvmf_create_target", 00:07:16.301 "nvmf_subsystem_allow_any_host", 00:07:16.301 "nvmf_subsystem_remove_host", 00:07:16.301 "nvmf_subsystem_add_host", 00:07:16.301 "nvmf_ns_remove_host", 00:07:16.301 "nvmf_ns_add_host", 00:07:16.301 "nvmf_subsystem_remove_ns", 00:07:16.301 "nvmf_subsystem_add_ns", 00:07:16.301 "nvmf_subsystem_listener_set_ana_state", 00:07:16.301 "nvmf_discovery_get_referrals", 00:07:16.301 "nvmf_discovery_remove_referral", 00:07:16.301 "nvmf_discovery_add_referral", 00:07:16.301 "nvmf_subsystem_remove_listener", 00:07:16.301 "nvmf_subsystem_add_listener", 00:07:16.301 "nvmf_delete_subsystem", 00:07:16.301 "nvmf_create_subsystem", 00:07:16.301 "nvmf_get_subsystems", 00:07:16.301 "env_dpdk_get_mem_stats", 00:07:16.301 "nbd_get_disks", 00:07:16.301 "nbd_stop_disk", 00:07:16.301 "nbd_start_disk", 00:07:16.301 "ublk_recover_disk", 00:07:16.301 "ublk_get_disks", 00:07:16.301 "ublk_stop_disk", 00:07:16.301 "ublk_start_disk", 00:07:16.301 "ublk_destroy_target", 00:07:16.301 "ublk_create_target", 00:07:16.301 "virtio_blk_create_transport", 00:07:16.301 "virtio_blk_get_transports", 00:07:16.301 "vhost_controller_set_coalescing", 00:07:16.301 "vhost_get_controllers", 00:07:16.301 "vhost_delete_controller", 00:07:16.301 "vhost_create_blk_controller", 00:07:16.301 "vhost_scsi_controller_remove_target", 00:07:16.301 "vhost_scsi_controller_add_target", 00:07:16.301 "vhost_start_scsi_controller", 00:07:16.301 "vhost_create_scsi_controller", 00:07:16.301 "thread_set_cpumask", 00:07:16.301 "framework_get_scheduler", 00:07:16.301 "framework_set_scheduler", 00:07:16.301 "framework_get_reactors", 00:07:16.301 "thread_get_io_channels", 00:07:16.301 "thread_get_pollers", 00:07:16.301 "thread_get_stats", 00:07:16.301 "framework_monitor_context_switch", 00:07:16.301 "spdk_kill_instance", 00:07:16.301 "log_enable_timestamps", 00:07:16.301 "log_get_flags", 00:07:16.301 "log_clear_flag", 00:07:16.301 "log_set_flag", 00:07:16.301 "log_get_level", 00:07:16.301 "log_set_level", 00:07:16.301 "log_get_print_level", 00:07:16.301 "log_set_print_level", 00:07:16.301 "framework_enable_cpumask_locks", 00:07:16.301 "framework_disable_cpumask_locks", 00:07:16.301 "framework_wait_init", 00:07:16.301 "framework_start_init", 00:07:16.301 "scsi_get_devices", 00:07:16.301 "bdev_get_histogram", 00:07:16.301 "bdev_enable_histogram", 00:07:16.301 "bdev_set_qos_limit", 00:07:16.301 "bdev_set_qd_sampling_period", 00:07:16.301 "bdev_get_bdevs", 00:07:16.301 "bdev_reset_iostat", 00:07:16.301 "bdev_get_iostat", 00:07:16.301 "bdev_examine", 00:07:16.301 "bdev_wait_for_examine", 00:07:16.301 "bdev_set_options", 00:07:16.301 "notify_get_notifications", 00:07:16.301 "notify_get_types", 00:07:16.301 "accel_get_stats", 00:07:16.301 "accel_set_options", 00:07:16.301 "accel_set_driver", 00:07:16.301 "accel_crypto_key_destroy", 00:07:16.301 "accel_crypto_keys_get", 00:07:16.301 "accel_crypto_key_create", 00:07:16.301 "accel_assign_opc", 00:07:16.301 "accel_get_module_info", 00:07:16.301 "accel_get_opc_assignments", 00:07:16.301 "vmd_rescan", 00:07:16.301 "vmd_remove_device", 00:07:16.301 "vmd_enable", 00:07:16.301 "sock_get_default_impl", 00:07:16.301 "sock_set_default_impl", 00:07:16.301 "sock_impl_set_options", 00:07:16.301 "sock_impl_get_options", 00:07:16.301 "iobuf_get_stats", 00:07:16.301 "iobuf_set_options", 00:07:16.301 "framework_get_pci_devices", 00:07:16.301 "framework_get_config", 00:07:16.301 "framework_get_subsystems", 00:07:16.301 "trace_get_info", 00:07:16.301 "trace_get_tpoint_group_mask", 00:07:16.301 "trace_disable_tpoint_group", 00:07:16.301 "trace_enable_tpoint_group", 00:07:16.301 "trace_clear_tpoint_mask", 00:07:16.301 "trace_set_tpoint_mask", 00:07:16.301 "keyring_get_keys", 00:07:16.301 "spdk_get_version", 00:07:16.301 "rpc_get_methods" 00:07:16.301 ] 00:07:16.301 02:26:49 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:07:16.301 02:26:49 -- common/autotest_common.sh@716 -- # xtrace_disable 00:07:16.301 02:26:49 -- common/autotest_common.sh@10 -- # set +x 00:07:16.301 02:26:49 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:07:16.301 02:26:49 -- spdkcli/tcp.sh@38 -- # killprocess 1426584 00:07:16.301 02:26:49 -- common/autotest_common.sh@936 -- # '[' -z 1426584 ']' 00:07:16.301 02:26:49 -- common/autotest_common.sh@940 -- # kill -0 1426584 00:07:16.301 02:26:49 -- common/autotest_common.sh@941 -- # uname 00:07:16.301 02:26:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:16.301 02:26:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1426584 00:07:16.301 02:26:49 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:16.301 02:26:49 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:16.301 02:26:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1426584' 00:07:16.301 killing process with pid 1426584 00:07:16.301 02:26:49 -- common/autotest_common.sh@955 -- # kill 1426584 00:07:16.301 02:26:49 -- common/autotest_common.sh@960 -- # wait 1426584 00:07:16.870 00:07:16.870 real 0m1.614s 00:07:16.870 user 0m2.855s 00:07:16.870 sys 0m0.534s 00:07:16.870 02:26:50 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:16.870 02:26:50 -- common/autotest_common.sh@10 -- # set +x 00:07:16.870 ************************************ 00:07:16.870 END TEST spdkcli_tcp 00:07:16.870 ************************************ 00:07:16.870 02:26:50 -- spdk/autotest.sh@176 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:07:16.870 02:26:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:16.870 02:26:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:16.870 02:26:50 -- common/autotest_common.sh@10 -- # set +x 00:07:16.870 ************************************ 00:07:16.870 START TEST dpdk_mem_utility 00:07:16.870 ************************************ 00:07:16.870 02:26:50 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:07:17.130 * Looking for test storage... 00:07:17.130 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dpdk_memory_utility 00:07:17.130 02:26:50 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:07:17.130 02:26:50 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=1426852 00:07:17.130 02:26:50 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 1426852 00:07:17.130 02:26:50 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:07:17.130 02:26:50 -- common/autotest_common.sh@817 -- # '[' -z 1426852 ']' 00:07:17.130 02:26:50 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:17.130 02:26:50 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:17.130 02:26:50 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:17.130 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:17.130 02:26:50 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:17.130 02:26:50 -- common/autotest_common.sh@10 -- # set +x 00:07:17.130 [2024-04-27 02:26:50.556711] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:07:17.130 [2024-04-27 02:26:50.556773] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1426852 ] 00:07:17.130 EAL: No free 2048 kB hugepages reported on node 1 00:07:17.130 [2024-04-27 02:26:50.628597] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:17.130 [2024-04-27 02:26:50.706897] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:18.068 02:26:51 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:18.068 02:26:51 -- common/autotest_common.sh@850 -- # return 0 00:07:18.068 02:26:51 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:07:18.068 02:26:51 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:07:18.069 02:26:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:18.069 02:26:51 -- common/autotest_common.sh@10 -- # set +x 00:07:18.069 { 00:07:18.069 "filename": "/tmp/spdk_mem_dump.txt" 00:07:18.069 } 00:07:18.069 02:26:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:18.069 02:26:51 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:07:18.069 DPDK memory size 814.000000 MiB in 1 heap(s) 00:07:18.069 1 heaps totaling size 814.000000 MiB 00:07:18.069 size: 814.000000 MiB heap id: 0 00:07:18.069 end heaps---------- 00:07:18.069 8 mempools totaling size 598.116089 MiB 00:07:18.069 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:07:18.069 size: 158.602051 MiB name: PDU_data_out_Pool 00:07:18.069 size: 84.521057 MiB name: bdev_io_1426852 00:07:18.069 size: 51.011292 MiB name: evtpool_1426852 00:07:18.069 size: 50.003479 MiB name: msgpool_1426852 00:07:18.069 size: 21.763794 MiB name: PDU_Pool 00:07:18.069 size: 19.513306 MiB name: SCSI_TASK_Pool 00:07:18.069 size: 0.026123 MiB name: Session_Pool 00:07:18.069 end mempools------- 00:07:18.069 6 memzones totaling size 4.142822 MiB 00:07:18.069 size: 1.000366 MiB name: RG_ring_0_1426852 00:07:18.069 size: 1.000366 MiB name: RG_ring_1_1426852 00:07:18.069 size: 1.000366 MiB name: RG_ring_4_1426852 00:07:18.069 size: 1.000366 MiB name: RG_ring_5_1426852 00:07:18.069 size: 0.125366 MiB name: RG_ring_2_1426852 00:07:18.069 size: 0.015991 MiB name: RG_ring_3_1426852 00:07:18.069 end memzones------- 00:07:18.069 02:26:51 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:07:18.069 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:07:18.069 list of free elements. size: 12.519348 MiB 00:07:18.069 element at address: 0x200000400000 with size: 1.999512 MiB 00:07:18.069 element at address: 0x200018e00000 with size: 0.999878 MiB 00:07:18.069 element at address: 0x200019000000 with size: 0.999878 MiB 00:07:18.069 element at address: 0x200003e00000 with size: 0.996277 MiB 00:07:18.069 element at address: 0x200031c00000 with size: 0.994446 MiB 00:07:18.069 element at address: 0x200013800000 with size: 0.978699 MiB 00:07:18.069 element at address: 0x200007000000 with size: 0.959839 MiB 00:07:18.069 element at address: 0x200019200000 with size: 0.936584 MiB 00:07:18.069 element at address: 0x200000200000 with size: 0.841614 MiB 00:07:18.069 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:07:18.069 element at address: 0x20000b200000 with size: 0.490723 MiB 00:07:18.069 element at address: 0x200000800000 with size: 0.487793 MiB 00:07:18.069 element at address: 0x200019400000 with size: 0.485657 MiB 00:07:18.069 element at address: 0x200027e00000 with size: 0.410034 MiB 00:07:18.069 element at address: 0x200003a00000 with size: 0.355530 MiB 00:07:18.069 list of standard malloc elements. size: 199.218079 MiB 00:07:18.069 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:07:18.069 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:07:18.069 element at address: 0x200018efff80 with size: 1.000122 MiB 00:07:18.069 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:07:18.069 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:07:18.069 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:07:18.069 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:07:18.069 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:07:18.069 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:07:18.069 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:07:18.069 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:07:18.069 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:07:18.069 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:07:18.069 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:07:18.069 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:07:18.069 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:07:18.069 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:07:18.069 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:07:18.069 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:07:18.069 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:07:18.069 element at address: 0x200003adb300 with size: 0.000183 MiB 00:07:18.069 element at address: 0x200003adb500 with size: 0.000183 MiB 00:07:18.069 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:07:18.069 element at address: 0x200003affa80 with size: 0.000183 MiB 00:07:18.069 element at address: 0x200003affb40 with size: 0.000183 MiB 00:07:18.069 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:07:18.069 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:07:18.069 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:07:18.069 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:07:18.069 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:07:18.069 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:07:18.069 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:07:18.069 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:07:18.069 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:07:18.069 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:07:18.069 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:07:18.069 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:07:18.069 element at address: 0x200027e69040 with size: 0.000183 MiB 00:07:18.069 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:07:18.069 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:07:18.069 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:07:18.069 list of memzone associated elements. size: 602.262573 MiB 00:07:18.069 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:07:18.069 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:07:18.069 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:07:18.069 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:07:18.069 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:07:18.069 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_1426852_0 00:07:18.069 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:07:18.069 associated memzone info: size: 48.002930 MiB name: MP_evtpool_1426852_0 00:07:18.069 element at address: 0x200003fff380 with size: 48.003052 MiB 00:07:18.069 associated memzone info: size: 48.002930 MiB name: MP_msgpool_1426852_0 00:07:18.069 element at address: 0x2000195be940 with size: 20.255554 MiB 00:07:18.069 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:07:18.069 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:07:18.069 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:07:18.069 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:07:18.069 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_1426852 00:07:18.069 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:07:18.069 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_1426852 00:07:18.069 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:07:18.069 associated memzone info: size: 1.007996 MiB name: MP_evtpool_1426852 00:07:18.069 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:07:18.069 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:07:18.069 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:07:18.069 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:07:18.069 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:07:18.069 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:07:18.069 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:07:18.069 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:07:18.069 element at address: 0x200003eff180 with size: 1.000488 MiB 00:07:18.069 associated memzone info: size: 1.000366 MiB name: RG_ring_0_1426852 00:07:18.069 element at address: 0x200003affc00 with size: 1.000488 MiB 00:07:18.069 associated memzone info: size: 1.000366 MiB name: RG_ring_1_1426852 00:07:18.069 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:07:18.069 associated memzone info: size: 1.000366 MiB name: RG_ring_4_1426852 00:07:18.069 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:07:18.069 associated memzone info: size: 1.000366 MiB name: RG_ring_5_1426852 00:07:18.069 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:07:18.069 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_1426852 00:07:18.069 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:07:18.069 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:07:18.069 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:07:18.069 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:07:18.069 element at address: 0x20001947c540 with size: 0.250488 MiB 00:07:18.069 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:07:18.069 element at address: 0x200003adf880 with size: 0.125488 MiB 00:07:18.069 associated memzone info: size: 0.125366 MiB name: RG_ring_2_1426852 00:07:18.069 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:07:18.069 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:07:18.069 element at address: 0x200027e69100 with size: 0.023743 MiB 00:07:18.069 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:07:18.069 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:07:18.069 associated memzone info: size: 0.015991 MiB name: RG_ring_3_1426852 00:07:18.069 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:07:18.069 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:07:18.069 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:07:18.069 associated memzone info: size: 0.000183 MiB name: MP_msgpool_1426852 00:07:18.069 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:07:18.069 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_1426852 00:07:18.069 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:07:18.069 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:07:18.069 02:26:51 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:07:18.069 02:26:51 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 1426852 00:07:18.070 02:26:51 -- common/autotest_common.sh@936 -- # '[' -z 1426852 ']' 00:07:18.070 02:26:51 -- common/autotest_common.sh@940 -- # kill -0 1426852 00:07:18.070 02:26:51 -- common/autotest_common.sh@941 -- # uname 00:07:18.070 02:26:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:18.070 02:26:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1426852 00:07:18.070 02:26:51 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:18.070 02:26:51 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:18.070 02:26:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1426852' 00:07:18.070 killing process with pid 1426852 00:07:18.070 02:26:51 -- common/autotest_common.sh@955 -- # kill 1426852 00:07:18.070 02:26:51 -- common/autotest_common.sh@960 -- # wait 1426852 00:07:18.329 00:07:18.329 real 0m1.503s 00:07:18.329 user 0m1.516s 00:07:18.329 sys 0m0.482s 00:07:18.329 02:26:51 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:18.329 02:26:51 -- common/autotest_common.sh@10 -- # set +x 00:07:18.329 ************************************ 00:07:18.329 END TEST dpdk_mem_utility 00:07:18.329 ************************************ 00:07:18.329 02:26:51 -- spdk/autotest.sh@177 -- # run_test event /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/event.sh 00:07:18.329 02:26:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:18.329 02:26:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:18.329 02:26:51 -- common/autotest_common.sh@10 -- # set +x 00:07:18.589 ************************************ 00:07:18.589 START TEST event 00:07:18.589 ************************************ 00:07:18.589 02:26:52 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/event.sh 00:07:18.849 * Looking for test storage... 00:07:18.849 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event 00:07:18.849 02:26:52 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/bdev/nbd_common.sh 00:07:18.849 02:26:52 -- bdev/nbd_common.sh@6 -- # set -e 00:07:18.849 02:26:52 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:07:18.849 02:26:52 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:18.849 02:26:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:18.849 02:26:52 -- common/autotest_common.sh@10 -- # set +x 00:07:18.849 ************************************ 00:07:18.849 START TEST event_perf 00:07:18.849 ************************************ 00:07:18.849 02:26:52 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:07:18.849 Running I/O for 1 seconds...[2024-04-27 02:26:52.422954] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:07:18.849 [2024-04-27 02:26:52.423037] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1427205 ] 00:07:18.849 EAL: No free 2048 kB hugepages reported on node 1 00:07:19.109 [2024-04-27 02:26:52.499993] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:19.109 [2024-04-27 02:26:52.589900] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:19.109 [2024-04-27 02:26:52.589985] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:19.109 [2024-04-27 02:26:52.590063] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:19.109 [2024-04-27 02:26:52.590065] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:20.488 Running I/O for 1 seconds... 00:07:20.488 lcore 0: 206765 00:07:20.488 lcore 1: 206764 00:07:20.488 lcore 2: 206765 00:07:20.488 lcore 3: 206767 00:07:20.488 done. 00:07:20.488 00:07:20.488 real 0m1.294s 00:07:20.488 user 0m4.197s 00:07:20.488 sys 0m0.092s 00:07:20.488 02:26:53 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:20.488 02:26:53 -- common/autotest_common.sh@10 -- # set +x 00:07:20.488 ************************************ 00:07:20.488 END TEST event_perf 00:07:20.488 ************************************ 00:07:20.488 02:26:53 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:07:20.488 02:26:53 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:20.488 02:26:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:20.488 02:26:53 -- common/autotest_common.sh@10 -- # set +x 00:07:20.488 ************************************ 00:07:20.488 START TEST event_reactor 00:07:20.488 ************************************ 00:07:20.488 02:26:53 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:07:20.488 [2024-04-27 02:26:53.926218] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:07:20.488 [2024-04-27 02:26:53.926283] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1427485 ] 00:07:20.488 EAL: No free 2048 kB hugepages reported on node 1 00:07:20.488 [2024-04-27 02:26:53.999098] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:20.488 [2024-04-27 02:26:54.087571] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:21.898 test_start 00:07:21.898 oneshot 00:07:21.898 tick 100 00:07:21.898 tick 100 00:07:21.898 tick 250 00:07:21.898 tick 100 00:07:21.898 tick 100 00:07:21.898 tick 100 00:07:21.898 tick 250 00:07:21.898 tick 500 00:07:21.898 tick 100 00:07:21.898 tick 100 00:07:21.898 tick 250 00:07:21.898 tick 100 00:07:21.898 tick 100 00:07:21.898 test_end 00:07:21.898 00:07:21.898 real 0m1.290s 00:07:21.898 user 0m1.198s 00:07:21.898 sys 0m0.088s 00:07:21.898 02:26:55 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:21.898 02:26:55 -- common/autotest_common.sh@10 -- # set +x 00:07:21.898 ************************************ 00:07:21.898 END TEST event_reactor 00:07:21.898 ************************************ 00:07:21.898 02:26:55 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:07:21.898 02:26:55 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:21.898 02:26:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:21.898 02:26:55 -- common/autotest_common.sh@10 -- # set +x 00:07:21.898 ************************************ 00:07:21.898 START TEST event_reactor_perf 00:07:21.898 ************************************ 00:07:21.898 02:26:55 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:07:21.898 [2024-04-27 02:26:55.429067] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:07:21.898 [2024-04-27 02:26:55.429131] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1427697 ] 00:07:21.898 EAL: No free 2048 kB hugepages reported on node 1 00:07:22.161 [2024-04-27 02:26:55.503060] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:22.161 [2024-04-27 02:26:55.589659] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:23.099 test_start 00:07:23.099 test_end 00:07:23.099 Performance: 502048 events per second 00:07:23.099 00:07:23.099 real 0m1.285s 00:07:23.099 user 0m1.189s 00:07:23.099 sys 0m0.092s 00:07:23.099 02:26:56 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:23.099 02:26:56 -- common/autotest_common.sh@10 -- # set +x 00:07:23.099 ************************************ 00:07:23.099 END TEST event_reactor_perf 00:07:23.099 ************************************ 00:07:23.361 02:26:56 -- event/event.sh@49 -- # uname -s 00:07:23.361 02:26:56 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:07:23.361 02:26:56 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:07:23.361 02:26:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:23.361 02:26:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:23.361 02:26:56 -- common/autotest_common.sh@10 -- # set +x 00:07:23.361 ************************************ 00:07:23.361 START TEST event_scheduler 00:07:23.361 ************************************ 00:07:23.361 02:26:56 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:07:23.621 * Looking for test storage... 00:07:23.621 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/scheduler 00:07:23.621 02:26:57 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:07:23.621 02:26:57 -- scheduler/scheduler.sh@35 -- # scheduler_pid=1427939 00:07:23.621 02:26:57 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:07:23.621 02:26:57 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:07:23.621 02:26:57 -- scheduler/scheduler.sh@37 -- # waitforlisten 1427939 00:07:23.621 02:26:57 -- common/autotest_common.sh@817 -- # '[' -z 1427939 ']' 00:07:23.621 02:26:57 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:23.621 02:26:57 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:23.621 02:26:57 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:23.621 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:23.621 02:26:57 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:23.621 02:26:57 -- common/autotest_common.sh@10 -- # set +x 00:07:23.621 [2024-04-27 02:26:57.052930] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:07:23.621 [2024-04-27 02:26:57.052986] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1427939 ] 00:07:23.621 EAL: No free 2048 kB hugepages reported on node 1 00:07:23.621 [2024-04-27 02:26:57.121405] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:23.621 [2024-04-27 02:26:57.210549] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:23.621 [2024-04-27 02:26:57.210624] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:23.621 [2024-04-27 02:26:57.210705] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:23.621 [2024-04-27 02:26:57.210706] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:24.558 02:26:57 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:24.558 02:26:57 -- common/autotest_common.sh@850 -- # return 0 00:07:24.558 02:26:57 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:07:24.558 02:26:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:24.558 02:26:57 -- common/autotest_common.sh@10 -- # set +x 00:07:24.558 POWER: Env isn't set yet! 00:07:24.558 POWER: Attempting to initialise ACPI cpufreq power management... 00:07:24.558 POWER: Failed to write /sys/devices/system/cpu/cpu%u/cpufreq/scaling_governor 00:07:24.558 POWER: Cannot set governor of lcore 0 to userspace 00:07:24.558 POWER: Attempting to initialise PSTAT power management... 00:07:24.558 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:07:24.558 POWER: Initialized successfully for lcore 0 power management 00:07:24.558 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:07:24.558 POWER: Initialized successfully for lcore 1 power management 00:07:24.558 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:07:24.558 POWER: Initialized successfully for lcore 2 power management 00:07:24.558 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:07:24.558 POWER: Initialized successfully for lcore 3 power management 00:07:24.558 02:26:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:24.558 02:26:57 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:07:24.558 02:26:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:24.558 02:26:57 -- common/autotest_common.sh@10 -- # set +x 00:07:24.558 [2024-04-27 02:26:58.026563] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:07:24.558 02:26:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:24.558 02:26:58 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:07:24.558 02:26:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:24.558 02:26:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:24.558 02:26:58 -- common/autotest_common.sh@10 -- # set +x 00:07:24.818 ************************************ 00:07:24.818 START TEST scheduler_create_thread 00:07:24.818 ************************************ 00:07:24.818 02:26:58 -- common/autotest_common.sh@1111 -- # scheduler_create_thread 00:07:24.818 02:26:58 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:07:24.818 02:26:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:24.818 02:26:58 -- common/autotest_common.sh@10 -- # set +x 00:07:24.818 2 00:07:24.818 02:26:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:24.818 02:26:58 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:07:24.818 02:26:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:24.818 02:26:58 -- common/autotest_common.sh@10 -- # set +x 00:07:24.818 3 00:07:24.818 02:26:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:24.818 02:26:58 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:07:24.818 02:26:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:24.818 02:26:58 -- common/autotest_common.sh@10 -- # set +x 00:07:24.818 4 00:07:24.818 02:26:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:24.818 02:26:58 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:07:24.818 02:26:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:24.818 02:26:58 -- common/autotest_common.sh@10 -- # set +x 00:07:24.818 5 00:07:24.818 02:26:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:24.818 02:26:58 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:07:24.818 02:26:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:24.818 02:26:58 -- common/autotest_common.sh@10 -- # set +x 00:07:24.818 6 00:07:24.818 02:26:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:24.818 02:26:58 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:07:24.818 02:26:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:24.818 02:26:58 -- common/autotest_common.sh@10 -- # set +x 00:07:24.818 7 00:07:24.818 02:26:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:24.818 02:26:58 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:07:24.818 02:26:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:24.818 02:26:58 -- common/autotest_common.sh@10 -- # set +x 00:07:24.818 8 00:07:24.818 02:26:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:24.818 02:26:58 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:07:24.818 02:26:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:24.818 02:26:58 -- common/autotest_common.sh@10 -- # set +x 00:07:24.818 9 00:07:24.818 02:26:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:24.818 02:26:58 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:07:24.818 02:26:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:24.818 02:26:58 -- common/autotest_common.sh@10 -- # set +x 00:07:24.818 10 00:07:24.818 02:26:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:24.818 02:26:58 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:07:24.818 02:26:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:24.818 02:26:58 -- common/autotest_common.sh@10 -- # set +x 00:07:24.818 02:26:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:24.818 02:26:58 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:07:24.818 02:26:58 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:07:24.818 02:26:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:24.818 02:26:58 -- common/autotest_common.sh@10 -- # set +x 00:07:25.754 02:26:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:25.754 02:26:59 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:07:25.754 02:26:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:25.754 02:26:59 -- common/autotest_common.sh@10 -- # set +x 00:07:27.130 02:27:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:27.130 02:27:00 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:07:27.130 02:27:00 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:07:27.130 02:27:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:27.130 02:27:00 -- common/autotest_common.sh@10 -- # set +x 00:07:28.065 02:27:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:28.065 00:07:28.065 real 0m3.482s 00:07:28.065 user 0m0.026s 00:07:28.065 sys 0m0.005s 00:07:28.065 02:27:01 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:28.065 02:27:01 -- common/autotest_common.sh@10 -- # set +x 00:07:28.065 ************************************ 00:07:28.065 END TEST scheduler_create_thread 00:07:28.065 ************************************ 00:07:28.325 02:27:01 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:07:28.325 02:27:01 -- scheduler/scheduler.sh@46 -- # killprocess 1427939 00:07:28.325 02:27:01 -- common/autotest_common.sh@936 -- # '[' -z 1427939 ']' 00:07:28.325 02:27:01 -- common/autotest_common.sh@940 -- # kill -0 1427939 00:07:28.325 02:27:01 -- common/autotest_common.sh@941 -- # uname 00:07:28.325 02:27:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:28.325 02:27:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1427939 00:07:28.325 02:27:01 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:07:28.325 02:27:01 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:07:28.325 02:27:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1427939' 00:07:28.325 killing process with pid 1427939 00:07:28.325 02:27:01 -- common/autotest_common.sh@955 -- # kill 1427939 00:07:28.325 02:27:01 -- common/autotest_common.sh@960 -- # wait 1427939 00:07:28.584 [2024-04-27 02:27:02.143897] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:07:28.844 POWER: Power management governor of lcore 0 has been set to 'powersave' successfully 00:07:28.844 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:07:28.844 POWER: Power management governor of lcore 1 has been set to 'powersave' successfully 00:07:28.844 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:07:28.844 POWER: Power management governor of lcore 2 has been set to 'powersave' successfully 00:07:28.844 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:07:28.844 POWER: Power management governor of lcore 3 has been set to 'powersave' successfully 00:07:28.844 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:07:28.844 00:07:28.844 real 0m5.459s 00:07:28.844 user 0m8.955s 00:07:28.844 sys 0m0.515s 00:07:28.844 02:27:02 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:28.844 02:27:02 -- common/autotest_common.sh@10 -- # set +x 00:07:28.844 ************************************ 00:07:28.844 END TEST event_scheduler 00:07:28.844 ************************************ 00:07:28.844 02:27:02 -- event/event.sh@51 -- # modprobe -n nbd 00:07:28.844 02:27:02 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:07:28.844 02:27:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:28.844 02:27:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:28.844 02:27:02 -- common/autotest_common.sh@10 -- # set +x 00:07:29.103 ************************************ 00:07:29.103 START TEST app_repeat 00:07:29.103 ************************************ 00:07:29.103 02:27:02 -- common/autotest_common.sh@1111 -- # app_repeat_test 00:07:29.103 02:27:02 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:29.103 02:27:02 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:29.103 02:27:02 -- event/event.sh@13 -- # local nbd_list 00:07:29.103 02:27:02 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:07:29.103 02:27:02 -- event/event.sh@14 -- # local bdev_list 00:07:29.103 02:27:02 -- event/event.sh@15 -- # local repeat_times=4 00:07:29.103 02:27:02 -- event/event.sh@17 -- # modprobe nbd 00:07:29.103 02:27:02 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:07:29.103 02:27:02 -- event/event.sh@19 -- # repeat_pid=1428857 00:07:29.103 02:27:02 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:07:29.103 02:27:02 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 1428857' 00:07:29.103 Process app_repeat pid: 1428857 00:07:29.103 02:27:02 -- event/event.sh@23 -- # for i in {0..2} 00:07:29.103 02:27:02 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:07:29.103 spdk_app_start Round 0 00:07:29.103 02:27:02 -- event/event.sh@25 -- # waitforlisten 1428857 /var/tmp/spdk-nbd.sock 00:07:29.103 02:27:02 -- common/autotest_common.sh@817 -- # '[' -z 1428857 ']' 00:07:29.103 02:27:02 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:07:29.103 02:27:02 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:29.103 02:27:02 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:07:29.103 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:07:29.103 02:27:02 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:29.103 02:27:02 -- common/autotest_common.sh@10 -- # set +x 00:07:29.103 [2024-04-27 02:27:02.588668] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:07:29.103 [2024-04-27 02:27:02.588721] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1428857 ] 00:07:29.103 EAL: No free 2048 kB hugepages reported on node 1 00:07:29.103 [2024-04-27 02:27:02.660898] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:07:29.362 [2024-04-27 02:27:02.751628] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:29.363 [2024-04-27 02:27:02.751631] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:29.928 02:27:03 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:29.928 02:27:03 -- common/autotest_common.sh@850 -- # return 0 00:07:29.928 02:27:03 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:07:30.187 Malloc0 00:07:30.187 02:27:03 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:07:30.187 Malloc1 00:07:30.447 02:27:03 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:07:30.447 02:27:03 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:30.447 02:27:03 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:07:30.447 02:27:03 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:07:30.447 02:27:03 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:30.447 02:27:03 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:07:30.447 02:27:03 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:07:30.447 02:27:03 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:30.447 02:27:03 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:07:30.447 02:27:03 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:07:30.447 02:27:03 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:30.447 02:27:03 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:07:30.447 02:27:03 -- bdev/nbd_common.sh@12 -- # local i 00:07:30.447 02:27:03 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:07:30.447 02:27:03 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:07:30.447 02:27:03 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:07:30.447 /dev/nbd0 00:07:30.447 02:27:04 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:07:30.447 02:27:04 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:07:30.447 02:27:04 -- common/autotest_common.sh@854 -- # local nbd_name=nbd0 00:07:30.447 02:27:04 -- common/autotest_common.sh@855 -- # local i 00:07:30.447 02:27:04 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:07:30.447 02:27:04 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:07:30.447 02:27:04 -- common/autotest_common.sh@858 -- # grep -q -w nbd0 /proc/partitions 00:07:30.447 02:27:04 -- common/autotest_common.sh@859 -- # break 00:07:30.447 02:27:04 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:07:30.447 02:27:04 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:07:30.447 02:27:04 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:07:30.447 1+0 records in 00:07:30.447 1+0 records out 00:07:30.447 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000220824 s, 18.5 MB/s 00:07:30.447 02:27:04 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:07:30.447 02:27:04 -- common/autotest_common.sh@872 -- # size=4096 00:07:30.447 02:27:04 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:07:30.447 02:27:04 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:07:30.447 02:27:04 -- common/autotest_common.sh@875 -- # return 0 00:07:30.447 02:27:04 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:07:30.447 02:27:04 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:07:30.447 02:27:04 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:07:30.707 /dev/nbd1 00:07:30.707 02:27:04 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:07:30.707 02:27:04 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:07:30.707 02:27:04 -- common/autotest_common.sh@854 -- # local nbd_name=nbd1 00:07:30.707 02:27:04 -- common/autotest_common.sh@855 -- # local i 00:07:30.707 02:27:04 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:07:30.707 02:27:04 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:07:30.707 02:27:04 -- common/autotest_common.sh@858 -- # grep -q -w nbd1 /proc/partitions 00:07:30.707 02:27:04 -- common/autotest_common.sh@859 -- # break 00:07:30.707 02:27:04 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:07:30.707 02:27:04 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:07:30.707 02:27:04 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:07:30.707 1+0 records in 00:07:30.707 1+0 records out 00:07:30.707 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000168404 s, 24.3 MB/s 00:07:30.707 02:27:04 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:07:30.707 02:27:04 -- common/autotest_common.sh@872 -- # size=4096 00:07:30.707 02:27:04 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:07:30.707 02:27:04 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:07:30.707 02:27:04 -- common/autotest_common.sh@875 -- # return 0 00:07:30.707 02:27:04 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:07:30.707 02:27:04 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:07:30.707 02:27:04 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:07:30.707 02:27:04 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:30.707 02:27:04 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:07:30.966 02:27:04 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:07:30.966 { 00:07:30.966 "nbd_device": "/dev/nbd0", 00:07:30.966 "bdev_name": "Malloc0" 00:07:30.966 }, 00:07:30.966 { 00:07:30.966 "nbd_device": "/dev/nbd1", 00:07:30.966 "bdev_name": "Malloc1" 00:07:30.966 } 00:07:30.966 ]' 00:07:30.966 02:27:04 -- bdev/nbd_common.sh@64 -- # echo '[ 00:07:30.966 { 00:07:30.966 "nbd_device": "/dev/nbd0", 00:07:30.966 "bdev_name": "Malloc0" 00:07:30.966 }, 00:07:30.966 { 00:07:30.966 "nbd_device": "/dev/nbd1", 00:07:30.966 "bdev_name": "Malloc1" 00:07:30.966 } 00:07:30.966 ]' 00:07:30.966 02:27:04 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:07:30.966 02:27:04 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:07:30.966 /dev/nbd1' 00:07:30.966 02:27:04 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:07:30.966 /dev/nbd1' 00:07:30.966 02:27:04 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:07:30.966 02:27:04 -- bdev/nbd_common.sh@65 -- # count=2 00:07:30.966 02:27:04 -- bdev/nbd_common.sh@66 -- # echo 2 00:07:30.966 02:27:04 -- bdev/nbd_common.sh@95 -- # count=2 00:07:30.966 02:27:04 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:07:30.966 02:27:04 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:07:30.966 02:27:04 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:30.966 02:27:04 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:07:30.966 02:27:04 -- bdev/nbd_common.sh@71 -- # local operation=write 00:07:30.966 02:27:04 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:07:30.966 02:27:04 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:07:30.966 02:27:04 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:07:30.966 256+0 records in 00:07:30.966 256+0 records out 00:07:30.966 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00462929 s, 227 MB/s 00:07:30.967 02:27:04 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:07:30.967 02:27:04 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:07:30.967 256+0 records in 00:07:30.967 256+0 records out 00:07:30.967 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205894 s, 50.9 MB/s 00:07:30.967 02:27:04 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:07:30.967 02:27:04 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:07:30.967 256+0 records in 00:07:30.967 256+0 records out 00:07:30.967 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217227 s, 48.3 MB/s 00:07:30.967 02:27:04 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:07:30.967 02:27:04 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:30.967 02:27:04 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:07:30.967 02:27:04 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:07:30.967 02:27:04 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:07:30.967 02:27:04 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:07:30.967 02:27:04 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:07:30.967 02:27:04 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:07:30.967 02:27:04 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:07:30.967 02:27:04 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:07:30.967 02:27:04 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:07:30.967 02:27:04 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:07:30.967 02:27:04 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:07:30.967 02:27:04 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:30.967 02:27:04 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:30.967 02:27:04 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:07:30.967 02:27:04 -- bdev/nbd_common.sh@51 -- # local i 00:07:30.967 02:27:04 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:07:30.967 02:27:04 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:07:31.226 02:27:04 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:07:31.226 02:27:04 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:07:31.226 02:27:04 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:07:31.226 02:27:04 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:07:31.226 02:27:04 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:07:31.226 02:27:04 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:07:31.226 02:27:04 -- bdev/nbd_common.sh@41 -- # break 00:07:31.226 02:27:04 -- bdev/nbd_common.sh@45 -- # return 0 00:07:31.226 02:27:04 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:07:31.226 02:27:04 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:07:31.486 02:27:04 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:07:31.486 02:27:04 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:07:31.486 02:27:04 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:07:31.486 02:27:04 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:07:31.486 02:27:04 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:07:31.486 02:27:04 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:07:31.486 02:27:04 -- bdev/nbd_common.sh@41 -- # break 00:07:31.486 02:27:04 -- bdev/nbd_common.sh@45 -- # return 0 00:07:31.486 02:27:04 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:07:31.486 02:27:04 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:31.486 02:27:04 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:07:31.745 02:27:05 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:07:31.745 02:27:05 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:07:31.745 02:27:05 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:07:31.745 02:27:05 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:07:31.745 02:27:05 -- bdev/nbd_common.sh@65 -- # echo '' 00:07:31.745 02:27:05 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:07:31.745 02:27:05 -- bdev/nbd_common.sh@65 -- # true 00:07:31.745 02:27:05 -- bdev/nbd_common.sh@65 -- # count=0 00:07:31.745 02:27:05 -- bdev/nbd_common.sh@66 -- # echo 0 00:07:31.745 02:27:05 -- bdev/nbd_common.sh@104 -- # count=0 00:07:31.745 02:27:05 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:07:31.745 02:27:05 -- bdev/nbd_common.sh@109 -- # return 0 00:07:31.745 02:27:05 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:07:32.004 02:27:05 -- event/event.sh@35 -- # sleep 3 00:07:32.264 [2024-04-27 02:27:05.641123] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:07:32.264 [2024-04-27 02:27:05.722409] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:32.264 [2024-04-27 02:27:05.722412] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:32.264 [2024-04-27 02:27:05.769497] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:07:32.264 [2024-04-27 02:27:05.769545] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:07:34.799 02:27:08 -- event/event.sh@23 -- # for i in {0..2} 00:07:35.058 02:27:08 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:07:35.058 spdk_app_start Round 1 00:07:35.058 02:27:08 -- event/event.sh@25 -- # waitforlisten 1428857 /var/tmp/spdk-nbd.sock 00:07:35.058 02:27:08 -- common/autotest_common.sh@817 -- # '[' -z 1428857 ']' 00:07:35.058 02:27:08 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:07:35.058 02:27:08 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:35.058 02:27:08 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:07:35.058 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:07:35.059 02:27:08 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:35.059 02:27:08 -- common/autotest_common.sh@10 -- # set +x 00:07:35.059 02:27:08 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:35.059 02:27:08 -- common/autotest_common.sh@850 -- # return 0 00:07:35.059 02:27:08 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:07:35.317 Malloc0 00:07:35.317 02:27:08 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:07:35.317 Malloc1 00:07:35.575 02:27:08 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:07:35.575 02:27:08 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:35.575 02:27:08 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:07:35.575 02:27:08 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:07:35.575 02:27:08 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:35.575 02:27:08 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:07:35.575 02:27:08 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:07:35.575 02:27:08 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:35.575 02:27:08 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:07:35.575 02:27:08 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:07:35.575 02:27:08 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:35.575 02:27:08 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:07:35.575 02:27:08 -- bdev/nbd_common.sh@12 -- # local i 00:07:35.575 02:27:08 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:07:35.575 02:27:08 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:07:35.575 02:27:08 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:07:35.575 /dev/nbd0 00:07:35.575 02:27:09 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:07:35.575 02:27:09 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:07:35.575 02:27:09 -- common/autotest_common.sh@854 -- # local nbd_name=nbd0 00:07:35.575 02:27:09 -- common/autotest_common.sh@855 -- # local i 00:07:35.575 02:27:09 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:07:35.575 02:27:09 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:07:35.575 02:27:09 -- common/autotest_common.sh@858 -- # grep -q -w nbd0 /proc/partitions 00:07:35.575 02:27:09 -- common/autotest_common.sh@859 -- # break 00:07:35.575 02:27:09 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:07:35.575 02:27:09 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:07:35.575 02:27:09 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:07:35.575 1+0 records in 00:07:35.575 1+0 records out 00:07:35.575 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000249099 s, 16.4 MB/s 00:07:35.575 02:27:09 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:07:35.575 02:27:09 -- common/autotest_common.sh@872 -- # size=4096 00:07:35.575 02:27:09 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:07:35.575 02:27:09 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:07:35.575 02:27:09 -- common/autotest_common.sh@875 -- # return 0 00:07:35.575 02:27:09 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:07:35.575 02:27:09 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:07:35.575 02:27:09 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:07:35.833 /dev/nbd1 00:07:35.833 02:27:09 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:07:35.833 02:27:09 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:07:35.833 02:27:09 -- common/autotest_common.sh@854 -- # local nbd_name=nbd1 00:07:35.833 02:27:09 -- common/autotest_common.sh@855 -- # local i 00:07:35.833 02:27:09 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:07:35.833 02:27:09 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:07:35.833 02:27:09 -- common/autotest_common.sh@858 -- # grep -q -w nbd1 /proc/partitions 00:07:35.833 02:27:09 -- common/autotest_common.sh@859 -- # break 00:07:35.833 02:27:09 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:07:35.833 02:27:09 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:07:35.833 02:27:09 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:07:35.833 1+0 records in 00:07:35.833 1+0 records out 00:07:35.833 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000342675 s, 12.0 MB/s 00:07:35.833 02:27:09 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:07:35.833 02:27:09 -- common/autotest_common.sh@872 -- # size=4096 00:07:35.833 02:27:09 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:07:35.833 02:27:09 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:07:35.833 02:27:09 -- common/autotest_common.sh@875 -- # return 0 00:07:35.833 02:27:09 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:07:35.833 02:27:09 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:07:35.833 02:27:09 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:07:35.833 02:27:09 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:35.833 02:27:09 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:07:36.091 02:27:09 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:07:36.091 { 00:07:36.091 "nbd_device": "/dev/nbd0", 00:07:36.091 "bdev_name": "Malloc0" 00:07:36.091 }, 00:07:36.091 { 00:07:36.091 "nbd_device": "/dev/nbd1", 00:07:36.091 "bdev_name": "Malloc1" 00:07:36.091 } 00:07:36.091 ]' 00:07:36.091 02:27:09 -- bdev/nbd_common.sh@64 -- # echo '[ 00:07:36.091 { 00:07:36.091 "nbd_device": "/dev/nbd0", 00:07:36.091 "bdev_name": "Malloc0" 00:07:36.091 }, 00:07:36.091 { 00:07:36.091 "nbd_device": "/dev/nbd1", 00:07:36.091 "bdev_name": "Malloc1" 00:07:36.091 } 00:07:36.091 ]' 00:07:36.091 02:27:09 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:07:36.091 02:27:09 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:07:36.091 /dev/nbd1' 00:07:36.091 02:27:09 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:07:36.091 02:27:09 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:07:36.091 /dev/nbd1' 00:07:36.091 02:27:09 -- bdev/nbd_common.sh@65 -- # count=2 00:07:36.091 02:27:09 -- bdev/nbd_common.sh@66 -- # echo 2 00:07:36.091 02:27:09 -- bdev/nbd_common.sh@95 -- # count=2 00:07:36.091 02:27:09 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:07:36.091 02:27:09 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:07:36.091 02:27:09 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:36.091 02:27:09 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:07:36.091 02:27:09 -- bdev/nbd_common.sh@71 -- # local operation=write 00:07:36.091 02:27:09 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:07:36.091 02:27:09 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:07:36.091 02:27:09 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:07:36.091 256+0 records in 00:07:36.091 256+0 records out 00:07:36.091 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114851 s, 91.3 MB/s 00:07:36.091 02:27:09 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:07:36.091 02:27:09 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:07:36.091 256+0 records in 00:07:36.091 256+0 records out 00:07:36.091 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020063 s, 52.3 MB/s 00:07:36.091 02:27:09 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:07:36.091 02:27:09 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:07:36.091 256+0 records in 00:07:36.091 256+0 records out 00:07:36.091 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215917 s, 48.6 MB/s 00:07:36.091 02:27:09 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:07:36.091 02:27:09 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:36.091 02:27:09 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:07:36.091 02:27:09 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:07:36.091 02:27:09 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:07:36.091 02:27:09 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:07:36.091 02:27:09 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:07:36.091 02:27:09 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:07:36.091 02:27:09 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:07:36.091 02:27:09 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:07:36.091 02:27:09 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:07:36.091 02:27:09 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:07:36.091 02:27:09 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:07:36.091 02:27:09 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:36.091 02:27:09 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:36.091 02:27:09 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:07:36.091 02:27:09 -- bdev/nbd_common.sh@51 -- # local i 00:07:36.091 02:27:09 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:07:36.091 02:27:09 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:07:36.349 02:27:09 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:07:36.349 02:27:09 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:07:36.349 02:27:09 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:07:36.349 02:27:09 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:07:36.349 02:27:09 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:07:36.349 02:27:09 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:07:36.349 02:27:09 -- bdev/nbd_common.sh@41 -- # break 00:07:36.349 02:27:09 -- bdev/nbd_common.sh@45 -- # return 0 00:07:36.349 02:27:09 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:07:36.349 02:27:09 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:07:36.607 02:27:10 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:07:36.607 02:27:10 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:07:36.607 02:27:10 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:07:36.607 02:27:10 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:07:36.607 02:27:10 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:07:36.607 02:27:10 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:07:36.607 02:27:10 -- bdev/nbd_common.sh@41 -- # break 00:07:36.607 02:27:10 -- bdev/nbd_common.sh@45 -- # return 0 00:07:36.607 02:27:10 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:07:36.607 02:27:10 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:36.607 02:27:10 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:07:36.865 02:27:10 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:07:36.865 02:27:10 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:07:36.865 02:27:10 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:07:36.865 02:27:10 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:07:36.865 02:27:10 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:07:36.865 02:27:10 -- bdev/nbd_common.sh@65 -- # echo '' 00:07:36.865 02:27:10 -- bdev/nbd_common.sh@65 -- # true 00:07:36.865 02:27:10 -- bdev/nbd_common.sh@65 -- # count=0 00:07:36.865 02:27:10 -- bdev/nbd_common.sh@66 -- # echo 0 00:07:36.865 02:27:10 -- bdev/nbd_common.sh@104 -- # count=0 00:07:36.865 02:27:10 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:07:36.865 02:27:10 -- bdev/nbd_common.sh@109 -- # return 0 00:07:36.865 02:27:10 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:07:37.123 02:27:10 -- event/event.sh@35 -- # sleep 3 00:07:37.381 [2024-04-27 02:27:10.755193] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:07:37.381 [2024-04-27 02:27:10.835374] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:37.381 [2024-04-27 02:27:10.835384] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:37.381 [2024-04-27 02:27:10.884913] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:07:37.381 [2024-04-27 02:27:10.884957] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:07:39.983 02:27:13 -- event/event.sh@23 -- # for i in {0..2} 00:07:39.983 02:27:13 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:07:39.983 spdk_app_start Round 2 00:07:39.983 02:27:13 -- event/event.sh@25 -- # waitforlisten 1428857 /var/tmp/spdk-nbd.sock 00:07:39.983 02:27:13 -- common/autotest_common.sh@817 -- # '[' -z 1428857 ']' 00:07:39.983 02:27:13 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:07:39.983 02:27:13 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:39.983 02:27:13 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:07:39.983 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:07:39.983 02:27:13 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:39.983 02:27:13 -- common/autotest_common.sh@10 -- # set +x 00:07:40.243 02:27:13 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:40.243 02:27:13 -- common/autotest_common.sh@850 -- # return 0 00:07:40.243 02:27:13 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:07:40.502 Malloc0 00:07:40.502 02:27:13 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:07:40.502 Malloc1 00:07:40.502 02:27:14 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:07:40.502 02:27:14 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:40.502 02:27:14 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:07:40.502 02:27:14 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:07:40.502 02:27:14 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:40.502 02:27:14 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:07:40.502 02:27:14 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:07:40.502 02:27:14 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:40.502 02:27:14 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:07:40.502 02:27:14 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:07:40.502 02:27:14 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:40.502 02:27:14 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:07:40.502 02:27:14 -- bdev/nbd_common.sh@12 -- # local i 00:07:40.502 02:27:14 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:07:40.502 02:27:14 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:07:40.502 02:27:14 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:07:40.761 /dev/nbd0 00:07:40.761 02:27:14 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:07:40.761 02:27:14 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:07:40.761 02:27:14 -- common/autotest_common.sh@854 -- # local nbd_name=nbd0 00:07:40.761 02:27:14 -- common/autotest_common.sh@855 -- # local i 00:07:40.761 02:27:14 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:07:40.761 02:27:14 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:07:40.761 02:27:14 -- common/autotest_common.sh@858 -- # grep -q -w nbd0 /proc/partitions 00:07:40.761 02:27:14 -- common/autotest_common.sh@859 -- # break 00:07:40.761 02:27:14 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:07:40.761 02:27:14 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:07:40.761 02:27:14 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:07:40.761 1+0 records in 00:07:40.761 1+0 records out 00:07:40.761 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000214945 s, 19.1 MB/s 00:07:40.761 02:27:14 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:07:40.761 02:27:14 -- common/autotest_common.sh@872 -- # size=4096 00:07:40.762 02:27:14 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:07:40.762 02:27:14 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:07:40.762 02:27:14 -- common/autotest_common.sh@875 -- # return 0 00:07:40.762 02:27:14 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:07:40.762 02:27:14 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:07:40.762 02:27:14 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:07:41.021 /dev/nbd1 00:07:41.021 02:27:14 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:07:41.021 02:27:14 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:07:41.021 02:27:14 -- common/autotest_common.sh@854 -- # local nbd_name=nbd1 00:07:41.021 02:27:14 -- common/autotest_common.sh@855 -- # local i 00:07:41.021 02:27:14 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:07:41.021 02:27:14 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:07:41.021 02:27:14 -- common/autotest_common.sh@858 -- # grep -q -w nbd1 /proc/partitions 00:07:41.021 02:27:14 -- common/autotest_common.sh@859 -- # break 00:07:41.021 02:27:14 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:07:41.021 02:27:14 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:07:41.021 02:27:14 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:07:41.021 1+0 records in 00:07:41.021 1+0 records out 00:07:41.021 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000223633 s, 18.3 MB/s 00:07:41.021 02:27:14 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:07:41.021 02:27:14 -- common/autotest_common.sh@872 -- # size=4096 00:07:41.021 02:27:14 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:07:41.021 02:27:14 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:07:41.021 02:27:14 -- common/autotest_common.sh@875 -- # return 0 00:07:41.021 02:27:14 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:07:41.021 02:27:14 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:07:41.021 02:27:14 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:07:41.021 02:27:14 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:41.021 02:27:14 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:07:41.280 02:27:14 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:07:41.280 { 00:07:41.280 "nbd_device": "/dev/nbd0", 00:07:41.280 "bdev_name": "Malloc0" 00:07:41.280 }, 00:07:41.280 { 00:07:41.280 "nbd_device": "/dev/nbd1", 00:07:41.280 "bdev_name": "Malloc1" 00:07:41.280 } 00:07:41.280 ]' 00:07:41.280 02:27:14 -- bdev/nbd_common.sh@64 -- # echo '[ 00:07:41.280 { 00:07:41.280 "nbd_device": "/dev/nbd0", 00:07:41.280 "bdev_name": "Malloc0" 00:07:41.280 }, 00:07:41.280 { 00:07:41.280 "nbd_device": "/dev/nbd1", 00:07:41.280 "bdev_name": "Malloc1" 00:07:41.280 } 00:07:41.280 ]' 00:07:41.280 02:27:14 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:07:41.280 02:27:14 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:07:41.280 /dev/nbd1' 00:07:41.280 02:27:14 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:07:41.280 /dev/nbd1' 00:07:41.280 02:27:14 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:07:41.280 02:27:14 -- bdev/nbd_common.sh@65 -- # count=2 00:07:41.280 02:27:14 -- bdev/nbd_common.sh@66 -- # echo 2 00:07:41.280 02:27:14 -- bdev/nbd_common.sh@95 -- # count=2 00:07:41.280 02:27:14 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:07:41.280 02:27:14 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:07:41.280 02:27:14 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:41.280 02:27:14 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:07:41.280 02:27:14 -- bdev/nbd_common.sh@71 -- # local operation=write 00:07:41.280 02:27:14 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:07:41.280 02:27:14 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:07:41.280 02:27:14 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:07:41.280 256+0 records in 00:07:41.280 256+0 records out 00:07:41.280 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114222 s, 91.8 MB/s 00:07:41.280 02:27:14 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:07:41.280 02:27:14 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:07:41.280 256+0 records in 00:07:41.280 256+0 records out 00:07:41.280 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193684 s, 54.1 MB/s 00:07:41.280 02:27:14 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:07:41.280 02:27:14 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:07:41.280 256+0 records in 00:07:41.280 256+0 records out 00:07:41.280 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215644 s, 48.6 MB/s 00:07:41.280 02:27:14 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:07:41.280 02:27:14 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:41.280 02:27:14 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:07:41.280 02:27:14 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:07:41.280 02:27:14 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:07:41.280 02:27:14 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:07:41.280 02:27:14 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:07:41.280 02:27:14 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:07:41.280 02:27:14 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:07:41.280 02:27:14 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:07:41.280 02:27:14 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:07:41.280 02:27:14 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:07:41.280 02:27:14 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:07:41.280 02:27:14 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:41.280 02:27:14 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:41.280 02:27:14 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:07:41.280 02:27:14 -- bdev/nbd_common.sh@51 -- # local i 00:07:41.280 02:27:14 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:07:41.280 02:27:14 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:07:41.539 02:27:15 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:07:41.539 02:27:15 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:07:41.539 02:27:15 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:07:41.539 02:27:15 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:07:41.539 02:27:15 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:07:41.539 02:27:15 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:07:41.539 02:27:15 -- bdev/nbd_common.sh@41 -- # break 00:07:41.539 02:27:15 -- bdev/nbd_common.sh@45 -- # return 0 00:07:41.539 02:27:15 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:07:41.539 02:27:15 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:07:41.798 02:27:15 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:07:41.798 02:27:15 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:07:41.798 02:27:15 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:07:41.798 02:27:15 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:07:41.798 02:27:15 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:07:41.798 02:27:15 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:07:41.798 02:27:15 -- bdev/nbd_common.sh@41 -- # break 00:07:41.798 02:27:15 -- bdev/nbd_common.sh@45 -- # return 0 00:07:41.798 02:27:15 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:07:41.798 02:27:15 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:41.799 02:27:15 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:07:42.058 02:27:15 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:07:42.058 02:27:15 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:07:42.058 02:27:15 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:07:42.058 02:27:15 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:07:42.058 02:27:15 -- bdev/nbd_common.sh@65 -- # echo '' 00:07:42.058 02:27:15 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:07:42.058 02:27:15 -- bdev/nbd_common.sh@65 -- # true 00:07:42.058 02:27:15 -- bdev/nbd_common.sh@65 -- # count=0 00:07:42.058 02:27:15 -- bdev/nbd_common.sh@66 -- # echo 0 00:07:42.058 02:27:15 -- bdev/nbd_common.sh@104 -- # count=0 00:07:42.058 02:27:15 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:07:42.058 02:27:15 -- bdev/nbd_common.sh@109 -- # return 0 00:07:42.058 02:27:15 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:07:42.058 02:27:15 -- event/event.sh@35 -- # sleep 3 00:07:42.318 [2024-04-27 02:27:15.896742] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:07:42.577 [2024-04-27 02:27:15.974072] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:42.577 [2024-04-27 02:27:15.974074] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:42.577 [2024-04-27 02:27:16.021280] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:07:42.578 [2024-04-27 02:27:16.021329] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:07:45.113 02:27:18 -- event/event.sh@38 -- # waitforlisten 1428857 /var/tmp/spdk-nbd.sock 00:07:45.113 02:27:18 -- common/autotest_common.sh@817 -- # '[' -z 1428857 ']' 00:07:45.113 02:27:18 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:07:45.113 02:27:18 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:45.113 02:27:18 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:07:45.113 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:07:45.113 02:27:18 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:45.113 02:27:18 -- common/autotest_common.sh@10 -- # set +x 00:07:45.373 02:27:18 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:45.373 02:27:18 -- common/autotest_common.sh@850 -- # return 0 00:07:45.373 02:27:18 -- event/event.sh@39 -- # killprocess 1428857 00:07:45.373 02:27:18 -- common/autotest_common.sh@936 -- # '[' -z 1428857 ']' 00:07:45.373 02:27:18 -- common/autotest_common.sh@940 -- # kill -0 1428857 00:07:45.373 02:27:18 -- common/autotest_common.sh@941 -- # uname 00:07:45.373 02:27:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:45.373 02:27:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1428857 00:07:45.373 02:27:18 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:45.373 02:27:18 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:45.373 02:27:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1428857' 00:07:45.373 killing process with pid 1428857 00:07:45.373 02:27:18 -- common/autotest_common.sh@955 -- # kill 1428857 00:07:45.373 02:27:18 -- common/autotest_common.sh@960 -- # wait 1428857 00:07:45.633 spdk_app_start is called in Round 0. 00:07:45.633 Shutdown signal received, stop current app iteration 00:07:45.633 Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 reinitialization... 00:07:45.633 spdk_app_start is called in Round 1. 00:07:45.633 Shutdown signal received, stop current app iteration 00:07:45.633 Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 reinitialization... 00:07:45.633 spdk_app_start is called in Round 2. 00:07:45.633 Shutdown signal received, stop current app iteration 00:07:45.633 Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 reinitialization... 00:07:45.633 spdk_app_start is called in Round 3. 00:07:45.633 Shutdown signal received, stop current app iteration 00:07:45.633 02:27:19 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:07:45.633 02:27:19 -- event/event.sh@42 -- # return 0 00:07:45.633 00:07:45.633 real 0m16.529s 00:07:45.633 user 0m34.991s 00:07:45.633 sys 0m3.124s 00:07:45.633 02:27:19 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:45.633 02:27:19 -- common/autotest_common.sh@10 -- # set +x 00:07:45.633 ************************************ 00:07:45.633 END TEST app_repeat 00:07:45.633 ************************************ 00:07:45.633 02:27:19 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:07:45.633 02:27:19 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/cpu_locks.sh 00:07:45.633 02:27:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:45.633 02:27:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:45.633 02:27:19 -- common/autotest_common.sh@10 -- # set +x 00:07:45.892 ************************************ 00:07:45.892 START TEST cpu_locks 00:07:45.892 ************************************ 00:07:45.892 02:27:19 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/cpu_locks.sh 00:07:45.892 * Looking for test storage... 00:07:45.892 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event 00:07:45.892 02:27:19 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:07:45.892 02:27:19 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:07:45.892 02:27:19 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:07:45.892 02:27:19 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:07:45.892 02:27:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:45.892 02:27:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:45.892 02:27:19 -- common/autotest_common.sh@10 -- # set +x 00:07:46.151 ************************************ 00:07:46.151 START TEST default_locks 00:07:46.151 ************************************ 00:07:46.151 02:27:19 -- common/autotest_common.sh@1111 -- # default_locks 00:07:46.151 02:27:19 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=1431784 00:07:46.151 02:27:19 -- event/cpu_locks.sh@47 -- # waitforlisten 1431784 00:07:46.151 02:27:19 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:07:46.151 02:27:19 -- common/autotest_common.sh@817 -- # '[' -z 1431784 ']' 00:07:46.151 02:27:19 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:46.152 02:27:19 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:46.152 02:27:19 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:46.152 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:46.152 02:27:19 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:46.152 02:27:19 -- common/autotest_common.sh@10 -- # set +x 00:07:46.152 [2024-04-27 02:27:19.621113] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:07:46.152 [2024-04-27 02:27:19.621166] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1431784 ] 00:07:46.152 EAL: No free 2048 kB hugepages reported on node 1 00:07:46.152 [2024-04-27 02:27:19.692075] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:46.410 [2024-04-27 02:27:19.778551] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:46.984 02:27:20 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:46.984 02:27:20 -- common/autotest_common.sh@850 -- # return 0 00:07:46.984 02:27:20 -- event/cpu_locks.sh@49 -- # locks_exist 1431784 00:07:46.984 02:27:20 -- event/cpu_locks.sh@22 -- # lslocks -p 1431784 00:07:46.984 02:27:20 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:07:47.552 lslocks: write error 00:07:47.552 02:27:21 -- event/cpu_locks.sh@50 -- # killprocess 1431784 00:07:47.552 02:27:21 -- common/autotest_common.sh@936 -- # '[' -z 1431784 ']' 00:07:47.552 02:27:21 -- common/autotest_common.sh@940 -- # kill -0 1431784 00:07:47.552 02:27:21 -- common/autotest_common.sh@941 -- # uname 00:07:47.552 02:27:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:47.552 02:27:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1431784 00:07:47.552 02:27:21 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:47.552 02:27:21 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:47.552 02:27:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1431784' 00:07:47.552 killing process with pid 1431784 00:07:47.552 02:27:21 -- common/autotest_common.sh@955 -- # kill 1431784 00:07:47.552 02:27:21 -- common/autotest_common.sh@960 -- # wait 1431784 00:07:48.120 02:27:21 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 1431784 00:07:48.120 02:27:21 -- common/autotest_common.sh@638 -- # local es=0 00:07:48.120 02:27:21 -- common/autotest_common.sh@640 -- # valid_exec_arg waitforlisten 1431784 00:07:48.120 02:27:21 -- common/autotest_common.sh@626 -- # local arg=waitforlisten 00:07:48.120 02:27:21 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:48.120 02:27:21 -- common/autotest_common.sh@630 -- # type -t waitforlisten 00:07:48.120 02:27:21 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:48.120 02:27:21 -- common/autotest_common.sh@641 -- # waitforlisten 1431784 00:07:48.120 02:27:21 -- common/autotest_common.sh@817 -- # '[' -z 1431784 ']' 00:07:48.120 02:27:21 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:48.120 02:27:21 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:48.120 02:27:21 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:48.120 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:48.120 02:27:21 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:48.120 02:27:21 -- common/autotest_common.sh@10 -- # set +x 00:07:48.120 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh: line 832: kill: (1431784) - No such process 00:07:48.120 ERROR: process (pid: 1431784) is no longer running 00:07:48.120 02:27:21 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:48.120 02:27:21 -- common/autotest_common.sh@850 -- # return 1 00:07:48.120 02:27:21 -- common/autotest_common.sh@641 -- # es=1 00:07:48.120 02:27:21 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:07:48.120 02:27:21 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:07:48.120 02:27:21 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:07:48.120 02:27:21 -- event/cpu_locks.sh@54 -- # no_locks 00:07:48.120 02:27:21 -- event/cpu_locks.sh@26 -- # lock_files=() 00:07:48.120 02:27:21 -- event/cpu_locks.sh@26 -- # local lock_files 00:07:48.120 02:27:21 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:07:48.120 00:07:48.120 real 0m1.961s 00:07:48.120 user 0m2.036s 00:07:48.120 sys 0m0.710s 00:07:48.120 02:27:21 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:48.120 02:27:21 -- common/autotest_common.sh@10 -- # set +x 00:07:48.120 ************************************ 00:07:48.120 END TEST default_locks 00:07:48.120 ************************************ 00:07:48.120 02:27:21 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:07:48.120 02:27:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:48.120 02:27:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:48.120 02:27:21 -- common/autotest_common.sh@10 -- # set +x 00:07:48.120 ************************************ 00:07:48.120 START TEST default_locks_via_rpc 00:07:48.120 ************************************ 00:07:48.120 02:27:21 -- common/autotest_common.sh@1111 -- # default_locks_via_rpc 00:07:48.120 02:27:21 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=1432055 00:07:48.120 02:27:21 -- event/cpu_locks.sh@63 -- # waitforlisten 1432055 00:07:48.120 02:27:21 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:07:48.120 02:27:21 -- common/autotest_common.sh@817 -- # '[' -z 1432055 ']' 00:07:48.120 02:27:21 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:48.120 02:27:21 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:48.120 02:27:21 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:48.120 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:48.120 02:27:21 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:48.120 02:27:21 -- common/autotest_common.sh@10 -- # set +x 00:07:48.379 [2024-04-27 02:27:21.788650] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:07:48.379 [2024-04-27 02:27:21.788712] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1432055 ] 00:07:48.379 EAL: No free 2048 kB hugepages reported on node 1 00:07:48.379 [2024-04-27 02:27:21.860772] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:48.379 [2024-04-27 02:27:21.950395] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:49.317 02:27:22 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:49.317 02:27:22 -- common/autotest_common.sh@850 -- # return 0 00:07:49.317 02:27:22 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:07:49.317 02:27:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:49.317 02:27:22 -- common/autotest_common.sh@10 -- # set +x 00:07:49.317 02:27:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:49.317 02:27:22 -- event/cpu_locks.sh@67 -- # no_locks 00:07:49.317 02:27:22 -- event/cpu_locks.sh@26 -- # lock_files=() 00:07:49.317 02:27:22 -- event/cpu_locks.sh@26 -- # local lock_files 00:07:49.317 02:27:22 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:07:49.317 02:27:22 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:07:49.317 02:27:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:49.317 02:27:22 -- common/autotest_common.sh@10 -- # set +x 00:07:49.317 02:27:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:49.317 02:27:22 -- event/cpu_locks.sh@71 -- # locks_exist 1432055 00:07:49.317 02:27:22 -- event/cpu_locks.sh@22 -- # lslocks -p 1432055 00:07:49.317 02:27:22 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:07:49.317 02:27:22 -- event/cpu_locks.sh@73 -- # killprocess 1432055 00:07:49.317 02:27:22 -- common/autotest_common.sh@936 -- # '[' -z 1432055 ']' 00:07:49.317 02:27:22 -- common/autotest_common.sh@940 -- # kill -0 1432055 00:07:49.317 02:27:22 -- common/autotest_common.sh@941 -- # uname 00:07:49.317 02:27:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:49.317 02:27:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1432055 00:07:49.317 02:27:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:49.317 02:27:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:49.317 02:27:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1432055' 00:07:49.317 killing process with pid 1432055 00:07:49.317 02:27:22 -- common/autotest_common.sh@955 -- # kill 1432055 00:07:49.317 02:27:22 -- common/autotest_common.sh@960 -- # wait 1432055 00:07:49.885 00:07:49.886 real 0m1.582s 00:07:49.886 user 0m1.634s 00:07:49.886 sys 0m0.525s 00:07:49.886 02:27:23 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:49.886 02:27:23 -- common/autotest_common.sh@10 -- # set +x 00:07:49.886 ************************************ 00:07:49.886 END TEST default_locks_via_rpc 00:07:49.886 ************************************ 00:07:49.886 02:27:23 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:07:49.886 02:27:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:49.886 02:27:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:49.886 02:27:23 -- common/autotest_common.sh@10 -- # set +x 00:07:50.144 ************************************ 00:07:50.144 START TEST non_locking_app_on_locked_coremask 00:07:50.144 ************************************ 00:07:50.144 02:27:23 -- common/autotest_common.sh@1111 -- # non_locking_app_on_locked_coremask 00:07:50.144 02:27:23 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=1432319 00:07:50.144 02:27:23 -- event/cpu_locks.sh@81 -- # waitforlisten 1432319 /var/tmp/spdk.sock 00:07:50.144 02:27:23 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:07:50.144 02:27:23 -- common/autotest_common.sh@817 -- # '[' -z 1432319 ']' 00:07:50.144 02:27:23 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:50.144 02:27:23 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:50.144 02:27:23 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:50.144 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:50.144 02:27:23 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:50.144 02:27:23 -- common/autotest_common.sh@10 -- # set +x 00:07:50.144 [2024-04-27 02:27:23.581661] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:07:50.144 [2024-04-27 02:27:23.581720] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1432319 ] 00:07:50.144 EAL: No free 2048 kB hugepages reported on node 1 00:07:50.144 [2024-04-27 02:27:23.655408] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:50.144 [2024-04-27 02:27:23.743347] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:51.079 02:27:24 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:51.079 02:27:24 -- common/autotest_common.sh@850 -- # return 0 00:07:51.079 02:27:24 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=1432463 00:07:51.079 02:27:24 -- event/cpu_locks.sh@85 -- # waitforlisten 1432463 /var/tmp/spdk2.sock 00:07:51.079 02:27:24 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:07:51.079 02:27:24 -- common/autotest_common.sh@817 -- # '[' -z 1432463 ']' 00:07:51.079 02:27:24 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:07:51.079 02:27:24 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:51.079 02:27:24 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:07:51.079 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:07:51.079 02:27:24 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:51.079 02:27:24 -- common/autotest_common.sh@10 -- # set +x 00:07:51.079 [2024-04-27 02:27:24.436711] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:07:51.079 [2024-04-27 02:27:24.436768] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1432463 ] 00:07:51.079 EAL: No free 2048 kB hugepages reported on node 1 00:07:51.079 [2024-04-27 02:27:24.532554] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:07:51.079 [2024-04-27 02:27:24.532586] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:51.337 [2024-04-27 02:27:24.715612] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:51.903 02:27:25 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:51.903 02:27:25 -- common/autotest_common.sh@850 -- # return 0 00:07:51.903 02:27:25 -- event/cpu_locks.sh@87 -- # locks_exist 1432319 00:07:51.903 02:27:25 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:07:51.903 02:27:25 -- event/cpu_locks.sh@22 -- # lslocks -p 1432319 00:07:52.836 lslocks: write error 00:07:52.836 02:27:26 -- event/cpu_locks.sh@89 -- # killprocess 1432319 00:07:52.836 02:27:26 -- common/autotest_common.sh@936 -- # '[' -z 1432319 ']' 00:07:52.836 02:27:26 -- common/autotest_common.sh@940 -- # kill -0 1432319 00:07:52.836 02:27:26 -- common/autotest_common.sh@941 -- # uname 00:07:52.836 02:27:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:52.836 02:27:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1432319 00:07:52.836 02:27:26 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:52.836 02:27:26 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:52.836 02:27:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1432319' 00:07:52.836 killing process with pid 1432319 00:07:52.836 02:27:26 -- common/autotest_common.sh@955 -- # kill 1432319 00:07:52.836 02:27:26 -- common/autotest_common.sh@960 -- # wait 1432319 00:07:53.402 02:27:26 -- event/cpu_locks.sh@90 -- # killprocess 1432463 00:07:53.402 02:27:26 -- common/autotest_common.sh@936 -- # '[' -z 1432463 ']' 00:07:53.402 02:27:26 -- common/autotest_common.sh@940 -- # kill -0 1432463 00:07:53.402 02:27:26 -- common/autotest_common.sh@941 -- # uname 00:07:53.402 02:27:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:53.402 02:27:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1432463 00:07:53.402 02:27:26 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:53.402 02:27:26 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:53.402 02:27:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1432463' 00:07:53.402 killing process with pid 1432463 00:07:53.402 02:27:26 -- common/autotest_common.sh@955 -- # kill 1432463 00:07:53.402 02:27:26 -- common/autotest_common.sh@960 -- # wait 1432463 00:07:53.969 00:07:53.969 real 0m3.834s 00:07:53.969 user 0m4.051s 00:07:53.969 sys 0m1.188s 00:07:53.969 02:27:27 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:53.969 02:27:27 -- common/autotest_common.sh@10 -- # set +x 00:07:53.969 ************************************ 00:07:53.969 END TEST non_locking_app_on_locked_coremask 00:07:53.969 ************************************ 00:07:53.969 02:27:27 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:07:53.969 02:27:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:53.969 02:27:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:53.969 02:27:27 -- common/autotest_common.sh@10 -- # set +x 00:07:53.969 ************************************ 00:07:53.969 START TEST locking_app_on_unlocked_coremask 00:07:53.969 ************************************ 00:07:53.969 02:27:27 -- common/autotest_common.sh@1111 -- # locking_app_on_unlocked_coremask 00:07:53.969 02:27:27 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=1432876 00:07:53.969 02:27:27 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:07:53.969 02:27:27 -- event/cpu_locks.sh@99 -- # waitforlisten 1432876 /var/tmp/spdk.sock 00:07:53.969 02:27:27 -- common/autotest_common.sh@817 -- # '[' -z 1432876 ']' 00:07:53.969 02:27:27 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:53.969 02:27:27 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:53.969 02:27:27 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:53.969 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:53.969 02:27:27 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:53.969 02:27:27 -- common/autotest_common.sh@10 -- # set +x 00:07:54.227 [2024-04-27 02:27:27.613710] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:07:54.227 [2024-04-27 02:27:27.613767] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1432876 ] 00:07:54.227 EAL: No free 2048 kB hugepages reported on node 1 00:07:54.227 [2024-04-27 02:27:27.686756] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:07:54.227 [2024-04-27 02:27:27.686786] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:54.227 [2024-04-27 02:27:27.776749] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:54.794 02:27:28 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:54.794 02:27:28 -- common/autotest_common.sh@850 -- # return 0 00:07:54.794 02:27:28 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:07:54.794 02:27:28 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=1433055 00:07:54.794 02:27:28 -- event/cpu_locks.sh@103 -- # waitforlisten 1433055 /var/tmp/spdk2.sock 00:07:54.794 02:27:28 -- common/autotest_common.sh@817 -- # '[' -z 1433055 ']' 00:07:54.794 02:27:28 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:07:54.794 02:27:28 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:54.794 02:27:28 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:07:54.794 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:07:54.794 02:27:28 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:54.794 02:27:28 -- common/autotest_common.sh@10 -- # set +x 00:07:55.052 [2024-04-27 02:27:28.460198] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:07:55.052 [2024-04-27 02:27:28.460255] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1433055 ] 00:07:55.052 EAL: No free 2048 kB hugepages reported on node 1 00:07:55.052 [2024-04-27 02:27:28.556204] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:55.311 [2024-04-27 02:27:28.722284] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:55.877 02:27:29 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:55.877 02:27:29 -- common/autotest_common.sh@850 -- # return 0 00:07:55.877 02:27:29 -- event/cpu_locks.sh@105 -- # locks_exist 1433055 00:07:55.877 02:27:29 -- event/cpu_locks.sh@22 -- # lslocks -p 1433055 00:07:55.877 02:27:29 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:07:57.286 lslocks: write error 00:07:57.286 02:27:30 -- event/cpu_locks.sh@107 -- # killprocess 1432876 00:07:57.286 02:27:30 -- common/autotest_common.sh@936 -- # '[' -z 1432876 ']' 00:07:57.286 02:27:30 -- common/autotest_common.sh@940 -- # kill -0 1432876 00:07:57.286 02:27:30 -- common/autotest_common.sh@941 -- # uname 00:07:57.286 02:27:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:57.286 02:27:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1432876 00:07:57.286 02:27:30 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:57.286 02:27:30 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:57.286 02:27:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1432876' 00:07:57.286 killing process with pid 1432876 00:07:57.286 02:27:30 -- common/autotest_common.sh@955 -- # kill 1432876 00:07:57.286 02:27:30 -- common/autotest_common.sh@960 -- # wait 1432876 00:07:57.853 02:27:31 -- event/cpu_locks.sh@108 -- # killprocess 1433055 00:07:57.853 02:27:31 -- common/autotest_common.sh@936 -- # '[' -z 1433055 ']' 00:07:57.853 02:27:31 -- common/autotest_common.sh@940 -- # kill -0 1433055 00:07:57.853 02:27:31 -- common/autotest_common.sh@941 -- # uname 00:07:57.853 02:27:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:57.853 02:27:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1433055 00:07:57.853 02:27:31 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:57.853 02:27:31 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:57.853 02:27:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1433055' 00:07:57.853 killing process with pid 1433055 00:07:57.853 02:27:31 -- common/autotest_common.sh@955 -- # kill 1433055 00:07:57.853 02:27:31 -- common/autotest_common.sh@960 -- # wait 1433055 00:07:58.423 00:07:58.423 real 0m4.263s 00:07:58.423 user 0m4.494s 00:07:58.423 sys 0m1.427s 00:07:58.423 02:27:31 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:58.423 02:27:31 -- common/autotest_common.sh@10 -- # set +x 00:07:58.423 ************************************ 00:07:58.423 END TEST locking_app_on_unlocked_coremask 00:07:58.423 ************************************ 00:07:58.423 02:27:31 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:07:58.423 02:27:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:58.423 02:27:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:58.423 02:27:31 -- common/autotest_common.sh@10 -- # set +x 00:07:58.423 ************************************ 00:07:58.423 START TEST locking_app_on_locked_coremask 00:07:58.423 ************************************ 00:07:58.423 02:27:32 -- common/autotest_common.sh@1111 -- # locking_app_on_locked_coremask 00:07:58.423 02:27:32 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=1433632 00:07:58.423 02:27:32 -- event/cpu_locks.sh@116 -- # waitforlisten 1433632 /var/tmp/spdk.sock 00:07:58.423 02:27:32 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:07:58.423 02:27:32 -- common/autotest_common.sh@817 -- # '[' -z 1433632 ']' 00:07:58.423 02:27:32 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:58.423 02:27:32 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:58.423 02:27:32 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:58.423 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:58.423 02:27:32 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:58.423 02:27:32 -- common/autotest_common.sh@10 -- # set +x 00:07:58.683 [2024-04-27 02:27:32.075833] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:07:58.683 [2024-04-27 02:27:32.075888] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1433632 ] 00:07:58.683 EAL: No free 2048 kB hugepages reported on node 1 00:07:58.683 [2024-04-27 02:27:32.147085] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:58.683 [2024-04-27 02:27:32.233146] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:59.617 02:27:32 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:59.617 02:27:32 -- common/autotest_common.sh@850 -- # return 0 00:07:59.618 02:27:32 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=1433650 00:07:59.618 02:27:32 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 1433650 /var/tmp/spdk2.sock 00:07:59.618 02:27:32 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:07:59.618 02:27:32 -- common/autotest_common.sh@638 -- # local es=0 00:07:59.618 02:27:32 -- common/autotest_common.sh@640 -- # valid_exec_arg waitforlisten 1433650 /var/tmp/spdk2.sock 00:07:59.618 02:27:32 -- common/autotest_common.sh@626 -- # local arg=waitforlisten 00:07:59.618 02:27:32 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:59.618 02:27:32 -- common/autotest_common.sh@630 -- # type -t waitforlisten 00:07:59.618 02:27:32 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:59.618 02:27:32 -- common/autotest_common.sh@641 -- # waitforlisten 1433650 /var/tmp/spdk2.sock 00:07:59.618 02:27:32 -- common/autotest_common.sh@817 -- # '[' -z 1433650 ']' 00:07:59.618 02:27:32 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:07:59.618 02:27:32 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:59.618 02:27:32 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:07:59.618 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:07:59.618 02:27:32 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:59.618 02:27:32 -- common/autotest_common.sh@10 -- # set +x 00:07:59.618 [2024-04-27 02:27:32.935508] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:07:59.618 [2024-04-27 02:27:32.935566] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1433650 ] 00:07:59.618 EAL: No free 2048 kB hugepages reported on node 1 00:07:59.618 [2024-04-27 02:27:33.038821] app.c: 690:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 1433632 has claimed it. 00:07:59.618 [2024-04-27 02:27:33.038862] app.c: 821:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:08:00.183 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh: line 832: kill: (1433650) - No such process 00:08:00.183 ERROR: process (pid: 1433650) is no longer running 00:08:00.183 02:27:33 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:08:00.183 02:27:33 -- common/autotest_common.sh@850 -- # return 1 00:08:00.183 02:27:33 -- common/autotest_common.sh@641 -- # es=1 00:08:00.183 02:27:33 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:08:00.183 02:27:33 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:08:00.183 02:27:33 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:08:00.183 02:27:33 -- event/cpu_locks.sh@122 -- # locks_exist 1433632 00:08:00.183 02:27:33 -- event/cpu_locks.sh@22 -- # lslocks -p 1433632 00:08:00.184 02:27:33 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:08:00.750 lslocks: write error 00:08:00.750 02:27:34 -- event/cpu_locks.sh@124 -- # killprocess 1433632 00:08:00.750 02:27:34 -- common/autotest_common.sh@936 -- # '[' -z 1433632 ']' 00:08:00.750 02:27:34 -- common/autotest_common.sh@940 -- # kill -0 1433632 00:08:00.750 02:27:34 -- common/autotest_common.sh@941 -- # uname 00:08:00.750 02:27:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:00.750 02:27:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1433632 00:08:00.750 02:27:34 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:00.750 02:27:34 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:00.750 02:27:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1433632' 00:08:00.750 killing process with pid 1433632 00:08:00.750 02:27:34 -- common/autotest_common.sh@955 -- # kill 1433632 00:08:00.750 02:27:34 -- common/autotest_common.sh@960 -- # wait 1433632 00:08:01.318 00:08:01.318 real 0m2.626s 00:08:01.318 user 0m2.846s 00:08:01.318 sys 0m0.854s 00:08:01.318 02:27:34 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:01.319 02:27:34 -- common/autotest_common.sh@10 -- # set +x 00:08:01.319 ************************************ 00:08:01.319 END TEST locking_app_on_locked_coremask 00:08:01.319 ************************************ 00:08:01.319 02:27:34 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:08:01.319 02:27:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:08:01.319 02:27:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:01.319 02:27:34 -- common/autotest_common.sh@10 -- # set +x 00:08:01.319 ************************************ 00:08:01.319 START TEST locking_overlapped_coremask 00:08:01.319 ************************************ 00:08:01.319 02:27:34 -- common/autotest_common.sh@1111 -- # locking_overlapped_coremask 00:08:01.319 02:27:34 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=1434039 00:08:01.319 02:27:34 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:08:01.319 02:27:34 -- event/cpu_locks.sh@133 -- # waitforlisten 1434039 /var/tmp/spdk.sock 00:08:01.319 02:27:34 -- common/autotest_common.sh@817 -- # '[' -z 1434039 ']' 00:08:01.319 02:27:34 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:01.319 02:27:34 -- common/autotest_common.sh@822 -- # local max_retries=100 00:08:01.319 02:27:34 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:01.319 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:01.319 02:27:34 -- common/autotest_common.sh@826 -- # xtrace_disable 00:08:01.319 02:27:34 -- common/autotest_common.sh@10 -- # set +x 00:08:01.319 [2024-04-27 02:27:34.906629] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:08:01.319 [2024-04-27 02:27:34.906688] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1434039 ] 00:08:01.319 EAL: No free 2048 kB hugepages reported on node 1 00:08:01.578 [2024-04-27 02:27:34.978129] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:08:01.578 [2024-04-27 02:27:35.063594] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:01.578 [2024-04-27 02:27:35.063684] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:01.578 [2024-04-27 02:27:35.063681] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:02.144 02:27:35 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:08:02.144 02:27:35 -- common/autotest_common.sh@850 -- # return 0 00:08:02.144 02:27:35 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=1434066 00:08:02.144 02:27:35 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 1434066 /var/tmp/spdk2.sock 00:08:02.144 02:27:35 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:08:02.144 02:27:35 -- common/autotest_common.sh@638 -- # local es=0 00:08:02.144 02:27:35 -- common/autotest_common.sh@640 -- # valid_exec_arg waitforlisten 1434066 /var/tmp/spdk2.sock 00:08:02.144 02:27:35 -- common/autotest_common.sh@626 -- # local arg=waitforlisten 00:08:02.144 02:27:35 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:08:02.144 02:27:35 -- common/autotest_common.sh@630 -- # type -t waitforlisten 00:08:02.144 02:27:35 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:08:02.144 02:27:35 -- common/autotest_common.sh@641 -- # waitforlisten 1434066 /var/tmp/spdk2.sock 00:08:02.144 02:27:35 -- common/autotest_common.sh@817 -- # '[' -z 1434066 ']' 00:08:02.144 02:27:35 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:08:02.144 02:27:35 -- common/autotest_common.sh@822 -- # local max_retries=100 00:08:02.144 02:27:35 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:08:02.144 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:08:02.144 02:27:35 -- common/autotest_common.sh@826 -- # xtrace_disable 00:08:02.144 02:27:35 -- common/autotest_common.sh@10 -- # set +x 00:08:02.144 [2024-04-27 02:27:35.753175] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:08:02.144 [2024-04-27 02:27:35.753234] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1434066 ] 00:08:02.403 EAL: No free 2048 kB hugepages reported on node 1 00:08:02.403 [2024-04-27 02:27:35.854799] app.c: 690:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 1434039 has claimed it. 00:08:02.403 [2024-04-27 02:27:35.854841] app.c: 821:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:08:02.970 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh: line 832: kill: (1434066) - No such process 00:08:02.970 ERROR: process (pid: 1434066) is no longer running 00:08:02.970 02:27:36 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:08:02.970 02:27:36 -- common/autotest_common.sh@850 -- # return 1 00:08:02.970 02:27:36 -- common/autotest_common.sh@641 -- # es=1 00:08:02.970 02:27:36 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:08:02.970 02:27:36 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:08:02.970 02:27:36 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:08:02.970 02:27:36 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:08:02.970 02:27:36 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:08:02.970 02:27:36 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:08:02.970 02:27:36 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:08:02.970 02:27:36 -- event/cpu_locks.sh@141 -- # killprocess 1434039 00:08:02.970 02:27:36 -- common/autotest_common.sh@936 -- # '[' -z 1434039 ']' 00:08:02.970 02:27:36 -- common/autotest_common.sh@940 -- # kill -0 1434039 00:08:02.970 02:27:36 -- common/autotest_common.sh@941 -- # uname 00:08:02.970 02:27:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:02.970 02:27:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1434039 00:08:02.970 02:27:36 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:02.970 02:27:36 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:02.970 02:27:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1434039' 00:08:02.970 killing process with pid 1434039 00:08:02.970 02:27:36 -- common/autotest_common.sh@955 -- # kill 1434039 00:08:02.970 02:27:36 -- common/autotest_common.sh@960 -- # wait 1434039 00:08:03.229 00:08:03.229 real 0m1.948s 00:08:03.229 user 0m5.363s 00:08:03.229 sys 0m0.463s 00:08:03.229 02:27:36 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:03.229 02:27:36 -- common/autotest_common.sh@10 -- # set +x 00:08:03.229 ************************************ 00:08:03.229 END TEST locking_overlapped_coremask 00:08:03.229 ************************************ 00:08:03.229 02:27:36 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:08:03.229 02:27:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:08:03.229 02:27:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:03.229 02:27:36 -- common/autotest_common.sh@10 -- # set +x 00:08:03.488 ************************************ 00:08:03.488 START TEST locking_overlapped_coremask_via_rpc 00:08:03.488 ************************************ 00:08:03.488 02:27:37 -- common/autotest_common.sh@1111 -- # locking_overlapped_coremask_via_rpc 00:08:03.488 02:27:37 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=1434277 00:08:03.488 02:27:37 -- event/cpu_locks.sh@149 -- # waitforlisten 1434277 /var/tmp/spdk.sock 00:08:03.488 02:27:37 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:08:03.488 02:27:37 -- common/autotest_common.sh@817 -- # '[' -z 1434277 ']' 00:08:03.488 02:27:37 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:03.488 02:27:37 -- common/autotest_common.sh@822 -- # local max_retries=100 00:08:03.489 02:27:37 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:03.489 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:03.489 02:27:37 -- common/autotest_common.sh@826 -- # xtrace_disable 00:08:03.489 02:27:37 -- common/autotest_common.sh@10 -- # set +x 00:08:03.489 [2024-04-27 02:27:37.056632] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:08:03.489 [2024-04-27 02:27:37.056691] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1434277 ] 00:08:03.489 EAL: No free 2048 kB hugepages reported on node 1 00:08:03.747 [2024-04-27 02:27:37.129060] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:08:03.747 [2024-04-27 02:27:37.129090] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:08:03.747 [2024-04-27 02:27:37.216752] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:03.747 [2024-04-27 02:27:37.216836] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:03.747 [2024-04-27 02:27:37.216839] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:04.315 02:27:37 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:08:04.315 02:27:37 -- common/autotest_common.sh@850 -- # return 0 00:08:04.315 02:27:37 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=1434460 00:08:04.315 02:27:37 -- event/cpu_locks.sh@153 -- # waitforlisten 1434460 /var/tmp/spdk2.sock 00:08:04.315 02:27:37 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:08:04.315 02:27:37 -- common/autotest_common.sh@817 -- # '[' -z 1434460 ']' 00:08:04.315 02:27:37 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:08:04.315 02:27:37 -- common/autotest_common.sh@822 -- # local max_retries=100 00:08:04.315 02:27:37 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:08:04.315 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:08:04.315 02:27:37 -- common/autotest_common.sh@826 -- # xtrace_disable 00:08:04.315 02:27:37 -- common/autotest_common.sh@10 -- # set +x 00:08:04.315 [2024-04-27 02:27:37.911318] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:08:04.315 [2024-04-27 02:27:37.911386] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1434460 ] 00:08:04.574 EAL: No free 2048 kB hugepages reported on node 1 00:08:04.574 [2024-04-27 02:27:38.010655] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:08:04.574 [2024-04-27 02:27:38.010686] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:08:04.574 [2024-04-27 02:27:38.171378] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:04.574 [2024-04-27 02:27:38.171488] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:04.574 [2024-04-27 02:27:38.171489] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:08:05.144 02:27:38 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:08:05.144 02:27:38 -- common/autotest_common.sh@850 -- # return 0 00:08:05.144 02:27:38 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:08:05.144 02:27:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:05.144 02:27:38 -- common/autotest_common.sh@10 -- # set +x 00:08:05.144 02:27:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:05.144 02:27:38 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:08:05.144 02:27:38 -- common/autotest_common.sh@638 -- # local es=0 00:08:05.144 02:27:38 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:08:05.144 02:27:38 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:08:05.144 02:27:38 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:08:05.144 02:27:38 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:08:05.144 02:27:38 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:08:05.144 02:27:38 -- common/autotest_common.sh@641 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:08:05.144 02:27:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:05.144 02:27:38 -- common/autotest_common.sh@10 -- # set +x 00:08:05.144 [2024-04-27 02:27:38.730419] app.c: 690:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 1434277 has claimed it. 00:08:05.144 request: 00:08:05.144 { 00:08:05.144 "method": "framework_enable_cpumask_locks", 00:08:05.144 "req_id": 1 00:08:05.144 } 00:08:05.144 Got JSON-RPC error response 00:08:05.144 response: 00:08:05.144 { 00:08:05.144 "code": -32603, 00:08:05.144 "message": "Failed to claim CPU core: 2" 00:08:05.144 } 00:08:05.144 02:27:38 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:08:05.144 02:27:38 -- common/autotest_common.sh@641 -- # es=1 00:08:05.144 02:27:38 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:08:05.144 02:27:38 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:08:05.144 02:27:38 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:08:05.144 02:27:38 -- event/cpu_locks.sh@158 -- # waitforlisten 1434277 /var/tmp/spdk.sock 00:08:05.144 02:27:38 -- common/autotest_common.sh@817 -- # '[' -z 1434277 ']' 00:08:05.144 02:27:38 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:05.144 02:27:38 -- common/autotest_common.sh@822 -- # local max_retries=100 00:08:05.144 02:27:38 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:05.144 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:05.144 02:27:38 -- common/autotest_common.sh@826 -- # xtrace_disable 00:08:05.144 02:27:38 -- common/autotest_common.sh@10 -- # set +x 00:08:05.403 02:27:38 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:08:05.403 02:27:38 -- common/autotest_common.sh@850 -- # return 0 00:08:05.403 02:27:38 -- event/cpu_locks.sh@159 -- # waitforlisten 1434460 /var/tmp/spdk2.sock 00:08:05.403 02:27:38 -- common/autotest_common.sh@817 -- # '[' -z 1434460 ']' 00:08:05.403 02:27:38 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:08:05.403 02:27:38 -- common/autotest_common.sh@822 -- # local max_retries=100 00:08:05.403 02:27:38 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:08:05.403 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:08:05.403 02:27:38 -- common/autotest_common.sh@826 -- # xtrace_disable 00:08:05.403 02:27:38 -- common/autotest_common.sh@10 -- # set +x 00:08:05.663 02:27:39 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:08:05.663 02:27:39 -- common/autotest_common.sh@850 -- # return 0 00:08:05.663 02:27:39 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:08:05.663 02:27:39 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:08:05.663 02:27:39 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:08:05.663 02:27:39 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:08:05.663 00:08:05.663 real 0m2.090s 00:08:05.663 user 0m0.830s 00:08:05.663 sys 0m0.199s 00:08:05.663 02:27:39 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:05.663 02:27:39 -- common/autotest_common.sh@10 -- # set +x 00:08:05.663 ************************************ 00:08:05.663 END TEST locking_overlapped_coremask_via_rpc 00:08:05.663 ************************************ 00:08:05.663 02:27:39 -- event/cpu_locks.sh@174 -- # cleanup 00:08:05.663 02:27:39 -- event/cpu_locks.sh@15 -- # [[ -z 1434277 ]] 00:08:05.663 02:27:39 -- event/cpu_locks.sh@15 -- # killprocess 1434277 00:08:05.663 02:27:39 -- common/autotest_common.sh@936 -- # '[' -z 1434277 ']' 00:08:05.663 02:27:39 -- common/autotest_common.sh@940 -- # kill -0 1434277 00:08:05.663 02:27:39 -- common/autotest_common.sh@941 -- # uname 00:08:05.663 02:27:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:05.663 02:27:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1434277 00:08:05.663 02:27:39 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:05.663 02:27:39 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:05.663 02:27:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1434277' 00:08:05.663 killing process with pid 1434277 00:08:05.663 02:27:39 -- common/autotest_common.sh@955 -- # kill 1434277 00:08:05.663 02:27:39 -- common/autotest_common.sh@960 -- # wait 1434277 00:08:06.231 02:27:39 -- event/cpu_locks.sh@16 -- # [[ -z 1434460 ]] 00:08:06.231 02:27:39 -- event/cpu_locks.sh@16 -- # killprocess 1434460 00:08:06.231 02:27:39 -- common/autotest_common.sh@936 -- # '[' -z 1434460 ']' 00:08:06.231 02:27:39 -- common/autotest_common.sh@940 -- # kill -0 1434460 00:08:06.231 02:27:39 -- common/autotest_common.sh@941 -- # uname 00:08:06.231 02:27:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:06.231 02:27:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1434460 00:08:06.231 02:27:39 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:08:06.231 02:27:39 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:08:06.231 02:27:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1434460' 00:08:06.231 killing process with pid 1434460 00:08:06.231 02:27:39 -- common/autotest_common.sh@955 -- # kill 1434460 00:08:06.231 02:27:39 -- common/autotest_common.sh@960 -- # wait 1434460 00:08:06.489 02:27:40 -- event/cpu_locks.sh@18 -- # rm -f 00:08:06.489 02:27:40 -- event/cpu_locks.sh@1 -- # cleanup 00:08:06.489 02:27:40 -- event/cpu_locks.sh@15 -- # [[ -z 1434277 ]] 00:08:06.489 02:27:40 -- event/cpu_locks.sh@15 -- # killprocess 1434277 00:08:06.489 02:27:40 -- common/autotest_common.sh@936 -- # '[' -z 1434277 ']' 00:08:06.489 02:27:40 -- common/autotest_common.sh@940 -- # kill -0 1434277 00:08:06.489 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1434277) - No such process 00:08:06.489 02:27:40 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1434277 is not found' 00:08:06.489 Process with pid 1434277 is not found 00:08:06.489 02:27:40 -- event/cpu_locks.sh@16 -- # [[ -z 1434460 ]] 00:08:06.489 02:27:40 -- event/cpu_locks.sh@16 -- # killprocess 1434460 00:08:06.489 02:27:40 -- common/autotest_common.sh@936 -- # '[' -z 1434460 ']' 00:08:06.489 02:27:40 -- common/autotest_common.sh@940 -- # kill -0 1434460 00:08:06.489 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1434460) - No such process 00:08:06.489 02:27:40 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1434460 is not found' 00:08:06.489 Process with pid 1434460 is not found 00:08:06.489 02:27:40 -- event/cpu_locks.sh@18 -- # rm -f 00:08:06.489 00:08:06.489 real 0m20.725s 00:08:06.489 user 0m32.396s 00:08:06.489 sys 0m6.839s 00:08:06.489 02:27:40 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:06.489 02:27:40 -- common/autotest_common.sh@10 -- # set +x 00:08:06.489 ************************************ 00:08:06.489 END TEST cpu_locks 00:08:06.489 ************************************ 00:08:06.489 00:08:06.489 real 0m47.960s 00:08:06.489 user 1m23.403s 00:08:06.489 sys 0m11.551s 00:08:06.490 02:27:40 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:06.490 02:27:40 -- common/autotest_common.sh@10 -- # set +x 00:08:06.490 ************************************ 00:08:06.490 END TEST event 00:08:06.490 ************************************ 00:08:06.749 02:27:40 -- spdk/autotest.sh@178 -- # run_test thread /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread/thread.sh 00:08:06.749 02:27:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:08:06.749 02:27:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:06.749 02:27:40 -- common/autotest_common.sh@10 -- # set +x 00:08:06.749 ************************************ 00:08:06.749 START TEST thread 00:08:06.749 ************************************ 00:08:06.749 02:27:40 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread/thread.sh 00:08:06.749 * Looking for test storage... 00:08:06.749 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread 00:08:06.749 02:27:40 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:08:06.749 02:27:40 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:08:06.749 02:27:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:06.749 02:27:40 -- common/autotest_common.sh@10 -- # set +x 00:08:07.008 ************************************ 00:08:07.008 START TEST thread_poller_perf 00:08:07.008 ************************************ 00:08:07.008 02:27:40 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:08:07.008 [2024-04-27 02:27:40.528258] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:08:07.008 [2024-04-27 02:27:40.528370] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1434935 ] 00:08:07.008 EAL: No free 2048 kB hugepages reported on node 1 00:08:07.008 [2024-04-27 02:27:40.603053] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:07.268 [2024-04-27 02:27:40.688627] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:07.268 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:08:08.205 ====================================== 00:08:08.205 busy:2308543984 (cyc) 00:08:08.205 total_run_count: 418000 00:08:08.205 tsc_hz: 2300000000 (cyc) 00:08:08.205 ====================================== 00:08:08.205 poller_cost: 5522 (cyc), 2400 (nsec) 00:08:08.205 00:08:08.205 real 0m1.291s 00:08:08.205 user 0m1.186s 00:08:08.205 sys 0m0.099s 00:08:08.205 02:27:41 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:08.205 02:27:41 -- common/autotest_common.sh@10 -- # set +x 00:08:08.205 ************************************ 00:08:08.205 END TEST thread_poller_perf 00:08:08.205 ************************************ 00:08:08.465 02:27:41 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:08:08.465 02:27:41 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:08:08.465 02:27:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:08.465 02:27:41 -- common/autotest_common.sh@10 -- # set +x 00:08:08.465 ************************************ 00:08:08.465 START TEST thread_poller_perf 00:08:08.465 ************************************ 00:08:08.465 02:27:42 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:08:08.465 [2024-04-27 02:27:42.031771] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:08:08.465 [2024-04-27 02:27:42.031856] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1435144 ] 00:08:08.465 EAL: No free 2048 kB hugepages reported on node 1 00:08:08.725 [2024-04-27 02:27:42.106451] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:08.725 [2024-04-27 02:27:42.192364] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:08.725 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:08:10.101 ====================================== 00:08:10.101 busy:2301590062 (cyc) 00:08:10.101 total_run_count: 5437000 00:08:10.101 tsc_hz: 2300000000 (cyc) 00:08:10.101 ====================================== 00:08:10.101 poller_cost: 423 (cyc), 183 (nsec) 00:08:10.101 00:08:10.101 real 0m1.284s 00:08:10.101 user 0m1.184s 00:08:10.101 sys 0m0.095s 00:08:10.101 02:27:43 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:10.101 02:27:43 -- common/autotest_common.sh@10 -- # set +x 00:08:10.101 ************************************ 00:08:10.101 END TEST thread_poller_perf 00:08:10.101 ************************************ 00:08:10.101 02:27:43 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:08:10.101 00:08:10.101 real 0m3.069s 00:08:10.101 user 0m2.542s 00:08:10.101 sys 0m0.485s 00:08:10.101 02:27:43 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:10.101 02:27:43 -- common/autotest_common.sh@10 -- # set +x 00:08:10.101 ************************************ 00:08:10.101 END TEST thread 00:08:10.101 ************************************ 00:08:10.102 02:27:43 -- spdk/autotest.sh@179 -- # run_test accel /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/accel.sh 00:08:10.102 02:27:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:08:10.102 02:27:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:10.102 02:27:43 -- common/autotest_common.sh@10 -- # set +x 00:08:10.102 ************************************ 00:08:10.102 START TEST accel 00:08:10.102 ************************************ 00:08:10.102 02:27:43 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/accel.sh 00:08:10.102 * Looking for test storage... 00:08:10.102 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel 00:08:10.102 02:27:43 -- accel/accel.sh@81 -- # declare -A expected_opcs 00:08:10.102 02:27:43 -- accel/accel.sh@82 -- # get_expected_opcs 00:08:10.102 02:27:43 -- accel/accel.sh@60 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:08:10.102 02:27:43 -- accel/accel.sh@62 -- # spdk_tgt_pid=1435396 00:08:10.102 02:27:43 -- accel/accel.sh@63 -- # waitforlisten 1435396 00:08:10.102 02:27:43 -- common/autotest_common.sh@817 -- # '[' -z 1435396 ']' 00:08:10.102 02:27:43 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:10.102 02:27:43 -- common/autotest_common.sh@822 -- # local max_retries=100 00:08:10.102 02:27:43 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:10.102 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:10.102 02:27:43 -- common/autotest_common.sh@826 -- # xtrace_disable 00:08:10.102 02:27:43 -- common/autotest_common.sh@10 -- # set +x 00:08:10.102 02:27:43 -- accel/accel.sh@61 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:08:10.102 02:27:43 -- accel/accel.sh@61 -- # build_accel_config 00:08:10.102 02:27:43 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:08:10.102 02:27:43 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:08:10.102 02:27:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:10.102 02:27:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:10.102 02:27:43 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:08:10.102 02:27:43 -- accel/accel.sh@40 -- # local IFS=, 00:08:10.102 02:27:43 -- accel/accel.sh@41 -- # jq -r . 00:08:10.102 [2024-04-27 02:27:43.684668] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:08:10.102 [2024-04-27 02:27:43.684729] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1435396 ] 00:08:10.102 EAL: No free 2048 kB hugepages reported on node 1 00:08:10.361 [2024-04-27 02:27:43.757400] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:10.361 [2024-04-27 02:27:43.844621] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:10.929 02:27:44 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:08:10.929 02:27:44 -- common/autotest_common.sh@850 -- # return 0 00:08:10.929 02:27:44 -- accel/accel.sh@65 -- # [[ 0 -gt 0 ]] 00:08:10.929 02:27:44 -- accel/accel.sh@66 -- # [[ 0 -gt 0 ]] 00:08:10.929 02:27:44 -- accel/accel.sh@67 -- # [[ 0 -gt 0 ]] 00:08:10.929 02:27:44 -- accel/accel.sh@68 -- # [[ -n '' ]] 00:08:10.929 02:27:44 -- accel/accel.sh@70 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:08:10.929 02:27:44 -- accel/accel.sh@70 -- # rpc_cmd accel_get_opc_assignments 00:08:10.929 02:27:44 -- accel/accel.sh@70 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:08:10.929 02:27:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:10.929 02:27:44 -- common/autotest_common.sh@10 -- # set +x 00:08:10.929 02:27:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:10.929 02:27:44 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:08:10.929 02:27:44 -- accel/accel.sh@72 -- # IFS== 00:08:10.929 02:27:44 -- accel/accel.sh@72 -- # read -r opc module 00:08:10.929 02:27:44 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:08:10.929 02:27:44 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:08:10.929 02:27:44 -- accel/accel.sh@72 -- # IFS== 00:08:10.929 02:27:44 -- accel/accel.sh@72 -- # read -r opc module 00:08:10.929 02:27:44 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:08:10.929 02:27:44 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:08:10.929 02:27:44 -- accel/accel.sh@72 -- # IFS== 00:08:10.929 02:27:44 -- accel/accel.sh@72 -- # read -r opc module 00:08:10.929 02:27:44 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:08:10.929 02:27:44 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:08:10.929 02:27:44 -- accel/accel.sh@72 -- # IFS== 00:08:10.929 02:27:44 -- accel/accel.sh@72 -- # read -r opc module 00:08:10.929 02:27:44 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:08:10.929 02:27:44 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:08:10.929 02:27:44 -- accel/accel.sh@72 -- # IFS== 00:08:10.929 02:27:44 -- accel/accel.sh@72 -- # read -r opc module 00:08:10.929 02:27:44 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:08:10.929 02:27:44 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:08:10.929 02:27:44 -- accel/accel.sh@72 -- # IFS== 00:08:10.929 02:27:44 -- accel/accel.sh@72 -- # read -r opc module 00:08:10.929 02:27:44 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:08:10.929 02:27:44 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:08:10.929 02:27:44 -- accel/accel.sh@72 -- # IFS== 00:08:10.929 02:27:44 -- accel/accel.sh@72 -- # read -r opc module 00:08:10.929 02:27:44 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:08:10.929 02:27:44 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:08:10.929 02:27:44 -- accel/accel.sh@72 -- # IFS== 00:08:10.929 02:27:44 -- accel/accel.sh@72 -- # read -r opc module 00:08:10.929 02:27:44 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:08:10.929 02:27:44 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:08:10.929 02:27:44 -- accel/accel.sh@72 -- # IFS== 00:08:10.929 02:27:44 -- accel/accel.sh@72 -- # read -r opc module 00:08:10.929 02:27:44 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:08:10.929 02:27:44 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:08:10.929 02:27:44 -- accel/accel.sh@72 -- # IFS== 00:08:10.929 02:27:44 -- accel/accel.sh@72 -- # read -r opc module 00:08:10.929 02:27:44 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:08:10.929 02:27:44 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:08:10.929 02:27:44 -- accel/accel.sh@72 -- # IFS== 00:08:10.929 02:27:44 -- accel/accel.sh@72 -- # read -r opc module 00:08:10.929 02:27:44 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:08:10.929 02:27:44 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:08:10.929 02:27:44 -- accel/accel.sh@72 -- # IFS== 00:08:10.929 02:27:44 -- accel/accel.sh@72 -- # read -r opc module 00:08:10.929 02:27:44 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:08:10.929 02:27:44 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:08:10.929 02:27:44 -- accel/accel.sh@72 -- # IFS== 00:08:10.929 02:27:44 -- accel/accel.sh@72 -- # read -r opc module 00:08:10.929 02:27:44 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:08:10.929 02:27:44 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:08:10.929 02:27:44 -- accel/accel.sh@72 -- # IFS== 00:08:10.929 02:27:44 -- accel/accel.sh@72 -- # read -r opc module 00:08:10.929 02:27:44 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:08:10.929 02:27:44 -- accel/accel.sh@75 -- # killprocess 1435396 00:08:10.929 02:27:44 -- common/autotest_common.sh@936 -- # '[' -z 1435396 ']' 00:08:10.929 02:27:44 -- common/autotest_common.sh@940 -- # kill -0 1435396 00:08:10.929 02:27:44 -- common/autotest_common.sh@941 -- # uname 00:08:10.929 02:27:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:10.929 02:27:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1435396 00:08:11.189 02:27:44 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:11.189 02:27:44 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:11.189 02:27:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1435396' 00:08:11.189 killing process with pid 1435396 00:08:11.189 02:27:44 -- common/autotest_common.sh@955 -- # kill 1435396 00:08:11.189 02:27:44 -- common/autotest_common.sh@960 -- # wait 1435396 00:08:11.449 02:27:44 -- accel/accel.sh@76 -- # trap - ERR 00:08:11.449 02:27:44 -- accel/accel.sh@89 -- # run_test accel_help accel_perf -h 00:08:11.449 02:27:44 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:11.449 02:27:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:11.449 02:27:44 -- common/autotest_common.sh@10 -- # set +x 00:08:11.708 02:27:45 -- common/autotest_common.sh@1111 -- # accel_perf -h 00:08:11.709 02:27:45 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:08:11.709 02:27:45 -- accel/accel.sh@12 -- # build_accel_config 00:08:11.709 02:27:45 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:08:11.709 02:27:45 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:08:11.709 02:27:45 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:11.709 02:27:45 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:11.709 02:27:45 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:08:11.709 02:27:45 -- accel/accel.sh@40 -- # local IFS=, 00:08:11.709 02:27:45 -- accel/accel.sh@41 -- # jq -r . 00:08:11.709 02:27:45 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:11.709 02:27:45 -- common/autotest_common.sh@10 -- # set +x 00:08:11.709 02:27:45 -- accel/accel.sh@91 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:08:11.709 02:27:45 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:08:11.709 02:27:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:11.709 02:27:45 -- common/autotest_common.sh@10 -- # set +x 00:08:11.709 ************************************ 00:08:11.709 START TEST accel_missing_filename 00:08:11.709 ************************************ 00:08:11.709 02:27:45 -- common/autotest_common.sh@1111 -- # NOT accel_perf -t 1 -w compress 00:08:11.709 02:27:45 -- common/autotest_common.sh@638 -- # local es=0 00:08:11.709 02:27:45 -- common/autotest_common.sh@640 -- # valid_exec_arg accel_perf -t 1 -w compress 00:08:11.709 02:27:45 -- common/autotest_common.sh@626 -- # local arg=accel_perf 00:08:11.709 02:27:45 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:08:11.709 02:27:45 -- common/autotest_common.sh@630 -- # type -t accel_perf 00:08:11.709 02:27:45 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:08:11.709 02:27:45 -- common/autotest_common.sh@641 -- # accel_perf -t 1 -w compress 00:08:11.709 02:27:45 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:08:11.709 02:27:45 -- accel/accel.sh@12 -- # build_accel_config 00:08:11.709 02:27:45 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:08:11.709 02:27:45 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:08:11.709 02:27:45 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:11.709 02:27:45 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:11.709 02:27:45 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:08:11.709 02:27:45 -- accel/accel.sh@40 -- # local IFS=, 00:08:11.709 02:27:45 -- accel/accel.sh@41 -- # jq -r . 00:08:11.709 [2024-04-27 02:27:45.317273] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:08:11.709 [2024-04-27 02:27:45.317328] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1435687 ] 00:08:11.968 EAL: No free 2048 kB hugepages reported on node 1 00:08:11.968 [2024-04-27 02:27:45.388541] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:11.968 [2024-04-27 02:27:45.470444] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:11.968 [2024-04-27 02:27:45.518779] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:08:11.968 [2024-04-27 02:27:45.589428] accel_perf.c:1394:main: *ERROR*: ERROR starting application 00:08:12.227 A filename is required. 00:08:12.227 02:27:45 -- common/autotest_common.sh@641 -- # es=234 00:08:12.227 02:27:45 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:08:12.227 02:27:45 -- common/autotest_common.sh@650 -- # es=106 00:08:12.227 02:27:45 -- common/autotest_common.sh@651 -- # case "$es" in 00:08:12.227 02:27:45 -- common/autotest_common.sh@658 -- # es=1 00:08:12.227 02:27:45 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:08:12.227 00:08:12.227 real 0m0.391s 00:08:12.227 user 0m0.288s 00:08:12.227 sys 0m0.141s 00:08:12.227 02:27:45 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:12.227 02:27:45 -- common/autotest_common.sh@10 -- # set +x 00:08:12.227 ************************************ 00:08:12.227 END TEST accel_missing_filename 00:08:12.227 ************************************ 00:08:12.227 02:27:45 -- accel/accel.sh@93 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:08:12.227 02:27:45 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:08:12.227 02:27:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:12.227 02:27:45 -- common/autotest_common.sh@10 -- # set +x 00:08:12.487 ************************************ 00:08:12.487 START TEST accel_compress_verify 00:08:12.487 ************************************ 00:08:12.487 02:27:45 -- common/autotest_common.sh@1111 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:08:12.487 02:27:45 -- common/autotest_common.sh@638 -- # local es=0 00:08:12.487 02:27:45 -- common/autotest_common.sh@640 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:08:12.487 02:27:45 -- common/autotest_common.sh@626 -- # local arg=accel_perf 00:08:12.487 02:27:45 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:08:12.487 02:27:45 -- common/autotest_common.sh@630 -- # type -t accel_perf 00:08:12.487 02:27:45 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:08:12.487 02:27:45 -- common/autotest_common.sh@641 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:08:12.487 02:27:45 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:08:12.487 02:27:45 -- accel/accel.sh@12 -- # build_accel_config 00:08:12.487 02:27:45 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:08:12.487 02:27:45 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:08:12.487 02:27:45 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:12.487 02:27:45 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:12.487 02:27:45 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:08:12.487 02:27:45 -- accel/accel.sh@40 -- # local IFS=, 00:08:12.487 02:27:45 -- accel/accel.sh@41 -- # jq -r . 00:08:12.487 [2024-04-27 02:27:45.899656] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:08:12.487 [2024-04-27 02:27:45.899711] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1435831 ] 00:08:12.487 EAL: No free 2048 kB hugepages reported on node 1 00:08:12.487 [2024-04-27 02:27:45.970779] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:12.487 [2024-04-27 02:27:46.052353] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:12.487 [2024-04-27 02:27:46.100254] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:08:12.786 [2024-04-27 02:27:46.170436] accel_perf.c:1394:main: *ERROR*: ERROR starting application 00:08:12.786 00:08:12.786 Compression does not support the verify option, aborting. 00:08:12.786 02:27:46 -- common/autotest_common.sh@641 -- # es=161 00:08:12.786 02:27:46 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:08:12.786 02:27:46 -- common/autotest_common.sh@650 -- # es=33 00:08:12.786 02:27:46 -- common/autotest_common.sh@651 -- # case "$es" in 00:08:12.786 02:27:46 -- common/autotest_common.sh@658 -- # es=1 00:08:12.786 02:27:46 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:08:12.786 00:08:12.786 real 0m0.399s 00:08:12.786 user 0m0.294s 00:08:12.786 sys 0m0.141s 00:08:12.786 02:27:46 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:12.786 02:27:46 -- common/autotest_common.sh@10 -- # set +x 00:08:12.786 ************************************ 00:08:12.786 END TEST accel_compress_verify 00:08:12.786 ************************************ 00:08:12.786 02:27:46 -- accel/accel.sh@95 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:08:12.786 02:27:46 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:08:12.786 02:27:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:12.786 02:27:46 -- common/autotest_common.sh@10 -- # set +x 00:08:13.076 ************************************ 00:08:13.076 START TEST accel_wrong_workload 00:08:13.076 ************************************ 00:08:13.076 02:27:46 -- common/autotest_common.sh@1111 -- # NOT accel_perf -t 1 -w foobar 00:08:13.076 02:27:46 -- common/autotest_common.sh@638 -- # local es=0 00:08:13.076 02:27:46 -- common/autotest_common.sh@640 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:08:13.076 02:27:46 -- common/autotest_common.sh@626 -- # local arg=accel_perf 00:08:13.076 02:27:46 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:08:13.076 02:27:46 -- common/autotest_common.sh@630 -- # type -t accel_perf 00:08:13.076 02:27:46 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:08:13.076 02:27:46 -- common/autotest_common.sh@641 -- # accel_perf -t 1 -w foobar 00:08:13.076 02:27:46 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:08:13.076 02:27:46 -- accel/accel.sh@12 -- # build_accel_config 00:08:13.076 02:27:46 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:08:13.076 02:27:46 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:08:13.076 02:27:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:13.076 02:27:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:13.076 02:27:46 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:08:13.076 02:27:46 -- accel/accel.sh@40 -- # local IFS=, 00:08:13.076 02:27:46 -- accel/accel.sh@41 -- # jq -r . 00:08:13.076 Unsupported workload type: foobar 00:08:13.076 [2024-04-27 02:27:46.482004] app.c:1364:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:08:13.076 accel_perf options: 00:08:13.076 [-h help message] 00:08:13.076 [-q queue depth per core] 00:08:13.076 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:08:13.076 [-T number of threads per core 00:08:13.076 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:08:13.076 [-t time in seconds] 00:08:13.076 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:08:13.076 [ dif_verify, , dif_generate, dif_generate_copy 00:08:13.076 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:08:13.076 [-l for compress/decompress workloads, name of uncompressed input file 00:08:13.076 [-S for crc32c workload, use this seed value (default 0) 00:08:13.076 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:08:13.076 [-f for fill workload, use this BYTE value (default 255) 00:08:13.076 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:08:13.076 [-y verify result if this switch is on] 00:08:13.076 [-a tasks to allocate per core (default: same value as -q)] 00:08:13.076 Can be used to spread operations across a wider range of memory. 00:08:13.076 02:27:46 -- common/autotest_common.sh@641 -- # es=1 00:08:13.076 02:27:46 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:08:13.076 02:27:46 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:08:13.076 02:27:46 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:08:13.076 00:08:13.076 real 0m0.021s 00:08:13.076 user 0m0.010s 00:08:13.076 sys 0m0.012s 00:08:13.076 02:27:46 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:13.076 02:27:46 -- common/autotest_common.sh@10 -- # set +x 00:08:13.076 ************************************ 00:08:13.076 END TEST accel_wrong_workload 00:08:13.076 ************************************ 00:08:13.076 Error: writing output failed: Broken pipe 00:08:13.076 02:27:46 -- accel/accel.sh@97 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:08:13.076 02:27:46 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:08:13.076 02:27:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:13.076 02:27:46 -- common/autotest_common.sh@10 -- # set +x 00:08:13.076 ************************************ 00:08:13.076 START TEST accel_negative_buffers 00:08:13.076 ************************************ 00:08:13.076 02:27:46 -- common/autotest_common.sh@1111 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:08:13.076 02:27:46 -- common/autotest_common.sh@638 -- # local es=0 00:08:13.076 02:27:46 -- common/autotest_common.sh@640 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:08:13.076 02:27:46 -- common/autotest_common.sh@626 -- # local arg=accel_perf 00:08:13.076 02:27:46 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:08:13.076 02:27:46 -- common/autotest_common.sh@630 -- # type -t accel_perf 00:08:13.076 02:27:46 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:08:13.076 02:27:46 -- common/autotest_common.sh@641 -- # accel_perf -t 1 -w xor -y -x -1 00:08:13.076 02:27:46 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:08:13.076 02:27:46 -- accel/accel.sh@12 -- # build_accel_config 00:08:13.076 02:27:46 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:08:13.076 02:27:46 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:08:13.076 02:27:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:13.076 02:27:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:13.076 02:27:46 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:08:13.076 02:27:46 -- accel/accel.sh@40 -- # local IFS=, 00:08:13.076 02:27:46 -- accel/accel.sh@41 -- # jq -r . 00:08:13.076 -x option must be non-negative. 00:08:13.076 [2024-04-27 02:27:46.681642] app.c:1364:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:08:13.076 accel_perf options: 00:08:13.076 [-h help message] 00:08:13.076 [-q queue depth per core] 00:08:13.076 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:08:13.076 [-T number of threads per core 00:08:13.076 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:08:13.076 [-t time in seconds] 00:08:13.076 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:08:13.076 [ dif_verify, , dif_generate, dif_generate_copy 00:08:13.076 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:08:13.076 [-l for compress/decompress workloads, name of uncompressed input file 00:08:13.076 [-S for crc32c workload, use this seed value (default 0) 00:08:13.076 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:08:13.076 [-f for fill workload, use this BYTE value (default 255) 00:08:13.076 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:08:13.076 [-y verify result if this switch is on] 00:08:13.076 [-a tasks to allocate per core (default: same value as -q)] 00:08:13.076 Can be used to spread operations across a wider range of memory. 00:08:13.076 02:27:46 -- common/autotest_common.sh@641 -- # es=1 00:08:13.076 02:27:46 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:08:13.076 02:27:46 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:08:13.076 02:27:46 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:08:13.076 00:08:13.076 real 0m0.035s 00:08:13.076 user 0m0.044s 00:08:13.076 sys 0m0.018s 00:08:13.076 02:27:46 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:13.076 02:27:46 -- common/autotest_common.sh@10 -- # set +x 00:08:13.076 ************************************ 00:08:13.076 END TEST accel_negative_buffers 00:08:13.076 ************************************ 00:08:13.336 02:27:46 -- accel/accel.sh@101 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:08:13.336 02:27:46 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:08:13.336 02:27:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:13.336 02:27:46 -- common/autotest_common.sh@10 -- # set +x 00:08:13.336 ************************************ 00:08:13.336 START TEST accel_crc32c 00:08:13.336 ************************************ 00:08:13.336 02:27:46 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w crc32c -S 32 -y 00:08:13.336 02:27:46 -- accel/accel.sh@16 -- # local accel_opc 00:08:13.336 02:27:46 -- accel/accel.sh@17 -- # local accel_module 00:08:13.336 02:27:46 -- accel/accel.sh@19 -- # IFS=: 00:08:13.336 02:27:46 -- accel/accel.sh@19 -- # read -r var val 00:08:13.336 02:27:46 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:08:13.336 02:27:46 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:08:13.336 02:27:46 -- accel/accel.sh@12 -- # build_accel_config 00:08:13.336 02:27:46 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:08:13.336 02:27:46 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:08:13.336 02:27:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:13.336 02:27:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:13.336 02:27:46 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:08:13.336 02:27:46 -- accel/accel.sh@40 -- # local IFS=, 00:08:13.336 02:27:46 -- accel/accel.sh@41 -- # jq -r . 00:08:13.336 [2024-04-27 02:27:46.887916] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:08:13.336 [2024-04-27 02:27:46.887961] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1436071 ] 00:08:13.336 EAL: No free 2048 kB hugepages reported on node 1 00:08:13.595 [2024-04-27 02:27:46.958146] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:13.595 [2024-04-27 02:27:47.039191] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:13.595 02:27:47 -- accel/accel.sh@20 -- # val= 00:08:13.595 02:27:47 -- accel/accel.sh@21 -- # case "$var" in 00:08:13.595 02:27:47 -- accel/accel.sh@19 -- # IFS=: 00:08:13.595 02:27:47 -- accel/accel.sh@19 -- # read -r var val 00:08:13.595 02:27:47 -- accel/accel.sh@20 -- # val= 00:08:13.595 02:27:47 -- accel/accel.sh@21 -- # case "$var" in 00:08:13.595 02:27:47 -- accel/accel.sh@19 -- # IFS=: 00:08:13.595 02:27:47 -- accel/accel.sh@19 -- # read -r var val 00:08:13.595 02:27:47 -- accel/accel.sh@20 -- # val=0x1 00:08:13.595 02:27:47 -- accel/accel.sh@21 -- # case "$var" in 00:08:13.595 02:27:47 -- accel/accel.sh@19 -- # IFS=: 00:08:13.595 02:27:47 -- accel/accel.sh@19 -- # read -r var val 00:08:13.595 02:27:47 -- accel/accel.sh@20 -- # val= 00:08:13.595 02:27:47 -- accel/accel.sh@21 -- # case "$var" in 00:08:13.595 02:27:47 -- accel/accel.sh@19 -- # IFS=: 00:08:13.595 02:27:47 -- accel/accel.sh@19 -- # read -r var val 00:08:13.595 02:27:47 -- accel/accel.sh@20 -- # val= 00:08:13.595 02:27:47 -- accel/accel.sh@21 -- # case "$var" in 00:08:13.595 02:27:47 -- accel/accel.sh@19 -- # IFS=: 00:08:13.595 02:27:47 -- accel/accel.sh@19 -- # read -r var val 00:08:13.595 02:27:47 -- accel/accel.sh@20 -- # val=crc32c 00:08:13.595 02:27:47 -- accel/accel.sh@21 -- # case "$var" in 00:08:13.595 02:27:47 -- accel/accel.sh@23 -- # accel_opc=crc32c 00:08:13.595 02:27:47 -- accel/accel.sh@19 -- # IFS=: 00:08:13.595 02:27:47 -- accel/accel.sh@19 -- # read -r var val 00:08:13.595 02:27:47 -- accel/accel.sh@20 -- # val=32 00:08:13.595 02:27:47 -- accel/accel.sh@21 -- # case "$var" in 00:08:13.595 02:27:47 -- accel/accel.sh@19 -- # IFS=: 00:08:13.595 02:27:47 -- accel/accel.sh@19 -- # read -r var val 00:08:13.595 02:27:47 -- accel/accel.sh@20 -- # val='4096 bytes' 00:08:13.595 02:27:47 -- accel/accel.sh@21 -- # case "$var" in 00:08:13.595 02:27:47 -- accel/accel.sh@19 -- # IFS=: 00:08:13.595 02:27:47 -- accel/accel.sh@19 -- # read -r var val 00:08:13.595 02:27:47 -- accel/accel.sh@20 -- # val= 00:08:13.595 02:27:47 -- accel/accel.sh@21 -- # case "$var" in 00:08:13.595 02:27:47 -- accel/accel.sh@19 -- # IFS=: 00:08:13.595 02:27:47 -- accel/accel.sh@19 -- # read -r var val 00:08:13.595 02:27:47 -- accel/accel.sh@20 -- # val=software 00:08:13.595 02:27:47 -- accel/accel.sh@21 -- # case "$var" in 00:08:13.595 02:27:47 -- accel/accel.sh@22 -- # accel_module=software 00:08:13.595 02:27:47 -- accel/accel.sh@19 -- # IFS=: 00:08:13.595 02:27:47 -- accel/accel.sh@19 -- # read -r var val 00:08:13.595 02:27:47 -- accel/accel.sh@20 -- # val=32 00:08:13.595 02:27:47 -- accel/accel.sh@21 -- # case "$var" in 00:08:13.595 02:27:47 -- accel/accel.sh@19 -- # IFS=: 00:08:13.595 02:27:47 -- accel/accel.sh@19 -- # read -r var val 00:08:13.595 02:27:47 -- accel/accel.sh@20 -- # val=32 00:08:13.595 02:27:47 -- accel/accel.sh@21 -- # case "$var" in 00:08:13.595 02:27:47 -- accel/accel.sh@19 -- # IFS=: 00:08:13.595 02:27:47 -- accel/accel.sh@19 -- # read -r var val 00:08:13.595 02:27:47 -- accel/accel.sh@20 -- # val=1 00:08:13.595 02:27:47 -- accel/accel.sh@21 -- # case "$var" in 00:08:13.595 02:27:47 -- accel/accel.sh@19 -- # IFS=: 00:08:13.595 02:27:47 -- accel/accel.sh@19 -- # read -r var val 00:08:13.595 02:27:47 -- accel/accel.sh@20 -- # val='1 seconds' 00:08:13.595 02:27:47 -- accel/accel.sh@21 -- # case "$var" in 00:08:13.595 02:27:47 -- accel/accel.sh@19 -- # IFS=: 00:08:13.595 02:27:47 -- accel/accel.sh@19 -- # read -r var val 00:08:13.595 02:27:47 -- accel/accel.sh@20 -- # val=Yes 00:08:13.595 02:27:47 -- accel/accel.sh@21 -- # case "$var" in 00:08:13.595 02:27:47 -- accel/accel.sh@19 -- # IFS=: 00:08:13.595 02:27:47 -- accel/accel.sh@19 -- # read -r var val 00:08:13.595 02:27:47 -- accel/accel.sh@20 -- # val= 00:08:13.595 02:27:47 -- accel/accel.sh@21 -- # case "$var" in 00:08:13.596 02:27:47 -- accel/accel.sh@19 -- # IFS=: 00:08:13.596 02:27:47 -- accel/accel.sh@19 -- # read -r var val 00:08:13.596 02:27:47 -- accel/accel.sh@20 -- # val= 00:08:13.596 02:27:47 -- accel/accel.sh@21 -- # case "$var" in 00:08:13.596 02:27:47 -- accel/accel.sh@19 -- # IFS=: 00:08:13.596 02:27:47 -- accel/accel.sh@19 -- # read -r var val 00:08:14.973 02:27:48 -- accel/accel.sh@20 -- # val= 00:08:14.973 02:27:48 -- accel/accel.sh@21 -- # case "$var" in 00:08:14.973 02:27:48 -- accel/accel.sh@19 -- # IFS=: 00:08:14.973 02:27:48 -- accel/accel.sh@19 -- # read -r var val 00:08:14.973 02:27:48 -- accel/accel.sh@20 -- # val= 00:08:14.973 02:27:48 -- accel/accel.sh@21 -- # case "$var" in 00:08:14.973 02:27:48 -- accel/accel.sh@19 -- # IFS=: 00:08:14.973 02:27:48 -- accel/accel.sh@19 -- # read -r var val 00:08:14.973 02:27:48 -- accel/accel.sh@20 -- # val= 00:08:14.973 02:27:48 -- accel/accel.sh@21 -- # case "$var" in 00:08:14.973 02:27:48 -- accel/accel.sh@19 -- # IFS=: 00:08:14.973 02:27:48 -- accel/accel.sh@19 -- # read -r var val 00:08:14.973 02:27:48 -- accel/accel.sh@20 -- # val= 00:08:14.973 02:27:48 -- accel/accel.sh@21 -- # case "$var" in 00:08:14.973 02:27:48 -- accel/accel.sh@19 -- # IFS=: 00:08:14.973 02:27:48 -- accel/accel.sh@19 -- # read -r var val 00:08:14.973 02:27:48 -- accel/accel.sh@20 -- # val= 00:08:14.973 02:27:48 -- accel/accel.sh@21 -- # case "$var" in 00:08:14.973 02:27:48 -- accel/accel.sh@19 -- # IFS=: 00:08:14.973 02:27:48 -- accel/accel.sh@19 -- # read -r var val 00:08:14.973 02:27:48 -- accel/accel.sh@20 -- # val= 00:08:14.973 02:27:48 -- accel/accel.sh@21 -- # case "$var" in 00:08:14.973 02:27:48 -- accel/accel.sh@19 -- # IFS=: 00:08:14.973 02:27:48 -- accel/accel.sh@19 -- # read -r var val 00:08:14.973 02:27:48 -- accel/accel.sh@27 -- # [[ -n software ]] 00:08:14.973 02:27:48 -- accel/accel.sh@27 -- # [[ -n crc32c ]] 00:08:14.973 02:27:48 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:14.973 00:08:14.973 real 0m1.393s 00:08:14.973 user 0m1.260s 00:08:14.973 sys 0m0.135s 00:08:14.973 02:27:48 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:14.973 02:27:48 -- common/autotest_common.sh@10 -- # set +x 00:08:14.973 ************************************ 00:08:14.973 END TEST accel_crc32c 00:08:14.973 ************************************ 00:08:14.973 02:27:48 -- accel/accel.sh@102 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:08:14.973 02:27:48 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:08:14.973 02:27:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:14.973 02:27:48 -- common/autotest_common.sh@10 -- # set +x 00:08:14.973 ************************************ 00:08:14.973 START TEST accel_crc32c_C2 00:08:14.973 ************************************ 00:08:14.973 02:27:48 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w crc32c -y -C 2 00:08:14.973 02:27:48 -- accel/accel.sh@16 -- # local accel_opc 00:08:14.973 02:27:48 -- accel/accel.sh@17 -- # local accel_module 00:08:14.973 02:27:48 -- accel/accel.sh@19 -- # IFS=: 00:08:14.973 02:27:48 -- accel/accel.sh@19 -- # read -r var val 00:08:14.973 02:27:48 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:08:14.973 02:27:48 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:08:14.973 02:27:48 -- accel/accel.sh@12 -- # build_accel_config 00:08:14.973 02:27:48 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:08:14.974 02:27:48 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:08:14.974 02:27:48 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:14.974 02:27:48 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:14.974 02:27:48 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:08:14.974 02:27:48 -- accel/accel.sh@40 -- # local IFS=, 00:08:14.974 02:27:48 -- accel/accel.sh@41 -- # jq -r . 00:08:14.974 [2024-04-27 02:27:48.480116] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:08:14.974 [2024-04-27 02:27:48.480170] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1436298 ] 00:08:14.974 EAL: No free 2048 kB hugepages reported on node 1 00:08:14.974 [2024-04-27 02:27:48.551232] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:15.233 [2024-04-27 02:27:48.633577] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:15.233 02:27:48 -- accel/accel.sh@20 -- # val= 00:08:15.233 02:27:48 -- accel/accel.sh@21 -- # case "$var" in 00:08:15.233 02:27:48 -- accel/accel.sh@19 -- # IFS=: 00:08:15.233 02:27:48 -- accel/accel.sh@19 -- # read -r var val 00:08:15.233 02:27:48 -- accel/accel.sh@20 -- # val= 00:08:15.233 02:27:48 -- accel/accel.sh@21 -- # case "$var" in 00:08:15.233 02:27:48 -- accel/accel.sh@19 -- # IFS=: 00:08:15.233 02:27:48 -- accel/accel.sh@19 -- # read -r var val 00:08:15.233 02:27:48 -- accel/accel.sh@20 -- # val=0x1 00:08:15.233 02:27:48 -- accel/accel.sh@21 -- # case "$var" in 00:08:15.233 02:27:48 -- accel/accel.sh@19 -- # IFS=: 00:08:15.233 02:27:48 -- accel/accel.sh@19 -- # read -r var val 00:08:15.233 02:27:48 -- accel/accel.sh@20 -- # val= 00:08:15.233 02:27:48 -- accel/accel.sh@21 -- # case "$var" in 00:08:15.233 02:27:48 -- accel/accel.sh@19 -- # IFS=: 00:08:15.233 02:27:48 -- accel/accel.sh@19 -- # read -r var val 00:08:15.233 02:27:48 -- accel/accel.sh@20 -- # val= 00:08:15.233 02:27:48 -- accel/accel.sh@21 -- # case "$var" in 00:08:15.233 02:27:48 -- accel/accel.sh@19 -- # IFS=: 00:08:15.233 02:27:48 -- accel/accel.sh@19 -- # read -r var val 00:08:15.233 02:27:48 -- accel/accel.sh@20 -- # val=crc32c 00:08:15.233 02:27:48 -- accel/accel.sh@21 -- # case "$var" in 00:08:15.233 02:27:48 -- accel/accel.sh@23 -- # accel_opc=crc32c 00:08:15.233 02:27:48 -- accel/accel.sh@19 -- # IFS=: 00:08:15.233 02:27:48 -- accel/accel.sh@19 -- # read -r var val 00:08:15.233 02:27:48 -- accel/accel.sh@20 -- # val=0 00:08:15.233 02:27:48 -- accel/accel.sh@21 -- # case "$var" in 00:08:15.233 02:27:48 -- accel/accel.sh@19 -- # IFS=: 00:08:15.233 02:27:48 -- accel/accel.sh@19 -- # read -r var val 00:08:15.233 02:27:48 -- accel/accel.sh@20 -- # val='4096 bytes' 00:08:15.233 02:27:48 -- accel/accel.sh@21 -- # case "$var" in 00:08:15.233 02:27:48 -- accel/accel.sh@19 -- # IFS=: 00:08:15.233 02:27:48 -- accel/accel.sh@19 -- # read -r var val 00:08:15.233 02:27:48 -- accel/accel.sh@20 -- # val= 00:08:15.233 02:27:48 -- accel/accel.sh@21 -- # case "$var" in 00:08:15.233 02:27:48 -- accel/accel.sh@19 -- # IFS=: 00:08:15.233 02:27:48 -- accel/accel.sh@19 -- # read -r var val 00:08:15.233 02:27:48 -- accel/accel.sh@20 -- # val=software 00:08:15.233 02:27:48 -- accel/accel.sh@21 -- # case "$var" in 00:08:15.233 02:27:48 -- accel/accel.sh@22 -- # accel_module=software 00:08:15.233 02:27:48 -- accel/accel.sh@19 -- # IFS=: 00:08:15.233 02:27:48 -- accel/accel.sh@19 -- # read -r var val 00:08:15.233 02:27:48 -- accel/accel.sh@20 -- # val=32 00:08:15.233 02:27:48 -- accel/accel.sh@21 -- # case "$var" in 00:08:15.233 02:27:48 -- accel/accel.sh@19 -- # IFS=: 00:08:15.233 02:27:48 -- accel/accel.sh@19 -- # read -r var val 00:08:15.233 02:27:48 -- accel/accel.sh@20 -- # val=32 00:08:15.233 02:27:48 -- accel/accel.sh@21 -- # case "$var" in 00:08:15.233 02:27:48 -- accel/accel.sh@19 -- # IFS=: 00:08:15.233 02:27:48 -- accel/accel.sh@19 -- # read -r var val 00:08:15.233 02:27:48 -- accel/accel.sh@20 -- # val=1 00:08:15.233 02:27:48 -- accel/accel.sh@21 -- # case "$var" in 00:08:15.233 02:27:48 -- accel/accel.sh@19 -- # IFS=: 00:08:15.233 02:27:48 -- accel/accel.sh@19 -- # read -r var val 00:08:15.233 02:27:48 -- accel/accel.sh@20 -- # val='1 seconds' 00:08:15.233 02:27:48 -- accel/accel.sh@21 -- # case "$var" in 00:08:15.233 02:27:48 -- accel/accel.sh@19 -- # IFS=: 00:08:15.233 02:27:48 -- accel/accel.sh@19 -- # read -r var val 00:08:15.233 02:27:48 -- accel/accel.sh@20 -- # val=Yes 00:08:15.233 02:27:48 -- accel/accel.sh@21 -- # case "$var" in 00:08:15.233 02:27:48 -- accel/accel.sh@19 -- # IFS=: 00:08:15.233 02:27:48 -- accel/accel.sh@19 -- # read -r var val 00:08:15.233 02:27:48 -- accel/accel.sh@20 -- # val= 00:08:15.233 02:27:48 -- accel/accel.sh@21 -- # case "$var" in 00:08:15.233 02:27:48 -- accel/accel.sh@19 -- # IFS=: 00:08:15.233 02:27:48 -- accel/accel.sh@19 -- # read -r var val 00:08:15.233 02:27:48 -- accel/accel.sh@20 -- # val= 00:08:15.233 02:27:48 -- accel/accel.sh@21 -- # case "$var" in 00:08:15.233 02:27:48 -- accel/accel.sh@19 -- # IFS=: 00:08:15.233 02:27:48 -- accel/accel.sh@19 -- # read -r var val 00:08:16.612 02:27:49 -- accel/accel.sh@20 -- # val= 00:08:16.612 02:27:49 -- accel/accel.sh@21 -- # case "$var" in 00:08:16.612 02:27:49 -- accel/accel.sh@19 -- # IFS=: 00:08:16.612 02:27:49 -- accel/accel.sh@19 -- # read -r var val 00:08:16.612 02:27:49 -- accel/accel.sh@20 -- # val= 00:08:16.612 02:27:49 -- accel/accel.sh@21 -- # case "$var" in 00:08:16.612 02:27:49 -- accel/accel.sh@19 -- # IFS=: 00:08:16.612 02:27:49 -- accel/accel.sh@19 -- # read -r var val 00:08:16.612 02:27:49 -- accel/accel.sh@20 -- # val= 00:08:16.612 02:27:49 -- accel/accel.sh@21 -- # case "$var" in 00:08:16.612 02:27:49 -- accel/accel.sh@19 -- # IFS=: 00:08:16.612 02:27:49 -- accel/accel.sh@19 -- # read -r var val 00:08:16.612 02:27:49 -- accel/accel.sh@20 -- # val= 00:08:16.612 02:27:49 -- accel/accel.sh@21 -- # case "$var" in 00:08:16.612 02:27:49 -- accel/accel.sh@19 -- # IFS=: 00:08:16.612 02:27:49 -- accel/accel.sh@19 -- # read -r var val 00:08:16.612 02:27:49 -- accel/accel.sh@20 -- # val= 00:08:16.612 02:27:49 -- accel/accel.sh@21 -- # case "$var" in 00:08:16.612 02:27:49 -- accel/accel.sh@19 -- # IFS=: 00:08:16.612 02:27:49 -- accel/accel.sh@19 -- # read -r var val 00:08:16.612 02:27:49 -- accel/accel.sh@20 -- # val= 00:08:16.612 02:27:49 -- accel/accel.sh@21 -- # case "$var" in 00:08:16.612 02:27:49 -- accel/accel.sh@19 -- # IFS=: 00:08:16.612 02:27:49 -- accel/accel.sh@19 -- # read -r var val 00:08:16.612 02:27:49 -- accel/accel.sh@27 -- # [[ -n software ]] 00:08:16.612 02:27:49 -- accel/accel.sh@27 -- # [[ -n crc32c ]] 00:08:16.612 02:27:49 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:16.612 00:08:16.612 real 0m1.405s 00:08:16.612 user 0m1.264s 00:08:16.612 sys 0m0.143s 00:08:16.612 02:27:49 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:16.612 02:27:49 -- common/autotest_common.sh@10 -- # set +x 00:08:16.612 ************************************ 00:08:16.612 END TEST accel_crc32c_C2 00:08:16.612 ************************************ 00:08:16.612 02:27:49 -- accel/accel.sh@103 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:08:16.612 02:27:49 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:08:16.612 02:27:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:16.612 02:27:49 -- common/autotest_common.sh@10 -- # set +x 00:08:16.612 ************************************ 00:08:16.612 START TEST accel_copy 00:08:16.612 ************************************ 00:08:16.612 02:27:50 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w copy -y 00:08:16.612 02:27:50 -- accel/accel.sh@16 -- # local accel_opc 00:08:16.612 02:27:50 -- accel/accel.sh@17 -- # local accel_module 00:08:16.612 02:27:50 -- accel/accel.sh@19 -- # IFS=: 00:08:16.613 02:27:50 -- accel/accel.sh@19 -- # read -r var val 00:08:16.613 02:27:50 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:08:16.613 02:27:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:08:16.613 02:27:50 -- accel/accel.sh@12 -- # build_accel_config 00:08:16.613 02:27:50 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:08:16.613 02:27:50 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:08:16.613 02:27:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:16.613 02:27:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:16.613 02:27:50 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:08:16.613 02:27:50 -- accel/accel.sh@40 -- # local IFS=, 00:08:16.613 02:27:50 -- accel/accel.sh@41 -- # jq -r . 00:08:16.613 [2024-04-27 02:27:50.067878] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:08:16.613 [2024-04-27 02:27:50.067947] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1436511 ] 00:08:16.613 EAL: No free 2048 kB hugepages reported on node 1 00:08:16.613 [2024-04-27 02:27:50.140732] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:16.613 [2024-04-27 02:27:50.219549] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:16.873 02:27:50 -- accel/accel.sh@20 -- # val= 00:08:16.873 02:27:50 -- accel/accel.sh@21 -- # case "$var" in 00:08:16.873 02:27:50 -- accel/accel.sh@19 -- # IFS=: 00:08:16.873 02:27:50 -- accel/accel.sh@19 -- # read -r var val 00:08:16.873 02:27:50 -- accel/accel.sh@20 -- # val= 00:08:16.873 02:27:50 -- accel/accel.sh@21 -- # case "$var" in 00:08:16.873 02:27:50 -- accel/accel.sh@19 -- # IFS=: 00:08:16.873 02:27:50 -- accel/accel.sh@19 -- # read -r var val 00:08:16.873 02:27:50 -- accel/accel.sh@20 -- # val=0x1 00:08:16.873 02:27:50 -- accel/accel.sh@21 -- # case "$var" in 00:08:16.873 02:27:50 -- accel/accel.sh@19 -- # IFS=: 00:08:16.873 02:27:50 -- accel/accel.sh@19 -- # read -r var val 00:08:16.873 02:27:50 -- accel/accel.sh@20 -- # val= 00:08:16.873 02:27:50 -- accel/accel.sh@21 -- # case "$var" in 00:08:16.873 02:27:50 -- accel/accel.sh@19 -- # IFS=: 00:08:16.873 02:27:50 -- accel/accel.sh@19 -- # read -r var val 00:08:16.873 02:27:50 -- accel/accel.sh@20 -- # val= 00:08:16.873 02:27:50 -- accel/accel.sh@21 -- # case "$var" in 00:08:16.873 02:27:50 -- accel/accel.sh@19 -- # IFS=: 00:08:16.873 02:27:50 -- accel/accel.sh@19 -- # read -r var val 00:08:16.873 02:27:50 -- accel/accel.sh@20 -- # val=copy 00:08:16.873 02:27:50 -- accel/accel.sh@21 -- # case "$var" in 00:08:16.873 02:27:50 -- accel/accel.sh@23 -- # accel_opc=copy 00:08:16.873 02:27:50 -- accel/accel.sh@19 -- # IFS=: 00:08:16.873 02:27:50 -- accel/accel.sh@19 -- # read -r var val 00:08:16.873 02:27:50 -- accel/accel.sh@20 -- # val='4096 bytes' 00:08:16.873 02:27:50 -- accel/accel.sh@21 -- # case "$var" in 00:08:16.873 02:27:50 -- accel/accel.sh@19 -- # IFS=: 00:08:16.873 02:27:50 -- accel/accel.sh@19 -- # read -r var val 00:08:16.873 02:27:50 -- accel/accel.sh@20 -- # val= 00:08:16.873 02:27:50 -- accel/accel.sh@21 -- # case "$var" in 00:08:16.873 02:27:50 -- accel/accel.sh@19 -- # IFS=: 00:08:16.873 02:27:50 -- accel/accel.sh@19 -- # read -r var val 00:08:16.873 02:27:50 -- accel/accel.sh@20 -- # val=software 00:08:16.873 02:27:50 -- accel/accel.sh@21 -- # case "$var" in 00:08:16.873 02:27:50 -- accel/accel.sh@22 -- # accel_module=software 00:08:16.873 02:27:50 -- accel/accel.sh@19 -- # IFS=: 00:08:16.873 02:27:50 -- accel/accel.sh@19 -- # read -r var val 00:08:16.873 02:27:50 -- accel/accel.sh@20 -- # val=32 00:08:16.873 02:27:50 -- accel/accel.sh@21 -- # case "$var" in 00:08:16.873 02:27:50 -- accel/accel.sh@19 -- # IFS=: 00:08:16.873 02:27:50 -- accel/accel.sh@19 -- # read -r var val 00:08:16.873 02:27:50 -- accel/accel.sh@20 -- # val=32 00:08:16.873 02:27:50 -- accel/accel.sh@21 -- # case "$var" in 00:08:16.873 02:27:50 -- accel/accel.sh@19 -- # IFS=: 00:08:16.873 02:27:50 -- accel/accel.sh@19 -- # read -r var val 00:08:16.873 02:27:50 -- accel/accel.sh@20 -- # val=1 00:08:16.873 02:27:50 -- accel/accel.sh@21 -- # case "$var" in 00:08:16.873 02:27:50 -- accel/accel.sh@19 -- # IFS=: 00:08:16.873 02:27:50 -- accel/accel.sh@19 -- # read -r var val 00:08:16.873 02:27:50 -- accel/accel.sh@20 -- # val='1 seconds' 00:08:16.873 02:27:50 -- accel/accel.sh@21 -- # case "$var" in 00:08:16.873 02:27:50 -- accel/accel.sh@19 -- # IFS=: 00:08:16.873 02:27:50 -- accel/accel.sh@19 -- # read -r var val 00:08:16.873 02:27:50 -- accel/accel.sh@20 -- # val=Yes 00:08:16.873 02:27:50 -- accel/accel.sh@21 -- # case "$var" in 00:08:16.873 02:27:50 -- accel/accel.sh@19 -- # IFS=: 00:08:16.873 02:27:50 -- accel/accel.sh@19 -- # read -r var val 00:08:16.873 02:27:50 -- accel/accel.sh@20 -- # val= 00:08:16.873 02:27:50 -- accel/accel.sh@21 -- # case "$var" in 00:08:16.873 02:27:50 -- accel/accel.sh@19 -- # IFS=: 00:08:16.874 02:27:50 -- accel/accel.sh@19 -- # read -r var val 00:08:16.874 02:27:50 -- accel/accel.sh@20 -- # val= 00:08:16.874 02:27:50 -- accel/accel.sh@21 -- # case "$var" in 00:08:16.874 02:27:50 -- accel/accel.sh@19 -- # IFS=: 00:08:16.874 02:27:50 -- accel/accel.sh@19 -- # read -r var val 00:08:17.813 02:27:51 -- accel/accel.sh@20 -- # val= 00:08:17.813 02:27:51 -- accel/accel.sh@21 -- # case "$var" in 00:08:17.813 02:27:51 -- accel/accel.sh@19 -- # IFS=: 00:08:17.813 02:27:51 -- accel/accel.sh@19 -- # read -r var val 00:08:17.813 02:27:51 -- accel/accel.sh@20 -- # val= 00:08:17.813 02:27:51 -- accel/accel.sh@21 -- # case "$var" in 00:08:17.813 02:27:51 -- accel/accel.sh@19 -- # IFS=: 00:08:17.813 02:27:51 -- accel/accel.sh@19 -- # read -r var val 00:08:17.813 02:27:51 -- accel/accel.sh@20 -- # val= 00:08:17.813 02:27:51 -- accel/accel.sh@21 -- # case "$var" in 00:08:17.813 02:27:51 -- accel/accel.sh@19 -- # IFS=: 00:08:17.813 02:27:51 -- accel/accel.sh@19 -- # read -r var val 00:08:17.813 02:27:51 -- accel/accel.sh@20 -- # val= 00:08:17.813 02:27:51 -- accel/accel.sh@21 -- # case "$var" in 00:08:17.813 02:27:51 -- accel/accel.sh@19 -- # IFS=: 00:08:17.813 02:27:51 -- accel/accel.sh@19 -- # read -r var val 00:08:17.813 02:27:51 -- accel/accel.sh@20 -- # val= 00:08:17.813 02:27:51 -- accel/accel.sh@21 -- # case "$var" in 00:08:17.813 02:27:51 -- accel/accel.sh@19 -- # IFS=: 00:08:17.813 02:27:51 -- accel/accel.sh@19 -- # read -r var val 00:08:17.813 02:27:51 -- accel/accel.sh@20 -- # val= 00:08:17.813 02:27:51 -- accel/accel.sh@21 -- # case "$var" in 00:08:17.813 02:27:51 -- accel/accel.sh@19 -- # IFS=: 00:08:17.813 02:27:51 -- accel/accel.sh@19 -- # read -r var val 00:08:17.813 02:27:51 -- accel/accel.sh@27 -- # [[ -n software ]] 00:08:17.813 02:27:51 -- accel/accel.sh@27 -- # [[ -n copy ]] 00:08:17.813 02:27:51 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:17.813 00:08:17.813 real 0m1.382s 00:08:17.813 user 0m1.252s 00:08:17.813 sys 0m0.131s 00:08:17.813 02:27:51 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:17.813 02:27:51 -- common/autotest_common.sh@10 -- # set +x 00:08:17.813 ************************************ 00:08:17.813 END TEST accel_copy 00:08:17.813 ************************************ 00:08:18.072 02:27:51 -- accel/accel.sh@104 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:08:18.072 02:27:51 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:08:18.072 02:27:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:18.072 02:27:51 -- common/autotest_common.sh@10 -- # set +x 00:08:18.072 ************************************ 00:08:18.072 START TEST accel_fill 00:08:18.072 ************************************ 00:08:18.072 02:27:51 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:08:18.072 02:27:51 -- accel/accel.sh@16 -- # local accel_opc 00:08:18.072 02:27:51 -- accel/accel.sh@17 -- # local accel_module 00:08:18.072 02:27:51 -- accel/accel.sh@19 -- # IFS=: 00:08:18.072 02:27:51 -- accel/accel.sh@19 -- # read -r var val 00:08:18.072 02:27:51 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:08:18.072 02:27:51 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:08:18.072 02:27:51 -- accel/accel.sh@12 -- # build_accel_config 00:08:18.072 02:27:51 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:08:18.072 02:27:51 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:08:18.072 02:27:51 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:18.072 02:27:51 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:18.072 02:27:51 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:08:18.072 02:27:51 -- accel/accel.sh@40 -- # local IFS=, 00:08:18.072 02:27:51 -- accel/accel.sh@41 -- # jq -r . 00:08:18.072 [2024-04-27 02:27:51.643004] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:08:18.072 [2024-04-27 02:27:51.643079] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1436721 ] 00:08:18.072 EAL: No free 2048 kB hugepages reported on node 1 00:08:18.331 [2024-04-27 02:27:51.716055] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:18.331 [2024-04-27 02:27:51.797428] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:18.331 02:27:51 -- accel/accel.sh@20 -- # val= 00:08:18.331 02:27:51 -- accel/accel.sh@21 -- # case "$var" in 00:08:18.331 02:27:51 -- accel/accel.sh@19 -- # IFS=: 00:08:18.331 02:27:51 -- accel/accel.sh@19 -- # read -r var val 00:08:18.331 02:27:51 -- accel/accel.sh@20 -- # val= 00:08:18.331 02:27:51 -- accel/accel.sh@21 -- # case "$var" in 00:08:18.331 02:27:51 -- accel/accel.sh@19 -- # IFS=: 00:08:18.331 02:27:51 -- accel/accel.sh@19 -- # read -r var val 00:08:18.331 02:27:51 -- accel/accel.sh@20 -- # val=0x1 00:08:18.331 02:27:51 -- accel/accel.sh@21 -- # case "$var" in 00:08:18.331 02:27:51 -- accel/accel.sh@19 -- # IFS=: 00:08:18.331 02:27:51 -- accel/accel.sh@19 -- # read -r var val 00:08:18.331 02:27:51 -- accel/accel.sh@20 -- # val= 00:08:18.331 02:27:51 -- accel/accel.sh@21 -- # case "$var" in 00:08:18.331 02:27:51 -- accel/accel.sh@19 -- # IFS=: 00:08:18.331 02:27:51 -- accel/accel.sh@19 -- # read -r var val 00:08:18.331 02:27:51 -- accel/accel.sh@20 -- # val= 00:08:18.331 02:27:51 -- accel/accel.sh@21 -- # case "$var" in 00:08:18.331 02:27:51 -- accel/accel.sh@19 -- # IFS=: 00:08:18.331 02:27:51 -- accel/accel.sh@19 -- # read -r var val 00:08:18.331 02:27:51 -- accel/accel.sh@20 -- # val=fill 00:08:18.331 02:27:51 -- accel/accel.sh@21 -- # case "$var" in 00:08:18.331 02:27:51 -- accel/accel.sh@23 -- # accel_opc=fill 00:08:18.331 02:27:51 -- accel/accel.sh@19 -- # IFS=: 00:08:18.332 02:27:51 -- accel/accel.sh@19 -- # read -r var val 00:08:18.332 02:27:51 -- accel/accel.sh@20 -- # val=0x80 00:08:18.332 02:27:51 -- accel/accel.sh@21 -- # case "$var" in 00:08:18.332 02:27:51 -- accel/accel.sh@19 -- # IFS=: 00:08:18.332 02:27:51 -- accel/accel.sh@19 -- # read -r var val 00:08:18.332 02:27:51 -- accel/accel.sh@20 -- # val='4096 bytes' 00:08:18.332 02:27:51 -- accel/accel.sh@21 -- # case "$var" in 00:08:18.332 02:27:51 -- accel/accel.sh@19 -- # IFS=: 00:08:18.332 02:27:51 -- accel/accel.sh@19 -- # read -r var val 00:08:18.332 02:27:51 -- accel/accel.sh@20 -- # val= 00:08:18.332 02:27:51 -- accel/accel.sh@21 -- # case "$var" in 00:08:18.332 02:27:51 -- accel/accel.sh@19 -- # IFS=: 00:08:18.332 02:27:51 -- accel/accel.sh@19 -- # read -r var val 00:08:18.332 02:27:51 -- accel/accel.sh@20 -- # val=software 00:08:18.332 02:27:51 -- accel/accel.sh@21 -- # case "$var" in 00:08:18.332 02:27:51 -- accel/accel.sh@22 -- # accel_module=software 00:08:18.332 02:27:51 -- accel/accel.sh@19 -- # IFS=: 00:08:18.332 02:27:51 -- accel/accel.sh@19 -- # read -r var val 00:08:18.332 02:27:51 -- accel/accel.sh@20 -- # val=64 00:08:18.332 02:27:51 -- accel/accel.sh@21 -- # case "$var" in 00:08:18.332 02:27:51 -- accel/accel.sh@19 -- # IFS=: 00:08:18.332 02:27:51 -- accel/accel.sh@19 -- # read -r var val 00:08:18.332 02:27:51 -- accel/accel.sh@20 -- # val=64 00:08:18.332 02:27:51 -- accel/accel.sh@21 -- # case "$var" in 00:08:18.332 02:27:51 -- accel/accel.sh@19 -- # IFS=: 00:08:18.332 02:27:51 -- accel/accel.sh@19 -- # read -r var val 00:08:18.332 02:27:51 -- accel/accel.sh@20 -- # val=1 00:08:18.332 02:27:51 -- accel/accel.sh@21 -- # case "$var" in 00:08:18.332 02:27:51 -- accel/accel.sh@19 -- # IFS=: 00:08:18.332 02:27:51 -- accel/accel.sh@19 -- # read -r var val 00:08:18.332 02:27:51 -- accel/accel.sh@20 -- # val='1 seconds' 00:08:18.332 02:27:51 -- accel/accel.sh@21 -- # case "$var" in 00:08:18.332 02:27:51 -- accel/accel.sh@19 -- # IFS=: 00:08:18.332 02:27:51 -- accel/accel.sh@19 -- # read -r var val 00:08:18.332 02:27:51 -- accel/accel.sh@20 -- # val=Yes 00:08:18.332 02:27:51 -- accel/accel.sh@21 -- # case "$var" in 00:08:18.332 02:27:51 -- accel/accel.sh@19 -- # IFS=: 00:08:18.332 02:27:51 -- accel/accel.sh@19 -- # read -r var val 00:08:18.332 02:27:51 -- accel/accel.sh@20 -- # val= 00:08:18.332 02:27:51 -- accel/accel.sh@21 -- # case "$var" in 00:08:18.332 02:27:51 -- accel/accel.sh@19 -- # IFS=: 00:08:18.332 02:27:51 -- accel/accel.sh@19 -- # read -r var val 00:08:18.332 02:27:51 -- accel/accel.sh@20 -- # val= 00:08:18.332 02:27:51 -- accel/accel.sh@21 -- # case "$var" in 00:08:18.332 02:27:51 -- accel/accel.sh@19 -- # IFS=: 00:08:18.332 02:27:51 -- accel/accel.sh@19 -- # read -r var val 00:08:19.710 02:27:53 -- accel/accel.sh@20 -- # val= 00:08:19.710 02:27:53 -- accel/accel.sh@21 -- # case "$var" in 00:08:19.710 02:27:53 -- accel/accel.sh@19 -- # IFS=: 00:08:19.710 02:27:53 -- accel/accel.sh@19 -- # read -r var val 00:08:19.710 02:27:53 -- accel/accel.sh@20 -- # val= 00:08:19.710 02:27:53 -- accel/accel.sh@21 -- # case "$var" in 00:08:19.710 02:27:53 -- accel/accel.sh@19 -- # IFS=: 00:08:19.710 02:27:53 -- accel/accel.sh@19 -- # read -r var val 00:08:19.710 02:27:53 -- accel/accel.sh@20 -- # val= 00:08:19.710 02:27:53 -- accel/accel.sh@21 -- # case "$var" in 00:08:19.710 02:27:53 -- accel/accel.sh@19 -- # IFS=: 00:08:19.710 02:27:53 -- accel/accel.sh@19 -- # read -r var val 00:08:19.710 02:27:53 -- accel/accel.sh@20 -- # val= 00:08:19.710 02:27:53 -- accel/accel.sh@21 -- # case "$var" in 00:08:19.710 02:27:53 -- accel/accel.sh@19 -- # IFS=: 00:08:19.710 02:27:53 -- accel/accel.sh@19 -- # read -r var val 00:08:19.710 02:27:53 -- accel/accel.sh@20 -- # val= 00:08:19.710 02:27:53 -- accel/accel.sh@21 -- # case "$var" in 00:08:19.710 02:27:53 -- accel/accel.sh@19 -- # IFS=: 00:08:19.710 02:27:53 -- accel/accel.sh@19 -- # read -r var val 00:08:19.710 02:27:53 -- accel/accel.sh@20 -- # val= 00:08:19.710 02:27:53 -- accel/accel.sh@21 -- # case "$var" in 00:08:19.710 02:27:53 -- accel/accel.sh@19 -- # IFS=: 00:08:19.710 02:27:53 -- accel/accel.sh@19 -- # read -r var val 00:08:19.710 02:27:53 -- accel/accel.sh@27 -- # [[ -n software ]] 00:08:19.710 02:27:53 -- accel/accel.sh@27 -- # [[ -n fill ]] 00:08:19.710 02:27:53 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:19.710 00:08:19.710 real 0m1.407s 00:08:19.710 user 0m1.273s 00:08:19.710 sys 0m0.136s 00:08:19.710 02:27:53 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:19.710 02:27:53 -- common/autotest_common.sh@10 -- # set +x 00:08:19.710 ************************************ 00:08:19.710 END TEST accel_fill 00:08:19.710 ************************************ 00:08:19.710 02:27:53 -- accel/accel.sh@105 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:08:19.710 02:27:53 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:08:19.710 02:27:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:19.710 02:27:53 -- common/autotest_common.sh@10 -- # set +x 00:08:19.710 ************************************ 00:08:19.710 START TEST accel_copy_crc32c 00:08:19.710 ************************************ 00:08:19.710 02:27:53 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w copy_crc32c -y 00:08:19.710 02:27:53 -- accel/accel.sh@16 -- # local accel_opc 00:08:19.710 02:27:53 -- accel/accel.sh@17 -- # local accel_module 00:08:19.710 02:27:53 -- accel/accel.sh@19 -- # IFS=: 00:08:19.710 02:27:53 -- accel/accel.sh@19 -- # read -r var val 00:08:19.710 02:27:53 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:08:19.710 02:27:53 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:08:19.710 02:27:53 -- accel/accel.sh@12 -- # build_accel_config 00:08:19.710 02:27:53 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:08:19.710 02:27:53 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:08:19.710 02:27:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:19.710 02:27:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:19.710 02:27:53 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:08:19.710 02:27:53 -- accel/accel.sh@40 -- # local IFS=, 00:08:19.710 02:27:53 -- accel/accel.sh@41 -- # jq -r . 00:08:19.710 [2024-04-27 02:27:53.230130] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:08:19.710 [2024-04-27 02:27:53.230178] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1436931 ] 00:08:19.710 EAL: No free 2048 kB hugepages reported on node 1 00:08:19.710 [2024-04-27 02:27:53.300513] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:19.969 [2024-04-27 02:27:53.383685] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:19.969 02:27:53 -- accel/accel.sh@20 -- # val= 00:08:19.969 02:27:53 -- accel/accel.sh@21 -- # case "$var" in 00:08:19.969 02:27:53 -- accel/accel.sh@19 -- # IFS=: 00:08:19.969 02:27:53 -- accel/accel.sh@19 -- # read -r var val 00:08:19.969 02:27:53 -- accel/accel.sh@20 -- # val= 00:08:19.969 02:27:53 -- accel/accel.sh@21 -- # case "$var" in 00:08:19.969 02:27:53 -- accel/accel.sh@19 -- # IFS=: 00:08:19.969 02:27:53 -- accel/accel.sh@19 -- # read -r var val 00:08:19.969 02:27:53 -- accel/accel.sh@20 -- # val=0x1 00:08:19.969 02:27:53 -- accel/accel.sh@21 -- # case "$var" in 00:08:19.969 02:27:53 -- accel/accel.sh@19 -- # IFS=: 00:08:19.969 02:27:53 -- accel/accel.sh@19 -- # read -r var val 00:08:19.969 02:27:53 -- accel/accel.sh@20 -- # val= 00:08:19.969 02:27:53 -- accel/accel.sh@21 -- # case "$var" in 00:08:19.969 02:27:53 -- accel/accel.sh@19 -- # IFS=: 00:08:19.969 02:27:53 -- accel/accel.sh@19 -- # read -r var val 00:08:19.969 02:27:53 -- accel/accel.sh@20 -- # val= 00:08:19.969 02:27:53 -- accel/accel.sh@21 -- # case "$var" in 00:08:19.969 02:27:53 -- accel/accel.sh@19 -- # IFS=: 00:08:19.969 02:27:53 -- accel/accel.sh@19 -- # read -r var val 00:08:19.969 02:27:53 -- accel/accel.sh@20 -- # val=copy_crc32c 00:08:19.969 02:27:53 -- accel/accel.sh@21 -- # case "$var" in 00:08:19.969 02:27:53 -- accel/accel.sh@23 -- # accel_opc=copy_crc32c 00:08:19.969 02:27:53 -- accel/accel.sh@19 -- # IFS=: 00:08:19.969 02:27:53 -- accel/accel.sh@19 -- # read -r var val 00:08:19.969 02:27:53 -- accel/accel.sh@20 -- # val=0 00:08:19.969 02:27:53 -- accel/accel.sh@21 -- # case "$var" in 00:08:19.969 02:27:53 -- accel/accel.sh@19 -- # IFS=: 00:08:19.969 02:27:53 -- accel/accel.sh@19 -- # read -r var val 00:08:19.969 02:27:53 -- accel/accel.sh@20 -- # val='4096 bytes' 00:08:19.969 02:27:53 -- accel/accel.sh@21 -- # case "$var" in 00:08:19.969 02:27:53 -- accel/accel.sh@19 -- # IFS=: 00:08:19.969 02:27:53 -- accel/accel.sh@19 -- # read -r var val 00:08:19.969 02:27:53 -- accel/accel.sh@20 -- # val='4096 bytes' 00:08:19.969 02:27:53 -- accel/accel.sh@21 -- # case "$var" in 00:08:19.969 02:27:53 -- accel/accel.sh@19 -- # IFS=: 00:08:19.969 02:27:53 -- accel/accel.sh@19 -- # read -r var val 00:08:19.969 02:27:53 -- accel/accel.sh@20 -- # val= 00:08:19.969 02:27:53 -- accel/accel.sh@21 -- # case "$var" in 00:08:19.969 02:27:53 -- accel/accel.sh@19 -- # IFS=: 00:08:19.969 02:27:53 -- accel/accel.sh@19 -- # read -r var val 00:08:19.969 02:27:53 -- accel/accel.sh@20 -- # val=software 00:08:19.969 02:27:53 -- accel/accel.sh@21 -- # case "$var" in 00:08:19.969 02:27:53 -- accel/accel.sh@22 -- # accel_module=software 00:08:19.969 02:27:53 -- accel/accel.sh@19 -- # IFS=: 00:08:19.969 02:27:53 -- accel/accel.sh@19 -- # read -r var val 00:08:19.969 02:27:53 -- accel/accel.sh@20 -- # val=32 00:08:19.969 02:27:53 -- accel/accel.sh@21 -- # case "$var" in 00:08:19.969 02:27:53 -- accel/accel.sh@19 -- # IFS=: 00:08:19.969 02:27:53 -- accel/accel.sh@19 -- # read -r var val 00:08:19.969 02:27:53 -- accel/accel.sh@20 -- # val=32 00:08:19.969 02:27:53 -- accel/accel.sh@21 -- # case "$var" in 00:08:19.969 02:27:53 -- accel/accel.sh@19 -- # IFS=: 00:08:19.969 02:27:53 -- accel/accel.sh@19 -- # read -r var val 00:08:19.969 02:27:53 -- accel/accel.sh@20 -- # val=1 00:08:19.969 02:27:53 -- accel/accel.sh@21 -- # case "$var" in 00:08:19.969 02:27:53 -- accel/accel.sh@19 -- # IFS=: 00:08:19.969 02:27:53 -- accel/accel.sh@19 -- # read -r var val 00:08:19.969 02:27:53 -- accel/accel.sh@20 -- # val='1 seconds' 00:08:19.969 02:27:53 -- accel/accel.sh@21 -- # case "$var" in 00:08:19.969 02:27:53 -- accel/accel.sh@19 -- # IFS=: 00:08:19.969 02:27:53 -- accel/accel.sh@19 -- # read -r var val 00:08:19.969 02:27:53 -- accel/accel.sh@20 -- # val=Yes 00:08:19.969 02:27:53 -- accel/accel.sh@21 -- # case "$var" in 00:08:19.969 02:27:53 -- accel/accel.sh@19 -- # IFS=: 00:08:19.969 02:27:53 -- accel/accel.sh@19 -- # read -r var val 00:08:19.969 02:27:53 -- accel/accel.sh@20 -- # val= 00:08:19.969 02:27:53 -- accel/accel.sh@21 -- # case "$var" in 00:08:19.969 02:27:53 -- accel/accel.sh@19 -- # IFS=: 00:08:19.969 02:27:53 -- accel/accel.sh@19 -- # read -r var val 00:08:19.969 02:27:53 -- accel/accel.sh@20 -- # val= 00:08:19.969 02:27:53 -- accel/accel.sh@21 -- # case "$var" in 00:08:19.969 02:27:53 -- accel/accel.sh@19 -- # IFS=: 00:08:19.969 02:27:53 -- accel/accel.sh@19 -- # read -r var val 00:08:21.348 02:27:54 -- accel/accel.sh@20 -- # val= 00:08:21.348 02:27:54 -- accel/accel.sh@21 -- # case "$var" in 00:08:21.348 02:27:54 -- accel/accel.sh@19 -- # IFS=: 00:08:21.348 02:27:54 -- accel/accel.sh@19 -- # read -r var val 00:08:21.348 02:27:54 -- accel/accel.sh@20 -- # val= 00:08:21.348 02:27:54 -- accel/accel.sh@21 -- # case "$var" in 00:08:21.348 02:27:54 -- accel/accel.sh@19 -- # IFS=: 00:08:21.348 02:27:54 -- accel/accel.sh@19 -- # read -r var val 00:08:21.348 02:27:54 -- accel/accel.sh@20 -- # val= 00:08:21.348 02:27:54 -- accel/accel.sh@21 -- # case "$var" in 00:08:21.348 02:27:54 -- accel/accel.sh@19 -- # IFS=: 00:08:21.348 02:27:54 -- accel/accel.sh@19 -- # read -r var val 00:08:21.348 02:27:54 -- accel/accel.sh@20 -- # val= 00:08:21.348 02:27:54 -- accel/accel.sh@21 -- # case "$var" in 00:08:21.348 02:27:54 -- accel/accel.sh@19 -- # IFS=: 00:08:21.348 02:27:54 -- accel/accel.sh@19 -- # read -r var val 00:08:21.348 02:27:54 -- accel/accel.sh@20 -- # val= 00:08:21.348 02:27:54 -- accel/accel.sh@21 -- # case "$var" in 00:08:21.348 02:27:54 -- accel/accel.sh@19 -- # IFS=: 00:08:21.348 02:27:54 -- accel/accel.sh@19 -- # read -r var val 00:08:21.348 02:27:54 -- accel/accel.sh@20 -- # val= 00:08:21.348 02:27:54 -- accel/accel.sh@21 -- # case "$var" in 00:08:21.348 02:27:54 -- accel/accel.sh@19 -- # IFS=: 00:08:21.348 02:27:54 -- accel/accel.sh@19 -- # read -r var val 00:08:21.348 02:27:54 -- accel/accel.sh@27 -- # [[ -n software ]] 00:08:21.348 02:27:54 -- accel/accel.sh@27 -- # [[ -n copy_crc32c ]] 00:08:21.348 02:27:54 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:21.348 00:08:21.348 real 0m1.401s 00:08:21.348 user 0m1.253s 00:08:21.348 sys 0m0.151s 00:08:21.348 02:27:54 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:21.348 02:27:54 -- common/autotest_common.sh@10 -- # set +x 00:08:21.348 ************************************ 00:08:21.348 END TEST accel_copy_crc32c 00:08:21.348 ************************************ 00:08:21.348 02:27:54 -- accel/accel.sh@106 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:08:21.348 02:27:54 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:08:21.348 02:27:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:21.348 02:27:54 -- common/autotest_common.sh@10 -- # set +x 00:08:21.348 ************************************ 00:08:21.348 START TEST accel_copy_crc32c_C2 00:08:21.348 ************************************ 00:08:21.348 02:27:54 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:08:21.348 02:27:54 -- accel/accel.sh@16 -- # local accel_opc 00:08:21.348 02:27:54 -- accel/accel.sh@17 -- # local accel_module 00:08:21.348 02:27:54 -- accel/accel.sh@19 -- # IFS=: 00:08:21.348 02:27:54 -- accel/accel.sh@19 -- # read -r var val 00:08:21.348 02:27:54 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:08:21.348 02:27:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:08:21.348 02:27:54 -- accel/accel.sh@12 -- # build_accel_config 00:08:21.348 02:27:54 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:08:21.348 02:27:54 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:08:21.348 02:27:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:21.348 02:27:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:21.348 02:27:54 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:08:21.348 02:27:54 -- accel/accel.sh@40 -- # local IFS=, 00:08:21.348 02:27:54 -- accel/accel.sh@41 -- # jq -r . 00:08:21.348 [2024-04-27 02:27:54.823154] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:08:21.348 [2024-04-27 02:27:54.823204] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1437147 ] 00:08:21.348 EAL: No free 2048 kB hugepages reported on node 1 00:08:21.348 [2024-04-27 02:27:54.896518] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:21.608 [2024-04-27 02:27:54.980459] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:21.608 02:27:55 -- accel/accel.sh@20 -- # val= 00:08:21.608 02:27:55 -- accel/accel.sh@21 -- # case "$var" in 00:08:21.608 02:27:55 -- accel/accel.sh@19 -- # IFS=: 00:08:21.608 02:27:55 -- accel/accel.sh@19 -- # read -r var val 00:08:21.608 02:27:55 -- accel/accel.sh@20 -- # val= 00:08:21.608 02:27:55 -- accel/accel.sh@21 -- # case "$var" in 00:08:21.608 02:27:55 -- accel/accel.sh@19 -- # IFS=: 00:08:21.608 02:27:55 -- accel/accel.sh@19 -- # read -r var val 00:08:21.608 02:27:55 -- accel/accel.sh@20 -- # val=0x1 00:08:21.608 02:27:55 -- accel/accel.sh@21 -- # case "$var" in 00:08:21.608 02:27:55 -- accel/accel.sh@19 -- # IFS=: 00:08:21.608 02:27:55 -- accel/accel.sh@19 -- # read -r var val 00:08:21.609 02:27:55 -- accel/accel.sh@20 -- # val= 00:08:21.609 02:27:55 -- accel/accel.sh@21 -- # case "$var" in 00:08:21.609 02:27:55 -- accel/accel.sh@19 -- # IFS=: 00:08:21.609 02:27:55 -- accel/accel.sh@19 -- # read -r var val 00:08:21.609 02:27:55 -- accel/accel.sh@20 -- # val= 00:08:21.609 02:27:55 -- accel/accel.sh@21 -- # case "$var" in 00:08:21.609 02:27:55 -- accel/accel.sh@19 -- # IFS=: 00:08:21.609 02:27:55 -- accel/accel.sh@19 -- # read -r var val 00:08:21.609 02:27:55 -- accel/accel.sh@20 -- # val=copy_crc32c 00:08:21.609 02:27:55 -- accel/accel.sh@21 -- # case "$var" in 00:08:21.609 02:27:55 -- accel/accel.sh@23 -- # accel_opc=copy_crc32c 00:08:21.609 02:27:55 -- accel/accel.sh@19 -- # IFS=: 00:08:21.609 02:27:55 -- accel/accel.sh@19 -- # read -r var val 00:08:21.609 02:27:55 -- accel/accel.sh@20 -- # val=0 00:08:21.609 02:27:55 -- accel/accel.sh@21 -- # case "$var" in 00:08:21.609 02:27:55 -- accel/accel.sh@19 -- # IFS=: 00:08:21.609 02:27:55 -- accel/accel.sh@19 -- # read -r var val 00:08:21.609 02:27:55 -- accel/accel.sh@20 -- # val='4096 bytes' 00:08:21.609 02:27:55 -- accel/accel.sh@21 -- # case "$var" in 00:08:21.609 02:27:55 -- accel/accel.sh@19 -- # IFS=: 00:08:21.609 02:27:55 -- accel/accel.sh@19 -- # read -r var val 00:08:21.609 02:27:55 -- accel/accel.sh@20 -- # val='8192 bytes' 00:08:21.609 02:27:55 -- accel/accel.sh@21 -- # case "$var" in 00:08:21.609 02:27:55 -- accel/accel.sh@19 -- # IFS=: 00:08:21.609 02:27:55 -- accel/accel.sh@19 -- # read -r var val 00:08:21.609 02:27:55 -- accel/accel.sh@20 -- # val= 00:08:21.609 02:27:55 -- accel/accel.sh@21 -- # case "$var" in 00:08:21.609 02:27:55 -- accel/accel.sh@19 -- # IFS=: 00:08:21.609 02:27:55 -- accel/accel.sh@19 -- # read -r var val 00:08:21.609 02:27:55 -- accel/accel.sh@20 -- # val=software 00:08:21.609 02:27:55 -- accel/accel.sh@21 -- # case "$var" in 00:08:21.609 02:27:55 -- accel/accel.sh@22 -- # accel_module=software 00:08:21.609 02:27:55 -- accel/accel.sh@19 -- # IFS=: 00:08:21.609 02:27:55 -- accel/accel.sh@19 -- # read -r var val 00:08:21.609 02:27:55 -- accel/accel.sh@20 -- # val=32 00:08:21.609 02:27:55 -- accel/accel.sh@21 -- # case "$var" in 00:08:21.609 02:27:55 -- accel/accel.sh@19 -- # IFS=: 00:08:21.609 02:27:55 -- accel/accel.sh@19 -- # read -r var val 00:08:21.609 02:27:55 -- accel/accel.sh@20 -- # val=32 00:08:21.609 02:27:55 -- accel/accel.sh@21 -- # case "$var" in 00:08:21.609 02:27:55 -- accel/accel.sh@19 -- # IFS=: 00:08:21.609 02:27:55 -- accel/accel.sh@19 -- # read -r var val 00:08:21.609 02:27:55 -- accel/accel.sh@20 -- # val=1 00:08:21.609 02:27:55 -- accel/accel.sh@21 -- # case "$var" in 00:08:21.609 02:27:55 -- accel/accel.sh@19 -- # IFS=: 00:08:21.609 02:27:55 -- accel/accel.sh@19 -- # read -r var val 00:08:21.609 02:27:55 -- accel/accel.sh@20 -- # val='1 seconds' 00:08:21.609 02:27:55 -- accel/accel.sh@21 -- # case "$var" in 00:08:21.609 02:27:55 -- accel/accel.sh@19 -- # IFS=: 00:08:21.609 02:27:55 -- accel/accel.sh@19 -- # read -r var val 00:08:21.609 02:27:55 -- accel/accel.sh@20 -- # val=Yes 00:08:21.609 02:27:55 -- accel/accel.sh@21 -- # case "$var" in 00:08:21.609 02:27:55 -- accel/accel.sh@19 -- # IFS=: 00:08:21.609 02:27:55 -- accel/accel.sh@19 -- # read -r var val 00:08:21.609 02:27:55 -- accel/accel.sh@20 -- # val= 00:08:21.609 02:27:55 -- accel/accel.sh@21 -- # case "$var" in 00:08:21.609 02:27:55 -- accel/accel.sh@19 -- # IFS=: 00:08:21.609 02:27:55 -- accel/accel.sh@19 -- # read -r var val 00:08:21.609 02:27:55 -- accel/accel.sh@20 -- # val= 00:08:21.609 02:27:55 -- accel/accel.sh@21 -- # case "$var" in 00:08:21.609 02:27:55 -- accel/accel.sh@19 -- # IFS=: 00:08:21.609 02:27:55 -- accel/accel.sh@19 -- # read -r var val 00:08:22.985 02:27:56 -- accel/accel.sh@20 -- # val= 00:08:22.985 02:27:56 -- accel/accel.sh@21 -- # case "$var" in 00:08:22.985 02:27:56 -- accel/accel.sh@19 -- # IFS=: 00:08:22.985 02:27:56 -- accel/accel.sh@19 -- # read -r var val 00:08:22.985 02:27:56 -- accel/accel.sh@20 -- # val= 00:08:22.985 02:27:56 -- accel/accel.sh@21 -- # case "$var" in 00:08:22.985 02:27:56 -- accel/accel.sh@19 -- # IFS=: 00:08:22.985 02:27:56 -- accel/accel.sh@19 -- # read -r var val 00:08:22.985 02:27:56 -- accel/accel.sh@20 -- # val= 00:08:22.985 02:27:56 -- accel/accel.sh@21 -- # case "$var" in 00:08:22.985 02:27:56 -- accel/accel.sh@19 -- # IFS=: 00:08:22.985 02:27:56 -- accel/accel.sh@19 -- # read -r var val 00:08:22.985 02:27:56 -- accel/accel.sh@20 -- # val= 00:08:22.985 02:27:56 -- accel/accel.sh@21 -- # case "$var" in 00:08:22.985 02:27:56 -- accel/accel.sh@19 -- # IFS=: 00:08:22.985 02:27:56 -- accel/accel.sh@19 -- # read -r var val 00:08:22.985 02:27:56 -- accel/accel.sh@20 -- # val= 00:08:22.985 02:27:56 -- accel/accel.sh@21 -- # case "$var" in 00:08:22.985 02:27:56 -- accel/accel.sh@19 -- # IFS=: 00:08:22.985 02:27:56 -- accel/accel.sh@19 -- # read -r var val 00:08:22.985 02:27:56 -- accel/accel.sh@20 -- # val= 00:08:22.985 02:27:56 -- accel/accel.sh@21 -- # case "$var" in 00:08:22.985 02:27:56 -- accel/accel.sh@19 -- # IFS=: 00:08:22.985 02:27:56 -- accel/accel.sh@19 -- # read -r var val 00:08:22.985 02:27:56 -- accel/accel.sh@27 -- # [[ -n software ]] 00:08:22.985 02:27:56 -- accel/accel.sh@27 -- # [[ -n copy_crc32c ]] 00:08:22.985 02:27:56 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:22.985 00:08:22.985 real 0m1.403s 00:08:22.985 user 0m1.273s 00:08:22.985 sys 0m0.132s 00:08:22.985 02:27:56 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:22.985 02:27:56 -- common/autotest_common.sh@10 -- # set +x 00:08:22.985 ************************************ 00:08:22.985 END TEST accel_copy_crc32c_C2 00:08:22.985 ************************************ 00:08:22.985 02:27:56 -- accel/accel.sh@107 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:08:22.985 02:27:56 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:08:22.985 02:27:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:22.985 02:27:56 -- common/autotest_common.sh@10 -- # set +x 00:08:22.985 ************************************ 00:08:22.985 START TEST accel_dualcast 00:08:22.985 ************************************ 00:08:22.985 02:27:56 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w dualcast -y 00:08:22.985 02:27:56 -- accel/accel.sh@16 -- # local accel_opc 00:08:22.985 02:27:56 -- accel/accel.sh@17 -- # local accel_module 00:08:22.985 02:27:56 -- accel/accel.sh@19 -- # IFS=: 00:08:22.985 02:27:56 -- accel/accel.sh@19 -- # read -r var val 00:08:22.985 02:27:56 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:08:22.985 02:27:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:08:22.985 02:27:56 -- accel/accel.sh@12 -- # build_accel_config 00:08:22.985 02:27:56 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:08:22.985 02:27:56 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:08:22.985 02:27:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:22.985 02:27:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:22.985 02:27:56 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:08:22.985 02:27:56 -- accel/accel.sh@40 -- # local IFS=, 00:08:22.985 02:27:56 -- accel/accel.sh@41 -- # jq -r . 00:08:22.985 [2024-04-27 02:27:56.407480] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:08:22.985 [2024-04-27 02:27:56.407541] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1437453 ] 00:08:22.985 EAL: No free 2048 kB hugepages reported on node 1 00:08:22.985 [2024-04-27 02:27:56.479706] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:22.985 [2024-04-27 02:27:56.563238] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:23.244 02:27:56 -- accel/accel.sh@20 -- # val= 00:08:23.244 02:27:56 -- accel/accel.sh@21 -- # case "$var" in 00:08:23.244 02:27:56 -- accel/accel.sh@19 -- # IFS=: 00:08:23.244 02:27:56 -- accel/accel.sh@19 -- # read -r var val 00:08:23.244 02:27:56 -- accel/accel.sh@20 -- # val= 00:08:23.244 02:27:56 -- accel/accel.sh@21 -- # case "$var" in 00:08:23.244 02:27:56 -- accel/accel.sh@19 -- # IFS=: 00:08:23.244 02:27:56 -- accel/accel.sh@19 -- # read -r var val 00:08:23.244 02:27:56 -- accel/accel.sh@20 -- # val=0x1 00:08:23.244 02:27:56 -- accel/accel.sh@21 -- # case "$var" in 00:08:23.244 02:27:56 -- accel/accel.sh@19 -- # IFS=: 00:08:23.244 02:27:56 -- accel/accel.sh@19 -- # read -r var val 00:08:23.244 02:27:56 -- accel/accel.sh@20 -- # val= 00:08:23.244 02:27:56 -- accel/accel.sh@21 -- # case "$var" in 00:08:23.244 02:27:56 -- accel/accel.sh@19 -- # IFS=: 00:08:23.244 02:27:56 -- accel/accel.sh@19 -- # read -r var val 00:08:23.244 02:27:56 -- accel/accel.sh@20 -- # val= 00:08:23.244 02:27:56 -- accel/accel.sh@21 -- # case "$var" in 00:08:23.244 02:27:56 -- accel/accel.sh@19 -- # IFS=: 00:08:23.244 02:27:56 -- accel/accel.sh@19 -- # read -r var val 00:08:23.244 02:27:56 -- accel/accel.sh@20 -- # val=dualcast 00:08:23.244 02:27:56 -- accel/accel.sh@21 -- # case "$var" in 00:08:23.244 02:27:56 -- accel/accel.sh@23 -- # accel_opc=dualcast 00:08:23.244 02:27:56 -- accel/accel.sh@19 -- # IFS=: 00:08:23.244 02:27:56 -- accel/accel.sh@19 -- # read -r var val 00:08:23.244 02:27:56 -- accel/accel.sh@20 -- # val='4096 bytes' 00:08:23.244 02:27:56 -- accel/accel.sh@21 -- # case "$var" in 00:08:23.244 02:27:56 -- accel/accel.sh@19 -- # IFS=: 00:08:23.244 02:27:56 -- accel/accel.sh@19 -- # read -r var val 00:08:23.244 02:27:56 -- accel/accel.sh@20 -- # val= 00:08:23.244 02:27:56 -- accel/accel.sh@21 -- # case "$var" in 00:08:23.244 02:27:56 -- accel/accel.sh@19 -- # IFS=: 00:08:23.244 02:27:56 -- accel/accel.sh@19 -- # read -r var val 00:08:23.244 02:27:56 -- accel/accel.sh@20 -- # val=software 00:08:23.244 02:27:56 -- accel/accel.sh@21 -- # case "$var" in 00:08:23.244 02:27:56 -- accel/accel.sh@22 -- # accel_module=software 00:08:23.244 02:27:56 -- accel/accel.sh@19 -- # IFS=: 00:08:23.244 02:27:56 -- accel/accel.sh@19 -- # read -r var val 00:08:23.244 02:27:56 -- accel/accel.sh@20 -- # val=32 00:08:23.244 02:27:56 -- accel/accel.sh@21 -- # case "$var" in 00:08:23.244 02:27:56 -- accel/accel.sh@19 -- # IFS=: 00:08:23.244 02:27:56 -- accel/accel.sh@19 -- # read -r var val 00:08:23.244 02:27:56 -- accel/accel.sh@20 -- # val=32 00:08:23.244 02:27:56 -- accel/accel.sh@21 -- # case "$var" in 00:08:23.244 02:27:56 -- accel/accel.sh@19 -- # IFS=: 00:08:23.244 02:27:56 -- accel/accel.sh@19 -- # read -r var val 00:08:23.244 02:27:56 -- accel/accel.sh@20 -- # val=1 00:08:23.244 02:27:56 -- accel/accel.sh@21 -- # case "$var" in 00:08:23.244 02:27:56 -- accel/accel.sh@19 -- # IFS=: 00:08:23.244 02:27:56 -- accel/accel.sh@19 -- # read -r var val 00:08:23.244 02:27:56 -- accel/accel.sh@20 -- # val='1 seconds' 00:08:23.244 02:27:56 -- accel/accel.sh@21 -- # case "$var" in 00:08:23.244 02:27:56 -- accel/accel.sh@19 -- # IFS=: 00:08:23.244 02:27:56 -- accel/accel.sh@19 -- # read -r var val 00:08:23.244 02:27:56 -- accel/accel.sh@20 -- # val=Yes 00:08:23.244 02:27:56 -- accel/accel.sh@21 -- # case "$var" in 00:08:23.244 02:27:56 -- accel/accel.sh@19 -- # IFS=: 00:08:23.244 02:27:56 -- accel/accel.sh@19 -- # read -r var val 00:08:23.244 02:27:56 -- accel/accel.sh@20 -- # val= 00:08:23.244 02:27:56 -- accel/accel.sh@21 -- # case "$var" in 00:08:23.244 02:27:56 -- accel/accel.sh@19 -- # IFS=: 00:08:23.244 02:27:56 -- accel/accel.sh@19 -- # read -r var val 00:08:23.244 02:27:56 -- accel/accel.sh@20 -- # val= 00:08:23.244 02:27:56 -- accel/accel.sh@21 -- # case "$var" in 00:08:23.244 02:27:56 -- accel/accel.sh@19 -- # IFS=: 00:08:23.244 02:27:56 -- accel/accel.sh@19 -- # read -r var val 00:08:24.179 02:27:57 -- accel/accel.sh@20 -- # val= 00:08:24.179 02:27:57 -- accel/accel.sh@21 -- # case "$var" in 00:08:24.179 02:27:57 -- accel/accel.sh@19 -- # IFS=: 00:08:24.179 02:27:57 -- accel/accel.sh@19 -- # read -r var val 00:08:24.179 02:27:57 -- accel/accel.sh@20 -- # val= 00:08:24.179 02:27:57 -- accel/accel.sh@21 -- # case "$var" in 00:08:24.179 02:27:57 -- accel/accel.sh@19 -- # IFS=: 00:08:24.179 02:27:57 -- accel/accel.sh@19 -- # read -r var val 00:08:24.179 02:27:57 -- accel/accel.sh@20 -- # val= 00:08:24.179 02:27:57 -- accel/accel.sh@21 -- # case "$var" in 00:08:24.179 02:27:57 -- accel/accel.sh@19 -- # IFS=: 00:08:24.179 02:27:57 -- accel/accel.sh@19 -- # read -r var val 00:08:24.179 02:27:57 -- accel/accel.sh@20 -- # val= 00:08:24.179 02:27:57 -- accel/accel.sh@21 -- # case "$var" in 00:08:24.179 02:27:57 -- accel/accel.sh@19 -- # IFS=: 00:08:24.179 02:27:57 -- accel/accel.sh@19 -- # read -r var val 00:08:24.179 02:27:57 -- accel/accel.sh@20 -- # val= 00:08:24.179 02:27:57 -- accel/accel.sh@21 -- # case "$var" in 00:08:24.179 02:27:57 -- accel/accel.sh@19 -- # IFS=: 00:08:24.179 02:27:57 -- accel/accel.sh@19 -- # read -r var val 00:08:24.179 02:27:57 -- accel/accel.sh@20 -- # val= 00:08:24.179 02:27:57 -- accel/accel.sh@21 -- # case "$var" in 00:08:24.179 02:27:57 -- accel/accel.sh@19 -- # IFS=: 00:08:24.179 02:27:57 -- accel/accel.sh@19 -- # read -r var val 00:08:24.179 02:27:57 -- accel/accel.sh@27 -- # [[ -n software ]] 00:08:24.179 02:27:57 -- accel/accel.sh@27 -- # [[ -n dualcast ]] 00:08:24.179 02:27:57 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:24.179 00:08:24.179 real 0m1.403s 00:08:24.179 user 0m1.272s 00:08:24.179 sys 0m0.135s 00:08:24.179 02:27:57 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:24.179 02:27:57 -- common/autotest_common.sh@10 -- # set +x 00:08:24.179 ************************************ 00:08:24.179 END TEST accel_dualcast 00:08:24.179 ************************************ 00:08:24.437 02:27:57 -- accel/accel.sh@108 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:08:24.437 02:27:57 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:08:24.437 02:27:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:24.437 02:27:57 -- common/autotest_common.sh@10 -- # set +x 00:08:24.437 ************************************ 00:08:24.437 START TEST accel_compare 00:08:24.438 ************************************ 00:08:24.438 02:27:57 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w compare -y 00:08:24.438 02:27:57 -- accel/accel.sh@16 -- # local accel_opc 00:08:24.438 02:27:57 -- accel/accel.sh@17 -- # local accel_module 00:08:24.438 02:27:57 -- accel/accel.sh@19 -- # IFS=: 00:08:24.438 02:27:57 -- accel/accel.sh@19 -- # read -r var val 00:08:24.438 02:27:57 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:08:24.438 02:27:57 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:08:24.438 02:27:57 -- accel/accel.sh@12 -- # build_accel_config 00:08:24.438 02:27:57 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:08:24.438 02:27:57 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:08:24.438 02:27:57 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:24.438 02:27:57 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:24.438 02:27:57 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:08:24.438 02:27:57 -- accel/accel.sh@40 -- # local IFS=, 00:08:24.438 02:27:57 -- accel/accel.sh@41 -- # jq -r . 00:08:24.438 [2024-04-27 02:27:57.993908] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:08:24.438 [2024-04-27 02:27:57.993972] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1437730 ] 00:08:24.438 EAL: No free 2048 kB hugepages reported on node 1 00:08:24.696 [2024-04-27 02:27:58.069070] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:24.696 [2024-04-27 02:27:58.151434] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:24.696 02:27:58 -- accel/accel.sh@20 -- # val= 00:08:24.696 02:27:58 -- accel/accel.sh@21 -- # case "$var" in 00:08:24.696 02:27:58 -- accel/accel.sh@19 -- # IFS=: 00:08:24.696 02:27:58 -- accel/accel.sh@19 -- # read -r var val 00:08:24.696 02:27:58 -- accel/accel.sh@20 -- # val= 00:08:24.696 02:27:58 -- accel/accel.sh@21 -- # case "$var" in 00:08:24.696 02:27:58 -- accel/accel.sh@19 -- # IFS=: 00:08:24.696 02:27:58 -- accel/accel.sh@19 -- # read -r var val 00:08:24.696 02:27:58 -- accel/accel.sh@20 -- # val=0x1 00:08:24.696 02:27:58 -- accel/accel.sh@21 -- # case "$var" in 00:08:24.696 02:27:58 -- accel/accel.sh@19 -- # IFS=: 00:08:24.696 02:27:58 -- accel/accel.sh@19 -- # read -r var val 00:08:24.696 02:27:58 -- accel/accel.sh@20 -- # val= 00:08:24.696 02:27:58 -- accel/accel.sh@21 -- # case "$var" in 00:08:24.696 02:27:58 -- accel/accel.sh@19 -- # IFS=: 00:08:24.696 02:27:58 -- accel/accel.sh@19 -- # read -r var val 00:08:24.696 02:27:58 -- accel/accel.sh@20 -- # val= 00:08:24.696 02:27:58 -- accel/accel.sh@21 -- # case "$var" in 00:08:24.696 02:27:58 -- accel/accel.sh@19 -- # IFS=: 00:08:24.696 02:27:58 -- accel/accel.sh@19 -- # read -r var val 00:08:24.696 02:27:58 -- accel/accel.sh@20 -- # val=compare 00:08:24.696 02:27:58 -- accel/accel.sh@21 -- # case "$var" in 00:08:24.696 02:27:58 -- accel/accel.sh@23 -- # accel_opc=compare 00:08:24.696 02:27:58 -- accel/accel.sh@19 -- # IFS=: 00:08:24.696 02:27:58 -- accel/accel.sh@19 -- # read -r var val 00:08:24.696 02:27:58 -- accel/accel.sh@20 -- # val='4096 bytes' 00:08:24.696 02:27:58 -- accel/accel.sh@21 -- # case "$var" in 00:08:24.696 02:27:58 -- accel/accel.sh@19 -- # IFS=: 00:08:24.696 02:27:58 -- accel/accel.sh@19 -- # read -r var val 00:08:24.696 02:27:58 -- accel/accel.sh@20 -- # val= 00:08:24.696 02:27:58 -- accel/accel.sh@21 -- # case "$var" in 00:08:24.696 02:27:58 -- accel/accel.sh@19 -- # IFS=: 00:08:24.696 02:27:58 -- accel/accel.sh@19 -- # read -r var val 00:08:24.696 02:27:58 -- accel/accel.sh@20 -- # val=software 00:08:24.696 02:27:58 -- accel/accel.sh@21 -- # case "$var" in 00:08:24.696 02:27:58 -- accel/accel.sh@22 -- # accel_module=software 00:08:24.696 02:27:58 -- accel/accel.sh@19 -- # IFS=: 00:08:24.696 02:27:58 -- accel/accel.sh@19 -- # read -r var val 00:08:24.696 02:27:58 -- accel/accel.sh@20 -- # val=32 00:08:24.696 02:27:58 -- accel/accel.sh@21 -- # case "$var" in 00:08:24.697 02:27:58 -- accel/accel.sh@19 -- # IFS=: 00:08:24.697 02:27:58 -- accel/accel.sh@19 -- # read -r var val 00:08:24.697 02:27:58 -- accel/accel.sh@20 -- # val=32 00:08:24.697 02:27:58 -- accel/accel.sh@21 -- # case "$var" in 00:08:24.697 02:27:58 -- accel/accel.sh@19 -- # IFS=: 00:08:24.697 02:27:58 -- accel/accel.sh@19 -- # read -r var val 00:08:24.697 02:27:58 -- accel/accel.sh@20 -- # val=1 00:08:24.697 02:27:58 -- accel/accel.sh@21 -- # case "$var" in 00:08:24.697 02:27:58 -- accel/accel.sh@19 -- # IFS=: 00:08:24.697 02:27:58 -- accel/accel.sh@19 -- # read -r var val 00:08:24.697 02:27:58 -- accel/accel.sh@20 -- # val='1 seconds' 00:08:24.697 02:27:58 -- accel/accel.sh@21 -- # case "$var" in 00:08:24.697 02:27:58 -- accel/accel.sh@19 -- # IFS=: 00:08:24.697 02:27:58 -- accel/accel.sh@19 -- # read -r var val 00:08:24.697 02:27:58 -- accel/accel.sh@20 -- # val=Yes 00:08:24.697 02:27:58 -- accel/accel.sh@21 -- # case "$var" in 00:08:24.697 02:27:58 -- accel/accel.sh@19 -- # IFS=: 00:08:24.697 02:27:58 -- accel/accel.sh@19 -- # read -r var val 00:08:24.697 02:27:58 -- accel/accel.sh@20 -- # val= 00:08:24.697 02:27:58 -- accel/accel.sh@21 -- # case "$var" in 00:08:24.697 02:27:58 -- accel/accel.sh@19 -- # IFS=: 00:08:24.697 02:27:58 -- accel/accel.sh@19 -- # read -r var val 00:08:24.697 02:27:58 -- accel/accel.sh@20 -- # val= 00:08:24.697 02:27:58 -- accel/accel.sh@21 -- # case "$var" in 00:08:24.697 02:27:58 -- accel/accel.sh@19 -- # IFS=: 00:08:24.697 02:27:58 -- accel/accel.sh@19 -- # read -r var val 00:08:26.074 02:27:59 -- accel/accel.sh@20 -- # val= 00:08:26.074 02:27:59 -- accel/accel.sh@21 -- # case "$var" in 00:08:26.074 02:27:59 -- accel/accel.sh@19 -- # IFS=: 00:08:26.074 02:27:59 -- accel/accel.sh@19 -- # read -r var val 00:08:26.074 02:27:59 -- accel/accel.sh@20 -- # val= 00:08:26.074 02:27:59 -- accel/accel.sh@21 -- # case "$var" in 00:08:26.074 02:27:59 -- accel/accel.sh@19 -- # IFS=: 00:08:26.074 02:27:59 -- accel/accel.sh@19 -- # read -r var val 00:08:26.074 02:27:59 -- accel/accel.sh@20 -- # val= 00:08:26.074 02:27:59 -- accel/accel.sh@21 -- # case "$var" in 00:08:26.074 02:27:59 -- accel/accel.sh@19 -- # IFS=: 00:08:26.074 02:27:59 -- accel/accel.sh@19 -- # read -r var val 00:08:26.074 02:27:59 -- accel/accel.sh@20 -- # val= 00:08:26.074 02:27:59 -- accel/accel.sh@21 -- # case "$var" in 00:08:26.074 02:27:59 -- accel/accel.sh@19 -- # IFS=: 00:08:26.074 02:27:59 -- accel/accel.sh@19 -- # read -r var val 00:08:26.074 02:27:59 -- accel/accel.sh@20 -- # val= 00:08:26.074 02:27:59 -- accel/accel.sh@21 -- # case "$var" in 00:08:26.074 02:27:59 -- accel/accel.sh@19 -- # IFS=: 00:08:26.074 02:27:59 -- accel/accel.sh@19 -- # read -r var val 00:08:26.074 02:27:59 -- accel/accel.sh@20 -- # val= 00:08:26.074 02:27:59 -- accel/accel.sh@21 -- # case "$var" in 00:08:26.074 02:27:59 -- accel/accel.sh@19 -- # IFS=: 00:08:26.074 02:27:59 -- accel/accel.sh@19 -- # read -r var val 00:08:26.074 02:27:59 -- accel/accel.sh@27 -- # [[ -n software ]] 00:08:26.074 02:27:59 -- accel/accel.sh@27 -- # [[ -n compare ]] 00:08:26.074 02:27:59 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:26.074 00:08:26.074 real 0m1.409s 00:08:26.074 user 0m1.272s 00:08:26.074 sys 0m0.142s 00:08:26.074 02:27:59 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:26.074 02:27:59 -- common/autotest_common.sh@10 -- # set +x 00:08:26.074 ************************************ 00:08:26.074 END TEST accel_compare 00:08:26.074 ************************************ 00:08:26.074 02:27:59 -- accel/accel.sh@109 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:08:26.074 02:27:59 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:08:26.074 02:27:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:26.074 02:27:59 -- common/autotest_common.sh@10 -- # set +x 00:08:26.074 ************************************ 00:08:26.074 START TEST accel_xor 00:08:26.074 ************************************ 00:08:26.074 02:27:59 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w xor -y 00:08:26.074 02:27:59 -- accel/accel.sh@16 -- # local accel_opc 00:08:26.074 02:27:59 -- accel/accel.sh@17 -- # local accel_module 00:08:26.074 02:27:59 -- accel/accel.sh@19 -- # IFS=: 00:08:26.074 02:27:59 -- accel/accel.sh@19 -- # read -r var val 00:08:26.074 02:27:59 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:08:26.074 02:27:59 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:08:26.074 02:27:59 -- accel/accel.sh@12 -- # build_accel_config 00:08:26.074 02:27:59 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:08:26.074 02:27:59 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:08:26.074 02:27:59 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:26.074 02:27:59 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:26.074 02:27:59 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:08:26.074 02:27:59 -- accel/accel.sh@40 -- # local IFS=, 00:08:26.074 02:27:59 -- accel/accel.sh@41 -- # jq -r . 00:08:26.074 [2024-04-27 02:27:59.586918] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:08:26.074 [2024-04-27 02:27:59.586964] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1437934 ] 00:08:26.074 EAL: No free 2048 kB hugepages reported on node 1 00:08:26.074 [2024-04-27 02:27:59.657866] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:26.335 [2024-04-27 02:27:59.742429] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:26.335 02:27:59 -- accel/accel.sh@20 -- # val= 00:08:26.335 02:27:59 -- accel/accel.sh@21 -- # case "$var" in 00:08:26.335 02:27:59 -- accel/accel.sh@19 -- # IFS=: 00:08:26.335 02:27:59 -- accel/accel.sh@19 -- # read -r var val 00:08:26.335 02:27:59 -- accel/accel.sh@20 -- # val= 00:08:26.335 02:27:59 -- accel/accel.sh@21 -- # case "$var" in 00:08:26.335 02:27:59 -- accel/accel.sh@19 -- # IFS=: 00:08:26.335 02:27:59 -- accel/accel.sh@19 -- # read -r var val 00:08:26.335 02:27:59 -- accel/accel.sh@20 -- # val=0x1 00:08:26.335 02:27:59 -- accel/accel.sh@21 -- # case "$var" in 00:08:26.335 02:27:59 -- accel/accel.sh@19 -- # IFS=: 00:08:26.335 02:27:59 -- accel/accel.sh@19 -- # read -r var val 00:08:26.335 02:27:59 -- accel/accel.sh@20 -- # val= 00:08:26.335 02:27:59 -- accel/accel.sh@21 -- # case "$var" in 00:08:26.335 02:27:59 -- accel/accel.sh@19 -- # IFS=: 00:08:26.335 02:27:59 -- accel/accel.sh@19 -- # read -r var val 00:08:26.335 02:27:59 -- accel/accel.sh@20 -- # val= 00:08:26.335 02:27:59 -- accel/accel.sh@21 -- # case "$var" in 00:08:26.335 02:27:59 -- accel/accel.sh@19 -- # IFS=: 00:08:26.335 02:27:59 -- accel/accel.sh@19 -- # read -r var val 00:08:26.335 02:27:59 -- accel/accel.sh@20 -- # val=xor 00:08:26.335 02:27:59 -- accel/accel.sh@21 -- # case "$var" in 00:08:26.335 02:27:59 -- accel/accel.sh@23 -- # accel_opc=xor 00:08:26.335 02:27:59 -- accel/accel.sh@19 -- # IFS=: 00:08:26.335 02:27:59 -- accel/accel.sh@19 -- # read -r var val 00:08:26.335 02:27:59 -- accel/accel.sh@20 -- # val=2 00:08:26.335 02:27:59 -- accel/accel.sh@21 -- # case "$var" in 00:08:26.335 02:27:59 -- accel/accel.sh@19 -- # IFS=: 00:08:26.335 02:27:59 -- accel/accel.sh@19 -- # read -r var val 00:08:26.335 02:27:59 -- accel/accel.sh@20 -- # val='4096 bytes' 00:08:26.335 02:27:59 -- accel/accel.sh@21 -- # case "$var" in 00:08:26.335 02:27:59 -- accel/accel.sh@19 -- # IFS=: 00:08:26.335 02:27:59 -- accel/accel.sh@19 -- # read -r var val 00:08:26.335 02:27:59 -- accel/accel.sh@20 -- # val= 00:08:26.335 02:27:59 -- accel/accel.sh@21 -- # case "$var" in 00:08:26.335 02:27:59 -- accel/accel.sh@19 -- # IFS=: 00:08:26.335 02:27:59 -- accel/accel.sh@19 -- # read -r var val 00:08:26.335 02:27:59 -- accel/accel.sh@20 -- # val=software 00:08:26.335 02:27:59 -- accel/accel.sh@21 -- # case "$var" in 00:08:26.335 02:27:59 -- accel/accel.sh@22 -- # accel_module=software 00:08:26.335 02:27:59 -- accel/accel.sh@19 -- # IFS=: 00:08:26.335 02:27:59 -- accel/accel.sh@19 -- # read -r var val 00:08:26.335 02:27:59 -- accel/accel.sh@20 -- # val=32 00:08:26.335 02:27:59 -- accel/accel.sh@21 -- # case "$var" in 00:08:26.335 02:27:59 -- accel/accel.sh@19 -- # IFS=: 00:08:26.335 02:27:59 -- accel/accel.sh@19 -- # read -r var val 00:08:26.335 02:27:59 -- accel/accel.sh@20 -- # val=32 00:08:26.335 02:27:59 -- accel/accel.sh@21 -- # case "$var" in 00:08:26.335 02:27:59 -- accel/accel.sh@19 -- # IFS=: 00:08:26.335 02:27:59 -- accel/accel.sh@19 -- # read -r var val 00:08:26.335 02:27:59 -- accel/accel.sh@20 -- # val=1 00:08:26.335 02:27:59 -- accel/accel.sh@21 -- # case "$var" in 00:08:26.335 02:27:59 -- accel/accel.sh@19 -- # IFS=: 00:08:26.336 02:27:59 -- accel/accel.sh@19 -- # read -r var val 00:08:26.336 02:27:59 -- accel/accel.sh@20 -- # val='1 seconds' 00:08:26.336 02:27:59 -- accel/accel.sh@21 -- # case "$var" in 00:08:26.336 02:27:59 -- accel/accel.sh@19 -- # IFS=: 00:08:26.336 02:27:59 -- accel/accel.sh@19 -- # read -r var val 00:08:26.336 02:27:59 -- accel/accel.sh@20 -- # val=Yes 00:08:26.336 02:27:59 -- accel/accel.sh@21 -- # case "$var" in 00:08:26.336 02:27:59 -- accel/accel.sh@19 -- # IFS=: 00:08:26.336 02:27:59 -- accel/accel.sh@19 -- # read -r var val 00:08:26.336 02:27:59 -- accel/accel.sh@20 -- # val= 00:08:26.336 02:27:59 -- accel/accel.sh@21 -- # case "$var" in 00:08:26.336 02:27:59 -- accel/accel.sh@19 -- # IFS=: 00:08:26.336 02:27:59 -- accel/accel.sh@19 -- # read -r var val 00:08:26.336 02:27:59 -- accel/accel.sh@20 -- # val= 00:08:26.336 02:27:59 -- accel/accel.sh@21 -- # case "$var" in 00:08:26.336 02:27:59 -- accel/accel.sh@19 -- # IFS=: 00:08:26.336 02:27:59 -- accel/accel.sh@19 -- # read -r var val 00:08:27.716 02:28:00 -- accel/accel.sh@20 -- # val= 00:08:27.716 02:28:00 -- accel/accel.sh@21 -- # case "$var" in 00:08:27.716 02:28:00 -- accel/accel.sh@19 -- # IFS=: 00:08:27.716 02:28:00 -- accel/accel.sh@19 -- # read -r var val 00:08:27.716 02:28:00 -- accel/accel.sh@20 -- # val= 00:08:27.716 02:28:00 -- accel/accel.sh@21 -- # case "$var" in 00:08:27.716 02:28:00 -- accel/accel.sh@19 -- # IFS=: 00:08:27.716 02:28:00 -- accel/accel.sh@19 -- # read -r var val 00:08:27.716 02:28:00 -- accel/accel.sh@20 -- # val= 00:08:27.716 02:28:00 -- accel/accel.sh@21 -- # case "$var" in 00:08:27.716 02:28:00 -- accel/accel.sh@19 -- # IFS=: 00:08:27.716 02:28:00 -- accel/accel.sh@19 -- # read -r var val 00:08:27.716 02:28:00 -- accel/accel.sh@20 -- # val= 00:08:27.716 02:28:00 -- accel/accel.sh@21 -- # case "$var" in 00:08:27.716 02:28:00 -- accel/accel.sh@19 -- # IFS=: 00:08:27.716 02:28:00 -- accel/accel.sh@19 -- # read -r var val 00:08:27.716 02:28:00 -- accel/accel.sh@20 -- # val= 00:08:27.716 02:28:00 -- accel/accel.sh@21 -- # case "$var" in 00:08:27.716 02:28:00 -- accel/accel.sh@19 -- # IFS=: 00:08:27.716 02:28:00 -- accel/accel.sh@19 -- # read -r var val 00:08:27.716 02:28:00 -- accel/accel.sh@20 -- # val= 00:08:27.716 02:28:00 -- accel/accel.sh@21 -- # case "$var" in 00:08:27.716 02:28:00 -- accel/accel.sh@19 -- # IFS=: 00:08:27.716 02:28:00 -- accel/accel.sh@19 -- # read -r var val 00:08:27.716 02:28:00 -- accel/accel.sh@27 -- # [[ -n software ]] 00:08:27.716 02:28:00 -- accel/accel.sh@27 -- # [[ -n xor ]] 00:08:27.716 02:28:00 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:27.716 00:08:27.716 real 0m1.397s 00:08:27.716 user 0m1.260s 00:08:27.716 sys 0m0.138s 00:08:27.716 02:28:00 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:27.716 02:28:00 -- common/autotest_common.sh@10 -- # set +x 00:08:27.716 ************************************ 00:08:27.716 END TEST accel_xor 00:08:27.716 ************************************ 00:08:27.716 02:28:01 -- accel/accel.sh@110 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:08:27.716 02:28:01 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:08:27.716 02:28:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:27.716 02:28:01 -- common/autotest_common.sh@10 -- # set +x 00:08:27.716 ************************************ 00:08:27.716 START TEST accel_xor 00:08:27.716 ************************************ 00:08:27.716 02:28:01 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w xor -y -x 3 00:08:27.716 02:28:01 -- accel/accel.sh@16 -- # local accel_opc 00:08:27.716 02:28:01 -- accel/accel.sh@17 -- # local accel_module 00:08:27.716 02:28:01 -- accel/accel.sh@19 -- # IFS=: 00:08:27.716 02:28:01 -- accel/accel.sh@19 -- # read -r var val 00:08:27.716 02:28:01 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:08:27.716 02:28:01 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:08:27.716 02:28:01 -- accel/accel.sh@12 -- # build_accel_config 00:08:27.716 02:28:01 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:08:27.716 02:28:01 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:08:27.716 02:28:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:27.716 02:28:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:27.716 02:28:01 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:08:27.716 02:28:01 -- accel/accel.sh@40 -- # local IFS=, 00:08:27.716 02:28:01 -- accel/accel.sh@41 -- # jq -r . 00:08:27.716 [2024-04-27 02:28:01.165571] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:08:27.716 [2024-04-27 02:28:01.165645] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1438151 ] 00:08:27.716 EAL: No free 2048 kB hugepages reported on node 1 00:08:27.716 [2024-04-27 02:28:01.236696] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:27.716 [2024-04-27 02:28:01.314727] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:27.976 02:28:01 -- accel/accel.sh@20 -- # val= 00:08:27.976 02:28:01 -- accel/accel.sh@21 -- # case "$var" in 00:08:27.976 02:28:01 -- accel/accel.sh@19 -- # IFS=: 00:08:27.976 02:28:01 -- accel/accel.sh@19 -- # read -r var val 00:08:27.976 02:28:01 -- accel/accel.sh@20 -- # val= 00:08:27.976 02:28:01 -- accel/accel.sh@21 -- # case "$var" in 00:08:27.976 02:28:01 -- accel/accel.sh@19 -- # IFS=: 00:08:27.976 02:28:01 -- accel/accel.sh@19 -- # read -r var val 00:08:27.976 02:28:01 -- accel/accel.sh@20 -- # val=0x1 00:08:27.976 02:28:01 -- accel/accel.sh@21 -- # case "$var" in 00:08:27.976 02:28:01 -- accel/accel.sh@19 -- # IFS=: 00:08:27.976 02:28:01 -- accel/accel.sh@19 -- # read -r var val 00:08:27.976 02:28:01 -- accel/accel.sh@20 -- # val= 00:08:27.976 02:28:01 -- accel/accel.sh@21 -- # case "$var" in 00:08:27.976 02:28:01 -- accel/accel.sh@19 -- # IFS=: 00:08:27.976 02:28:01 -- accel/accel.sh@19 -- # read -r var val 00:08:27.976 02:28:01 -- accel/accel.sh@20 -- # val= 00:08:27.976 02:28:01 -- accel/accel.sh@21 -- # case "$var" in 00:08:27.976 02:28:01 -- accel/accel.sh@19 -- # IFS=: 00:08:27.976 02:28:01 -- accel/accel.sh@19 -- # read -r var val 00:08:27.976 02:28:01 -- accel/accel.sh@20 -- # val=xor 00:08:27.976 02:28:01 -- accel/accel.sh@21 -- # case "$var" in 00:08:27.976 02:28:01 -- accel/accel.sh@23 -- # accel_opc=xor 00:08:27.976 02:28:01 -- accel/accel.sh@19 -- # IFS=: 00:08:27.976 02:28:01 -- accel/accel.sh@19 -- # read -r var val 00:08:27.976 02:28:01 -- accel/accel.sh@20 -- # val=3 00:08:27.976 02:28:01 -- accel/accel.sh@21 -- # case "$var" in 00:08:27.976 02:28:01 -- accel/accel.sh@19 -- # IFS=: 00:08:27.976 02:28:01 -- accel/accel.sh@19 -- # read -r var val 00:08:27.976 02:28:01 -- accel/accel.sh@20 -- # val='4096 bytes' 00:08:27.976 02:28:01 -- accel/accel.sh@21 -- # case "$var" in 00:08:27.976 02:28:01 -- accel/accel.sh@19 -- # IFS=: 00:08:27.976 02:28:01 -- accel/accel.sh@19 -- # read -r var val 00:08:27.976 02:28:01 -- accel/accel.sh@20 -- # val= 00:08:27.976 02:28:01 -- accel/accel.sh@21 -- # case "$var" in 00:08:27.976 02:28:01 -- accel/accel.sh@19 -- # IFS=: 00:08:27.976 02:28:01 -- accel/accel.sh@19 -- # read -r var val 00:08:27.976 02:28:01 -- accel/accel.sh@20 -- # val=software 00:08:27.976 02:28:01 -- accel/accel.sh@21 -- # case "$var" in 00:08:27.976 02:28:01 -- accel/accel.sh@22 -- # accel_module=software 00:08:27.976 02:28:01 -- accel/accel.sh@19 -- # IFS=: 00:08:27.976 02:28:01 -- accel/accel.sh@19 -- # read -r var val 00:08:27.976 02:28:01 -- accel/accel.sh@20 -- # val=32 00:08:27.976 02:28:01 -- accel/accel.sh@21 -- # case "$var" in 00:08:27.976 02:28:01 -- accel/accel.sh@19 -- # IFS=: 00:08:27.976 02:28:01 -- accel/accel.sh@19 -- # read -r var val 00:08:27.976 02:28:01 -- accel/accel.sh@20 -- # val=32 00:08:27.976 02:28:01 -- accel/accel.sh@21 -- # case "$var" in 00:08:27.976 02:28:01 -- accel/accel.sh@19 -- # IFS=: 00:08:27.976 02:28:01 -- accel/accel.sh@19 -- # read -r var val 00:08:27.976 02:28:01 -- accel/accel.sh@20 -- # val=1 00:08:27.976 02:28:01 -- accel/accel.sh@21 -- # case "$var" in 00:08:27.976 02:28:01 -- accel/accel.sh@19 -- # IFS=: 00:08:27.976 02:28:01 -- accel/accel.sh@19 -- # read -r var val 00:08:27.976 02:28:01 -- accel/accel.sh@20 -- # val='1 seconds' 00:08:27.976 02:28:01 -- accel/accel.sh@21 -- # case "$var" in 00:08:27.976 02:28:01 -- accel/accel.sh@19 -- # IFS=: 00:08:27.976 02:28:01 -- accel/accel.sh@19 -- # read -r var val 00:08:27.976 02:28:01 -- accel/accel.sh@20 -- # val=Yes 00:08:27.976 02:28:01 -- accel/accel.sh@21 -- # case "$var" in 00:08:27.976 02:28:01 -- accel/accel.sh@19 -- # IFS=: 00:08:27.976 02:28:01 -- accel/accel.sh@19 -- # read -r var val 00:08:27.976 02:28:01 -- accel/accel.sh@20 -- # val= 00:08:27.976 02:28:01 -- accel/accel.sh@21 -- # case "$var" in 00:08:27.976 02:28:01 -- accel/accel.sh@19 -- # IFS=: 00:08:27.976 02:28:01 -- accel/accel.sh@19 -- # read -r var val 00:08:27.976 02:28:01 -- accel/accel.sh@20 -- # val= 00:08:27.976 02:28:01 -- accel/accel.sh@21 -- # case "$var" in 00:08:27.976 02:28:01 -- accel/accel.sh@19 -- # IFS=: 00:08:27.976 02:28:01 -- accel/accel.sh@19 -- # read -r var val 00:08:28.913 02:28:02 -- accel/accel.sh@20 -- # val= 00:08:28.913 02:28:02 -- accel/accel.sh@21 -- # case "$var" in 00:08:28.913 02:28:02 -- accel/accel.sh@19 -- # IFS=: 00:08:28.913 02:28:02 -- accel/accel.sh@19 -- # read -r var val 00:08:28.913 02:28:02 -- accel/accel.sh@20 -- # val= 00:08:28.913 02:28:02 -- accel/accel.sh@21 -- # case "$var" in 00:08:28.913 02:28:02 -- accel/accel.sh@19 -- # IFS=: 00:08:28.913 02:28:02 -- accel/accel.sh@19 -- # read -r var val 00:08:28.913 02:28:02 -- accel/accel.sh@20 -- # val= 00:08:28.913 02:28:02 -- accel/accel.sh@21 -- # case "$var" in 00:08:28.913 02:28:02 -- accel/accel.sh@19 -- # IFS=: 00:08:28.913 02:28:02 -- accel/accel.sh@19 -- # read -r var val 00:08:28.913 02:28:02 -- accel/accel.sh@20 -- # val= 00:08:28.913 02:28:02 -- accel/accel.sh@21 -- # case "$var" in 00:08:28.913 02:28:02 -- accel/accel.sh@19 -- # IFS=: 00:08:28.913 02:28:02 -- accel/accel.sh@19 -- # read -r var val 00:08:28.913 02:28:02 -- accel/accel.sh@20 -- # val= 00:08:28.913 02:28:02 -- accel/accel.sh@21 -- # case "$var" in 00:08:28.913 02:28:02 -- accel/accel.sh@19 -- # IFS=: 00:08:28.913 02:28:02 -- accel/accel.sh@19 -- # read -r var val 00:08:28.913 02:28:02 -- accel/accel.sh@20 -- # val= 00:08:28.913 02:28:02 -- accel/accel.sh@21 -- # case "$var" in 00:08:28.913 02:28:02 -- accel/accel.sh@19 -- # IFS=: 00:08:28.913 02:28:02 -- accel/accel.sh@19 -- # read -r var val 00:08:28.913 02:28:02 -- accel/accel.sh@27 -- # [[ -n software ]] 00:08:28.913 02:28:02 -- accel/accel.sh@27 -- # [[ -n xor ]] 00:08:28.913 02:28:02 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:28.913 00:08:28.913 real 0m1.387s 00:08:28.913 user 0m1.253s 00:08:28.913 sys 0m0.135s 00:08:28.913 02:28:02 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:28.913 02:28:02 -- common/autotest_common.sh@10 -- # set +x 00:08:28.913 ************************************ 00:08:28.913 END TEST accel_xor 00:08:28.913 ************************************ 00:08:29.173 02:28:02 -- accel/accel.sh@111 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:08:29.173 02:28:02 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:08:29.173 02:28:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:29.173 02:28:02 -- common/autotest_common.sh@10 -- # set +x 00:08:29.173 ************************************ 00:08:29.173 START TEST accel_dif_verify 00:08:29.173 ************************************ 00:08:29.173 02:28:02 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w dif_verify 00:08:29.173 02:28:02 -- accel/accel.sh@16 -- # local accel_opc 00:08:29.173 02:28:02 -- accel/accel.sh@17 -- # local accel_module 00:08:29.173 02:28:02 -- accel/accel.sh@19 -- # IFS=: 00:08:29.173 02:28:02 -- accel/accel.sh@19 -- # read -r var val 00:08:29.173 02:28:02 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:08:29.173 02:28:02 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:08:29.173 02:28:02 -- accel/accel.sh@12 -- # build_accel_config 00:08:29.173 02:28:02 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:08:29.173 02:28:02 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:08:29.173 02:28:02 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:29.173 02:28:02 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:29.173 02:28:02 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:08:29.173 02:28:02 -- accel/accel.sh@40 -- # local IFS=, 00:08:29.173 02:28:02 -- accel/accel.sh@41 -- # jq -r . 00:08:29.173 [2024-04-27 02:28:02.701108] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:08:29.173 [2024-04-27 02:28:02.701147] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1438358 ] 00:08:29.173 EAL: No free 2048 kB hugepages reported on node 1 00:08:29.173 [2024-04-27 02:28:02.770215] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:29.445 [2024-04-27 02:28:02.852881] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:29.445 02:28:02 -- accel/accel.sh@20 -- # val= 00:08:29.445 02:28:02 -- accel/accel.sh@21 -- # case "$var" in 00:08:29.445 02:28:02 -- accel/accel.sh@19 -- # IFS=: 00:08:29.445 02:28:02 -- accel/accel.sh@19 -- # read -r var val 00:08:29.445 02:28:02 -- accel/accel.sh@20 -- # val= 00:08:29.445 02:28:02 -- accel/accel.sh@21 -- # case "$var" in 00:08:29.445 02:28:02 -- accel/accel.sh@19 -- # IFS=: 00:08:29.445 02:28:02 -- accel/accel.sh@19 -- # read -r var val 00:08:29.445 02:28:02 -- accel/accel.sh@20 -- # val=0x1 00:08:29.445 02:28:02 -- accel/accel.sh@21 -- # case "$var" in 00:08:29.445 02:28:02 -- accel/accel.sh@19 -- # IFS=: 00:08:29.445 02:28:02 -- accel/accel.sh@19 -- # read -r var val 00:08:29.445 02:28:02 -- accel/accel.sh@20 -- # val= 00:08:29.445 02:28:02 -- accel/accel.sh@21 -- # case "$var" in 00:08:29.445 02:28:02 -- accel/accel.sh@19 -- # IFS=: 00:08:29.445 02:28:02 -- accel/accel.sh@19 -- # read -r var val 00:08:29.445 02:28:02 -- accel/accel.sh@20 -- # val= 00:08:29.445 02:28:02 -- accel/accel.sh@21 -- # case "$var" in 00:08:29.445 02:28:02 -- accel/accel.sh@19 -- # IFS=: 00:08:29.445 02:28:02 -- accel/accel.sh@19 -- # read -r var val 00:08:29.445 02:28:02 -- accel/accel.sh@20 -- # val=dif_verify 00:08:29.445 02:28:02 -- accel/accel.sh@21 -- # case "$var" in 00:08:29.445 02:28:02 -- accel/accel.sh@23 -- # accel_opc=dif_verify 00:08:29.445 02:28:02 -- accel/accel.sh@19 -- # IFS=: 00:08:29.445 02:28:02 -- accel/accel.sh@19 -- # read -r var val 00:08:29.445 02:28:02 -- accel/accel.sh@20 -- # val='4096 bytes' 00:08:29.445 02:28:02 -- accel/accel.sh@21 -- # case "$var" in 00:08:29.445 02:28:02 -- accel/accel.sh@19 -- # IFS=: 00:08:29.445 02:28:02 -- accel/accel.sh@19 -- # read -r var val 00:08:29.445 02:28:02 -- accel/accel.sh@20 -- # val='4096 bytes' 00:08:29.445 02:28:02 -- accel/accel.sh@21 -- # case "$var" in 00:08:29.445 02:28:02 -- accel/accel.sh@19 -- # IFS=: 00:08:29.445 02:28:02 -- accel/accel.sh@19 -- # read -r var val 00:08:29.445 02:28:02 -- accel/accel.sh@20 -- # val='512 bytes' 00:08:29.445 02:28:02 -- accel/accel.sh@21 -- # case "$var" in 00:08:29.445 02:28:02 -- accel/accel.sh@19 -- # IFS=: 00:08:29.445 02:28:02 -- accel/accel.sh@19 -- # read -r var val 00:08:29.445 02:28:02 -- accel/accel.sh@20 -- # val='8 bytes' 00:08:29.445 02:28:02 -- accel/accel.sh@21 -- # case "$var" in 00:08:29.445 02:28:02 -- accel/accel.sh@19 -- # IFS=: 00:08:29.445 02:28:02 -- accel/accel.sh@19 -- # read -r var val 00:08:29.445 02:28:02 -- accel/accel.sh@20 -- # val= 00:08:29.445 02:28:02 -- accel/accel.sh@21 -- # case "$var" in 00:08:29.445 02:28:02 -- accel/accel.sh@19 -- # IFS=: 00:08:29.445 02:28:02 -- accel/accel.sh@19 -- # read -r var val 00:08:29.445 02:28:02 -- accel/accel.sh@20 -- # val=software 00:08:29.445 02:28:02 -- accel/accel.sh@21 -- # case "$var" in 00:08:29.445 02:28:02 -- accel/accel.sh@22 -- # accel_module=software 00:08:29.445 02:28:02 -- accel/accel.sh@19 -- # IFS=: 00:08:29.445 02:28:02 -- accel/accel.sh@19 -- # read -r var val 00:08:29.445 02:28:02 -- accel/accel.sh@20 -- # val=32 00:08:29.445 02:28:02 -- accel/accel.sh@21 -- # case "$var" in 00:08:29.445 02:28:02 -- accel/accel.sh@19 -- # IFS=: 00:08:29.445 02:28:02 -- accel/accel.sh@19 -- # read -r var val 00:08:29.445 02:28:02 -- accel/accel.sh@20 -- # val=32 00:08:29.445 02:28:02 -- accel/accel.sh@21 -- # case "$var" in 00:08:29.445 02:28:02 -- accel/accel.sh@19 -- # IFS=: 00:08:29.445 02:28:02 -- accel/accel.sh@19 -- # read -r var val 00:08:29.445 02:28:02 -- accel/accel.sh@20 -- # val=1 00:08:29.445 02:28:02 -- accel/accel.sh@21 -- # case "$var" in 00:08:29.445 02:28:02 -- accel/accel.sh@19 -- # IFS=: 00:08:29.445 02:28:02 -- accel/accel.sh@19 -- # read -r var val 00:08:29.445 02:28:02 -- accel/accel.sh@20 -- # val='1 seconds' 00:08:29.445 02:28:02 -- accel/accel.sh@21 -- # case "$var" in 00:08:29.445 02:28:02 -- accel/accel.sh@19 -- # IFS=: 00:08:29.445 02:28:02 -- accel/accel.sh@19 -- # read -r var val 00:08:29.445 02:28:02 -- accel/accel.sh@20 -- # val=No 00:08:29.445 02:28:02 -- accel/accel.sh@21 -- # case "$var" in 00:08:29.445 02:28:02 -- accel/accel.sh@19 -- # IFS=: 00:08:29.445 02:28:02 -- accel/accel.sh@19 -- # read -r var val 00:08:29.445 02:28:02 -- accel/accel.sh@20 -- # val= 00:08:29.445 02:28:02 -- accel/accel.sh@21 -- # case "$var" in 00:08:29.445 02:28:02 -- accel/accel.sh@19 -- # IFS=: 00:08:29.445 02:28:02 -- accel/accel.sh@19 -- # read -r var val 00:08:29.445 02:28:02 -- accel/accel.sh@20 -- # val= 00:08:29.445 02:28:02 -- accel/accel.sh@21 -- # case "$var" in 00:08:29.445 02:28:02 -- accel/accel.sh@19 -- # IFS=: 00:08:29.445 02:28:02 -- accel/accel.sh@19 -- # read -r var val 00:08:30.827 02:28:04 -- accel/accel.sh@20 -- # val= 00:08:30.827 02:28:04 -- accel/accel.sh@21 -- # case "$var" in 00:08:30.827 02:28:04 -- accel/accel.sh@19 -- # IFS=: 00:08:30.827 02:28:04 -- accel/accel.sh@19 -- # read -r var val 00:08:30.827 02:28:04 -- accel/accel.sh@20 -- # val= 00:08:30.827 02:28:04 -- accel/accel.sh@21 -- # case "$var" in 00:08:30.827 02:28:04 -- accel/accel.sh@19 -- # IFS=: 00:08:30.827 02:28:04 -- accel/accel.sh@19 -- # read -r var val 00:08:30.827 02:28:04 -- accel/accel.sh@20 -- # val= 00:08:30.827 02:28:04 -- accel/accel.sh@21 -- # case "$var" in 00:08:30.827 02:28:04 -- accel/accel.sh@19 -- # IFS=: 00:08:30.827 02:28:04 -- accel/accel.sh@19 -- # read -r var val 00:08:30.827 02:28:04 -- accel/accel.sh@20 -- # val= 00:08:30.827 02:28:04 -- accel/accel.sh@21 -- # case "$var" in 00:08:30.827 02:28:04 -- accel/accel.sh@19 -- # IFS=: 00:08:30.827 02:28:04 -- accel/accel.sh@19 -- # read -r var val 00:08:30.827 02:28:04 -- accel/accel.sh@20 -- # val= 00:08:30.827 02:28:04 -- accel/accel.sh@21 -- # case "$var" in 00:08:30.827 02:28:04 -- accel/accel.sh@19 -- # IFS=: 00:08:30.827 02:28:04 -- accel/accel.sh@19 -- # read -r var val 00:08:30.827 02:28:04 -- accel/accel.sh@20 -- # val= 00:08:30.827 02:28:04 -- accel/accel.sh@21 -- # case "$var" in 00:08:30.827 02:28:04 -- accel/accel.sh@19 -- # IFS=: 00:08:30.827 02:28:04 -- accel/accel.sh@19 -- # read -r var val 00:08:30.827 02:28:04 -- accel/accel.sh@27 -- # [[ -n software ]] 00:08:30.827 02:28:04 -- accel/accel.sh@27 -- # [[ -n dif_verify ]] 00:08:30.827 02:28:04 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:30.827 00:08:30.827 real 0m1.391s 00:08:30.827 user 0m1.260s 00:08:30.827 sys 0m0.133s 00:08:30.827 02:28:04 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:30.827 02:28:04 -- common/autotest_common.sh@10 -- # set +x 00:08:30.827 ************************************ 00:08:30.827 END TEST accel_dif_verify 00:08:30.827 ************************************ 00:08:30.827 02:28:04 -- accel/accel.sh@112 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:08:30.827 02:28:04 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:08:30.827 02:28:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:30.827 02:28:04 -- common/autotest_common.sh@10 -- # set +x 00:08:30.827 ************************************ 00:08:30.827 START TEST accel_dif_generate 00:08:30.827 ************************************ 00:08:30.827 02:28:04 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w dif_generate 00:08:30.827 02:28:04 -- accel/accel.sh@16 -- # local accel_opc 00:08:30.827 02:28:04 -- accel/accel.sh@17 -- # local accel_module 00:08:30.827 02:28:04 -- accel/accel.sh@19 -- # IFS=: 00:08:30.827 02:28:04 -- accel/accel.sh@19 -- # read -r var val 00:08:30.827 02:28:04 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:08:30.827 02:28:04 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:08:30.827 02:28:04 -- accel/accel.sh@12 -- # build_accel_config 00:08:30.827 02:28:04 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:08:30.827 02:28:04 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:08:30.827 02:28:04 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:30.827 02:28:04 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:30.827 02:28:04 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:08:30.827 02:28:04 -- accel/accel.sh@40 -- # local IFS=, 00:08:30.827 02:28:04 -- accel/accel.sh@41 -- # jq -r . 00:08:30.827 [2024-04-27 02:28:04.266126] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:08:30.827 [2024-04-27 02:28:04.266180] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1438570 ] 00:08:30.827 EAL: No free 2048 kB hugepages reported on node 1 00:08:30.827 [2024-04-27 02:28:04.336418] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:30.827 [2024-04-27 02:28:04.417003] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:31.148 02:28:04 -- accel/accel.sh@20 -- # val= 00:08:31.148 02:28:04 -- accel/accel.sh@21 -- # case "$var" in 00:08:31.148 02:28:04 -- accel/accel.sh@19 -- # IFS=: 00:08:31.148 02:28:04 -- accel/accel.sh@19 -- # read -r var val 00:08:31.148 02:28:04 -- accel/accel.sh@20 -- # val= 00:08:31.148 02:28:04 -- accel/accel.sh@21 -- # case "$var" in 00:08:31.148 02:28:04 -- accel/accel.sh@19 -- # IFS=: 00:08:31.148 02:28:04 -- accel/accel.sh@19 -- # read -r var val 00:08:31.148 02:28:04 -- accel/accel.sh@20 -- # val=0x1 00:08:31.148 02:28:04 -- accel/accel.sh@21 -- # case "$var" in 00:08:31.148 02:28:04 -- accel/accel.sh@19 -- # IFS=: 00:08:31.148 02:28:04 -- accel/accel.sh@19 -- # read -r var val 00:08:31.148 02:28:04 -- accel/accel.sh@20 -- # val= 00:08:31.148 02:28:04 -- accel/accel.sh@21 -- # case "$var" in 00:08:31.148 02:28:04 -- accel/accel.sh@19 -- # IFS=: 00:08:31.148 02:28:04 -- accel/accel.sh@19 -- # read -r var val 00:08:31.148 02:28:04 -- accel/accel.sh@20 -- # val= 00:08:31.148 02:28:04 -- accel/accel.sh@21 -- # case "$var" in 00:08:31.148 02:28:04 -- accel/accel.sh@19 -- # IFS=: 00:08:31.148 02:28:04 -- accel/accel.sh@19 -- # read -r var val 00:08:31.148 02:28:04 -- accel/accel.sh@20 -- # val=dif_generate 00:08:31.148 02:28:04 -- accel/accel.sh@21 -- # case "$var" in 00:08:31.148 02:28:04 -- accel/accel.sh@23 -- # accel_opc=dif_generate 00:08:31.148 02:28:04 -- accel/accel.sh@19 -- # IFS=: 00:08:31.148 02:28:04 -- accel/accel.sh@19 -- # read -r var val 00:08:31.148 02:28:04 -- accel/accel.sh@20 -- # val='4096 bytes' 00:08:31.148 02:28:04 -- accel/accel.sh@21 -- # case "$var" in 00:08:31.148 02:28:04 -- accel/accel.sh@19 -- # IFS=: 00:08:31.148 02:28:04 -- accel/accel.sh@19 -- # read -r var val 00:08:31.148 02:28:04 -- accel/accel.sh@20 -- # val='4096 bytes' 00:08:31.148 02:28:04 -- accel/accel.sh@21 -- # case "$var" in 00:08:31.148 02:28:04 -- accel/accel.sh@19 -- # IFS=: 00:08:31.148 02:28:04 -- accel/accel.sh@19 -- # read -r var val 00:08:31.148 02:28:04 -- accel/accel.sh@20 -- # val='512 bytes' 00:08:31.148 02:28:04 -- accel/accel.sh@21 -- # case "$var" in 00:08:31.148 02:28:04 -- accel/accel.sh@19 -- # IFS=: 00:08:31.148 02:28:04 -- accel/accel.sh@19 -- # read -r var val 00:08:31.148 02:28:04 -- accel/accel.sh@20 -- # val='8 bytes' 00:08:31.148 02:28:04 -- accel/accel.sh@21 -- # case "$var" in 00:08:31.148 02:28:04 -- accel/accel.sh@19 -- # IFS=: 00:08:31.148 02:28:04 -- accel/accel.sh@19 -- # read -r var val 00:08:31.148 02:28:04 -- accel/accel.sh@20 -- # val= 00:08:31.148 02:28:04 -- accel/accel.sh@21 -- # case "$var" in 00:08:31.148 02:28:04 -- accel/accel.sh@19 -- # IFS=: 00:08:31.148 02:28:04 -- accel/accel.sh@19 -- # read -r var val 00:08:31.148 02:28:04 -- accel/accel.sh@20 -- # val=software 00:08:31.148 02:28:04 -- accel/accel.sh@21 -- # case "$var" in 00:08:31.148 02:28:04 -- accel/accel.sh@22 -- # accel_module=software 00:08:31.148 02:28:04 -- accel/accel.sh@19 -- # IFS=: 00:08:31.148 02:28:04 -- accel/accel.sh@19 -- # read -r var val 00:08:31.148 02:28:04 -- accel/accel.sh@20 -- # val=32 00:08:31.148 02:28:04 -- accel/accel.sh@21 -- # case "$var" in 00:08:31.148 02:28:04 -- accel/accel.sh@19 -- # IFS=: 00:08:31.148 02:28:04 -- accel/accel.sh@19 -- # read -r var val 00:08:31.148 02:28:04 -- accel/accel.sh@20 -- # val=32 00:08:31.148 02:28:04 -- accel/accel.sh@21 -- # case "$var" in 00:08:31.148 02:28:04 -- accel/accel.sh@19 -- # IFS=: 00:08:31.148 02:28:04 -- accel/accel.sh@19 -- # read -r var val 00:08:31.148 02:28:04 -- accel/accel.sh@20 -- # val=1 00:08:31.148 02:28:04 -- accel/accel.sh@21 -- # case "$var" in 00:08:31.148 02:28:04 -- accel/accel.sh@19 -- # IFS=: 00:08:31.148 02:28:04 -- accel/accel.sh@19 -- # read -r var val 00:08:31.148 02:28:04 -- accel/accel.sh@20 -- # val='1 seconds' 00:08:31.148 02:28:04 -- accel/accel.sh@21 -- # case "$var" in 00:08:31.148 02:28:04 -- accel/accel.sh@19 -- # IFS=: 00:08:31.148 02:28:04 -- accel/accel.sh@19 -- # read -r var val 00:08:31.148 02:28:04 -- accel/accel.sh@20 -- # val=No 00:08:31.148 02:28:04 -- accel/accel.sh@21 -- # case "$var" in 00:08:31.148 02:28:04 -- accel/accel.sh@19 -- # IFS=: 00:08:31.148 02:28:04 -- accel/accel.sh@19 -- # read -r var val 00:08:31.148 02:28:04 -- accel/accel.sh@20 -- # val= 00:08:31.148 02:28:04 -- accel/accel.sh@21 -- # case "$var" in 00:08:31.148 02:28:04 -- accel/accel.sh@19 -- # IFS=: 00:08:31.148 02:28:04 -- accel/accel.sh@19 -- # read -r var val 00:08:31.148 02:28:04 -- accel/accel.sh@20 -- # val= 00:08:31.148 02:28:04 -- accel/accel.sh@21 -- # case "$var" in 00:08:31.148 02:28:04 -- accel/accel.sh@19 -- # IFS=: 00:08:31.148 02:28:04 -- accel/accel.sh@19 -- # read -r var val 00:08:32.106 02:28:05 -- accel/accel.sh@20 -- # val= 00:08:32.106 02:28:05 -- accel/accel.sh@21 -- # case "$var" in 00:08:32.106 02:28:05 -- accel/accel.sh@19 -- # IFS=: 00:08:32.106 02:28:05 -- accel/accel.sh@19 -- # read -r var val 00:08:32.106 02:28:05 -- accel/accel.sh@20 -- # val= 00:08:32.106 02:28:05 -- accel/accel.sh@21 -- # case "$var" in 00:08:32.106 02:28:05 -- accel/accel.sh@19 -- # IFS=: 00:08:32.106 02:28:05 -- accel/accel.sh@19 -- # read -r var val 00:08:32.106 02:28:05 -- accel/accel.sh@20 -- # val= 00:08:32.106 02:28:05 -- accel/accel.sh@21 -- # case "$var" in 00:08:32.106 02:28:05 -- accel/accel.sh@19 -- # IFS=: 00:08:32.106 02:28:05 -- accel/accel.sh@19 -- # read -r var val 00:08:32.106 02:28:05 -- accel/accel.sh@20 -- # val= 00:08:32.106 02:28:05 -- accel/accel.sh@21 -- # case "$var" in 00:08:32.106 02:28:05 -- accel/accel.sh@19 -- # IFS=: 00:08:32.106 02:28:05 -- accel/accel.sh@19 -- # read -r var val 00:08:32.106 02:28:05 -- accel/accel.sh@20 -- # val= 00:08:32.106 02:28:05 -- accel/accel.sh@21 -- # case "$var" in 00:08:32.106 02:28:05 -- accel/accel.sh@19 -- # IFS=: 00:08:32.106 02:28:05 -- accel/accel.sh@19 -- # read -r var val 00:08:32.106 02:28:05 -- accel/accel.sh@20 -- # val= 00:08:32.106 02:28:05 -- accel/accel.sh@21 -- # case "$var" in 00:08:32.106 02:28:05 -- accel/accel.sh@19 -- # IFS=: 00:08:32.106 02:28:05 -- accel/accel.sh@19 -- # read -r var val 00:08:32.106 02:28:05 -- accel/accel.sh@27 -- # [[ -n software ]] 00:08:32.106 02:28:05 -- accel/accel.sh@27 -- # [[ -n dif_generate ]] 00:08:32.106 02:28:05 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:32.106 00:08:32.106 real 0m1.403s 00:08:32.106 user 0m1.264s 00:08:32.106 sys 0m0.141s 00:08:32.106 02:28:05 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:32.106 02:28:05 -- common/autotest_common.sh@10 -- # set +x 00:08:32.106 ************************************ 00:08:32.106 END TEST accel_dif_generate 00:08:32.106 ************************************ 00:08:32.106 02:28:05 -- accel/accel.sh@113 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:08:32.106 02:28:05 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:08:32.106 02:28:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:32.106 02:28:05 -- common/autotest_common.sh@10 -- # set +x 00:08:32.365 ************************************ 00:08:32.365 START TEST accel_dif_generate_copy 00:08:32.365 ************************************ 00:08:32.365 02:28:05 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w dif_generate_copy 00:08:32.365 02:28:05 -- accel/accel.sh@16 -- # local accel_opc 00:08:32.365 02:28:05 -- accel/accel.sh@17 -- # local accel_module 00:08:32.365 02:28:05 -- accel/accel.sh@19 -- # IFS=: 00:08:32.365 02:28:05 -- accel/accel.sh@19 -- # read -r var val 00:08:32.365 02:28:05 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:08:32.365 02:28:05 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:08:32.365 02:28:05 -- accel/accel.sh@12 -- # build_accel_config 00:08:32.365 02:28:05 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:08:32.365 02:28:05 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:08:32.365 02:28:05 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:32.365 02:28:05 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:32.365 02:28:05 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:08:32.365 02:28:05 -- accel/accel.sh@40 -- # local IFS=, 00:08:32.365 02:28:05 -- accel/accel.sh@41 -- # jq -r . 00:08:32.365 [2024-04-27 02:28:05.830535] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:08:32.365 [2024-04-27 02:28:05.830594] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1438781 ] 00:08:32.365 EAL: No free 2048 kB hugepages reported on node 1 00:08:32.365 [2024-04-27 02:28:05.902951] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:32.625 [2024-04-27 02:28:05.990317] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:32.625 02:28:06 -- accel/accel.sh@20 -- # val= 00:08:32.625 02:28:06 -- accel/accel.sh@21 -- # case "$var" in 00:08:32.625 02:28:06 -- accel/accel.sh@19 -- # IFS=: 00:08:32.625 02:28:06 -- accel/accel.sh@19 -- # read -r var val 00:08:32.625 02:28:06 -- accel/accel.sh@20 -- # val= 00:08:32.625 02:28:06 -- accel/accel.sh@21 -- # case "$var" in 00:08:32.625 02:28:06 -- accel/accel.sh@19 -- # IFS=: 00:08:32.625 02:28:06 -- accel/accel.sh@19 -- # read -r var val 00:08:32.625 02:28:06 -- accel/accel.sh@20 -- # val=0x1 00:08:32.625 02:28:06 -- accel/accel.sh@21 -- # case "$var" in 00:08:32.625 02:28:06 -- accel/accel.sh@19 -- # IFS=: 00:08:32.625 02:28:06 -- accel/accel.sh@19 -- # read -r var val 00:08:32.625 02:28:06 -- accel/accel.sh@20 -- # val= 00:08:32.625 02:28:06 -- accel/accel.sh@21 -- # case "$var" in 00:08:32.625 02:28:06 -- accel/accel.sh@19 -- # IFS=: 00:08:32.625 02:28:06 -- accel/accel.sh@19 -- # read -r var val 00:08:32.625 02:28:06 -- accel/accel.sh@20 -- # val= 00:08:32.625 02:28:06 -- accel/accel.sh@21 -- # case "$var" in 00:08:32.625 02:28:06 -- accel/accel.sh@19 -- # IFS=: 00:08:32.625 02:28:06 -- accel/accel.sh@19 -- # read -r var val 00:08:32.625 02:28:06 -- accel/accel.sh@20 -- # val=dif_generate_copy 00:08:32.625 02:28:06 -- accel/accel.sh@21 -- # case "$var" in 00:08:32.625 02:28:06 -- accel/accel.sh@23 -- # accel_opc=dif_generate_copy 00:08:32.625 02:28:06 -- accel/accel.sh@19 -- # IFS=: 00:08:32.625 02:28:06 -- accel/accel.sh@19 -- # read -r var val 00:08:32.625 02:28:06 -- accel/accel.sh@20 -- # val='4096 bytes' 00:08:32.625 02:28:06 -- accel/accel.sh@21 -- # case "$var" in 00:08:32.625 02:28:06 -- accel/accel.sh@19 -- # IFS=: 00:08:32.625 02:28:06 -- accel/accel.sh@19 -- # read -r var val 00:08:32.625 02:28:06 -- accel/accel.sh@20 -- # val='4096 bytes' 00:08:32.625 02:28:06 -- accel/accel.sh@21 -- # case "$var" in 00:08:32.625 02:28:06 -- accel/accel.sh@19 -- # IFS=: 00:08:32.625 02:28:06 -- accel/accel.sh@19 -- # read -r var val 00:08:32.625 02:28:06 -- accel/accel.sh@20 -- # val= 00:08:32.625 02:28:06 -- accel/accel.sh@21 -- # case "$var" in 00:08:32.625 02:28:06 -- accel/accel.sh@19 -- # IFS=: 00:08:32.625 02:28:06 -- accel/accel.sh@19 -- # read -r var val 00:08:32.625 02:28:06 -- accel/accel.sh@20 -- # val=software 00:08:32.625 02:28:06 -- accel/accel.sh@21 -- # case "$var" in 00:08:32.625 02:28:06 -- accel/accel.sh@22 -- # accel_module=software 00:08:32.625 02:28:06 -- accel/accel.sh@19 -- # IFS=: 00:08:32.625 02:28:06 -- accel/accel.sh@19 -- # read -r var val 00:08:32.625 02:28:06 -- accel/accel.sh@20 -- # val=32 00:08:32.625 02:28:06 -- accel/accel.sh@21 -- # case "$var" in 00:08:32.625 02:28:06 -- accel/accel.sh@19 -- # IFS=: 00:08:32.625 02:28:06 -- accel/accel.sh@19 -- # read -r var val 00:08:32.625 02:28:06 -- accel/accel.sh@20 -- # val=32 00:08:32.625 02:28:06 -- accel/accel.sh@21 -- # case "$var" in 00:08:32.625 02:28:06 -- accel/accel.sh@19 -- # IFS=: 00:08:32.625 02:28:06 -- accel/accel.sh@19 -- # read -r var val 00:08:32.625 02:28:06 -- accel/accel.sh@20 -- # val=1 00:08:32.625 02:28:06 -- accel/accel.sh@21 -- # case "$var" in 00:08:32.625 02:28:06 -- accel/accel.sh@19 -- # IFS=: 00:08:32.625 02:28:06 -- accel/accel.sh@19 -- # read -r var val 00:08:32.625 02:28:06 -- accel/accel.sh@20 -- # val='1 seconds' 00:08:32.625 02:28:06 -- accel/accel.sh@21 -- # case "$var" in 00:08:32.625 02:28:06 -- accel/accel.sh@19 -- # IFS=: 00:08:32.625 02:28:06 -- accel/accel.sh@19 -- # read -r var val 00:08:32.625 02:28:06 -- accel/accel.sh@20 -- # val=No 00:08:32.625 02:28:06 -- accel/accel.sh@21 -- # case "$var" in 00:08:32.625 02:28:06 -- accel/accel.sh@19 -- # IFS=: 00:08:32.625 02:28:06 -- accel/accel.sh@19 -- # read -r var val 00:08:32.625 02:28:06 -- accel/accel.sh@20 -- # val= 00:08:32.625 02:28:06 -- accel/accel.sh@21 -- # case "$var" in 00:08:32.625 02:28:06 -- accel/accel.sh@19 -- # IFS=: 00:08:32.625 02:28:06 -- accel/accel.sh@19 -- # read -r var val 00:08:32.625 02:28:06 -- accel/accel.sh@20 -- # val= 00:08:32.625 02:28:06 -- accel/accel.sh@21 -- # case "$var" in 00:08:32.625 02:28:06 -- accel/accel.sh@19 -- # IFS=: 00:08:32.625 02:28:06 -- accel/accel.sh@19 -- # read -r var val 00:08:34.005 02:28:07 -- accel/accel.sh@20 -- # val= 00:08:34.005 02:28:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:34.005 02:28:07 -- accel/accel.sh@19 -- # IFS=: 00:08:34.005 02:28:07 -- accel/accel.sh@19 -- # read -r var val 00:08:34.005 02:28:07 -- accel/accel.sh@20 -- # val= 00:08:34.005 02:28:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:34.005 02:28:07 -- accel/accel.sh@19 -- # IFS=: 00:08:34.005 02:28:07 -- accel/accel.sh@19 -- # read -r var val 00:08:34.005 02:28:07 -- accel/accel.sh@20 -- # val= 00:08:34.005 02:28:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:34.005 02:28:07 -- accel/accel.sh@19 -- # IFS=: 00:08:34.005 02:28:07 -- accel/accel.sh@19 -- # read -r var val 00:08:34.005 02:28:07 -- accel/accel.sh@20 -- # val= 00:08:34.005 02:28:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:34.005 02:28:07 -- accel/accel.sh@19 -- # IFS=: 00:08:34.005 02:28:07 -- accel/accel.sh@19 -- # read -r var val 00:08:34.005 02:28:07 -- accel/accel.sh@20 -- # val= 00:08:34.005 02:28:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:34.005 02:28:07 -- accel/accel.sh@19 -- # IFS=: 00:08:34.005 02:28:07 -- accel/accel.sh@19 -- # read -r var val 00:08:34.005 02:28:07 -- accel/accel.sh@20 -- # val= 00:08:34.005 02:28:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:34.005 02:28:07 -- accel/accel.sh@19 -- # IFS=: 00:08:34.005 02:28:07 -- accel/accel.sh@19 -- # read -r var val 00:08:34.005 02:28:07 -- accel/accel.sh@27 -- # [[ -n software ]] 00:08:34.005 02:28:07 -- accel/accel.sh@27 -- # [[ -n dif_generate_copy ]] 00:08:34.005 02:28:07 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:34.005 00:08:34.005 real 0m1.413s 00:08:34.005 user 0m1.274s 00:08:34.005 sys 0m0.144s 00:08:34.005 02:28:07 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:34.005 02:28:07 -- common/autotest_common.sh@10 -- # set +x 00:08:34.005 ************************************ 00:08:34.005 END TEST accel_dif_generate_copy 00:08:34.005 ************************************ 00:08:34.005 02:28:07 -- accel/accel.sh@115 -- # [[ y == y ]] 00:08:34.005 02:28:07 -- accel/accel.sh@116 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:08:34.005 02:28:07 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:08:34.005 02:28:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:34.005 02:28:07 -- common/autotest_common.sh@10 -- # set +x 00:08:34.005 ************************************ 00:08:34.005 START TEST accel_comp 00:08:34.005 ************************************ 00:08:34.005 02:28:07 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:08:34.005 02:28:07 -- accel/accel.sh@16 -- # local accel_opc 00:08:34.005 02:28:07 -- accel/accel.sh@17 -- # local accel_module 00:08:34.005 02:28:07 -- accel/accel.sh@19 -- # IFS=: 00:08:34.005 02:28:07 -- accel/accel.sh@19 -- # read -r var val 00:08:34.005 02:28:07 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:08:34.005 02:28:07 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:08:34.005 02:28:07 -- accel/accel.sh@12 -- # build_accel_config 00:08:34.005 02:28:07 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:08:34.005 02:28:07 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:08:34.006 02:28:07 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:34.006 02:28:07 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:34.006 02:28:07 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:08:34.006 02:28:07 -- accel/accel.sh@40 -- # local IFS=, 00:08:34.006 02:28:07 -- accel/accel.sh@41 -- # jq -r . 00:08:34.006 [2024-04-27 02:28:07.419901] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:08:34.006 [2024-04-27 02:28:07.419971] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1439085 ] 00:08:34.006 EAL: No free 2048 kB hugepages reported on node 1 00:08:34.006 [2024-04-27 02:28:07.492314] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:34.006 [2024-04-27 02:28:07.571208] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:34.006 02:28:07 -- accel/accel.sh@20 -- # val= 00:08:34.006 02:28:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:34.006 02:28:07 -- accel/accel.sh@19 -- # IFS=: 00:08:34.006 02:28:07 -- accel/accel.sh@19 -- # read -r var val 00:08:34.006 02:28:07 -- accel/accel.sh@20 -- # val= 00:08:34.006 02:28:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:34.006 02:28:07 -- accel/accel.sh@19 -- # IFS=: 00:08:34.006 02:28:07 -- accel/accel.sh@19 -- # read -r var val 00:08:34.006 02:28:07 -- accel/accel.sh@20 -- # val= 00:08:34.006 02:28:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:34.006 02:28:07 -- accel/accel.sh@19 -- # IFS=: 00:08:34.006 02:28:07 -- accel/accel.sh@19 -- # read -r var val 00:08:34.006 02:28:07 -- accel/accel.sh@20 -- # val=0x1 00:08:34.006 02:28:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:34.006 02:28:07 -- accel/accel.sh@19 -- # IFS=: 00:08:34.006 02:28:07 -- accel/accel.sh@19 -- # read -r var val 00:08:34.006 02:28:07 -- accel/accel.sh@20 -- # val= 00:08:34.006 02:28:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:34.006 02:28:07 -- accel/accel.sh@19 -- # IFS=: 00:08:34.006 02:28:07 -- accel/accel.sh@19 -- # read -r var val 00:08:34.006 02:28:07 -- accel/accel.sh@20 -- # val= 00:08:34.006 02:28:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:34.006 02:28:07 -- accel/accel.sh@19 -- # IFS=: 00:08:34.006 02:28:07 -- accel/accel.sh@19 -- # read -r var val 00:08:34.006 02:28:07 -- accel/accel.sh@20 -- # val=compress 00:08:34.006 02:28:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:34.006 02:28:07 -- accel/accel.sh@23 -- # accel_opc=compress 00:08:34.006 02:28:07 -- accel/accel.sh@19 -- # IFS=: 00:08:34.006 02:28:07 -- accel/accel.sh@19 -- # read -r var val 00:08:34.006 02:28:07 -- accel/accel.sh@20 -- # val='4096 bytes' 00:08:34.006 02:28:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:34.006 02:28:07 -- accel/accel.sh@19 -- # IFS=: 00:08:34.006 02:28:07 -- accel/accel.sh@19 -- # read -r var val 00:08:34.006 02:28:07 -- accel/accel.sh@20 -- # val= 00:08:34.006 02:28:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:34.006 02:28:07 -- accel/accel.sh@19 -- # IFS=: 00:08:34.006 02:28:07 -- accel/accel.sh@19 -- # read -r var val 00:08:34.006 02:28:07 -- accel/accel.sh@20 -- # val=software 00:08:34.006 02:28:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:34.006 02:28:07 -- accel/accel.sh@22 -- # accel_module=software 00:08:34.006 02:28:07 -- accel/accel.sh@19 -- # IFS=: 00:08:34.006 02:28:07 -- accel/accel.sh@19 -- # read -r var val 00:08:34.006 02:28:07 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:08:34.006 02:28:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:34.006 02:28:07 -- accel/accel.sh@19 -- # IFS=: 00:08:34.006 02:28:07 -- accel/accel.sh@19 -- # read -r var val 00:08:34.006 02:28:07 -- accel/accel.sh@20 -- # val=32 00:08:34.006 02:28:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:34.006 02:28:07 -- accel/accel.sh@19 -- # IFS=: 00:08:34.006 02:28:07 -- accel/accel.sh@19 -- # read -r var val 00:08:34.006 02:28:07 -- accel/accel.sh@20 -- # val=32 00:08:34.006 02:28:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:34.006 02:28:07 -- accel/accel.sh@19 -- # IFS=: 00:08:34.006 02:28:07 -- accel/accel.sh@19 -- # read -r var val 00:08:34.006 02:28:07 -- accel/accel.sh@20 -- # val=1 00:08:34.006 02:28:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:34.006 02:28:07 -- accel/accel.sh@19 -- # IFS=: 00:08:34.006 02:28:07 -- accel/accel.sh@19 -- # read -r var val 00:08:34.006 02:28:07 -- accel/accel.sh@20 -- # val='1 seconds' 00:08:34.006 02:28:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:34.006 02:28:07 -- accel/accel.sh@19 -- # IFS=: 00:08:34.006 02:28:07 -- accel/accel.sh@19 -- # read -r var val 00:08:34.006 02:28:07 -- accel/accel.sh@20 -- # val=No 00:08:34.006 02:28:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:34.006 02:28:07 -- accel/accel.sh@19 -- # IFS=: 00:08:34.006 02:28:07 -- accel/accel.sh@19 -- # read -r var val 00:08:34.006 02:28:07 -- accel/accel.sh@20 -- # val= 00:08:34.006 02:28:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:34.006 02:28:07 -- accel/accel.sh@19 -- # IFS=: 00:08:34.006 02:28:07 -- accel/accel.sh@19 -- # read -r var val 00:08:34.006 02:28:07 -- accel/accel.sh@20 -- # val= 00:08:34.006 02:28:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:34.006 02:28:07 -- accel/accel.sh@19 -- # IFS=: 00:08:34.006 02:28:07 -- accel/accel.sh@19 -- # read -r var val 00:08:35.386 02:28:08 -- accel/accel.sh@20 -- # val= 00:08:35.386 02:28:08 -- accel/accel.sh@21 -- # case "$var" in 00:08:35.386 02:28:08 -- accel/accel.sh@19 -- # IFS=: 00:08:35.386 02:28:08 -- accel/accel.sh@19 -- # read -r var val 00:08:35.387 02:28:08 -- accel/accel.sh@20 -- # val= 00:08:35.387 02:28:08 -- accel/accel.sh@21 -- # case "$var" in 00:08:35.387 02:28:08 -- accel/accel.sh@19 -- # IFS=: 00:08:35.387 02:28:08 -- accel/accel.sh@19 -- # read -r var val 00:08:35.387 02:28:08 -- accel/accel.sh@20 -- # val= 00:08:35.387 02:28:08 -- accel/accel.sh@21 -- # case "$var" in 00:08:35.387 02:28:08 -- accel/accel.sh@19 -- # IFS=: 00:08:35.387 02:28:08 -- accel/accel.sh@19 -- # read -r var val 00:08:35.387 02:28:08 -- accel/accel.sh@20 -- # val= 00:08:35.387 02:28:08 -- accel/accel.sh@21 -- # case "$var" in 00:08:35.387 02:28:08 -- accel/accel.sh@19 -- # IFS=: 00:08:35.387 02:28:08 -- accel/accel.sh@19 -- # read -r var val 00:08:35.387 02:28:08 -- accel/accel.sh@20 -- # val= 00:08:35.387 02:28:08 -- accel/accel.sh@21 -- # case "$var" in 00:08:35.387 02:28:08 -- accel/accel.sh@19 -- # IFS=: 00:08:35.387 02:28:08 -- accel/accel.sh@19 -- # read -r var val 00:08:35.387 02:28:08 -- accel/accel.sh@20 -- # val= 00:08:35.387 02:28:08 -- accel/accel.sh@21 -- # case "$var" in 00:08:35.387 02:28:08 -- accel/accel.sh@19 -- # IFS=: 00:08:35.387 02:28:08 -- accel/accel.sh@19 -- # read -r var val 00:08:35.387 02:28:08 -- accel/accel.sh@27 -- # [[ -n software ]] 00:08:35.387 02:28:08 -- accel/accel.sh@27 -- # [[ -n compress ]] 00:08:35.387 02:28:08 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:35.387 00:08:35.387 real 0m1.391s 00:08:35.387 user 0m1.260s 00:08:35.387 sys 0m0.132s 00:08:35.387 02:28:08 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:35.387 02:28:08 -- common/autotest_common.sh@10 -- # set +x 00:08:35.387 ************************************ 00:08:35.387 END TEST accel_comp 00:08:35.387 ************************************ 00:08:35.387 02:28:08 -- accel/accel.sh@117 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:08:35.387 02:28:08 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:08:35.387 02:28:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:35.387 02:28:08 -- common/autotest_common.sh@10 -- # set +x 00:08:35.387 ************************************ 00:08:35.387 START TEST accel_decomp 00:08:35.387 ************************************ 00:08:35.387 02:28:08 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:08:35.387 02:28:08 -- accel/accel.sh@16 -- # local accel_opc 00:08:35.387 02:28:08 -- accel/accel.sh@17 -- # local accel_module 00:08:35.387 02:28:08 -- accel/accel.sh@19 -- # IFS=: 00:08:35.387 02:28:08 -- accel/accel.sh@19 -- # read -r var val 00:08:35.387 02:28:08 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:08:35.387 02:28:08 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:08:35.387 02:28:08 -- accel/accel.sh@12 -- # build_accel_config 00:08:35.387 02:28:08 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:08:35.387 02:28:08 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:08:35.387 02:28:08 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:35.387 02:28:08 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:35.387 02:28:08 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:08:35.387 02:28:08 -- accel/accel.sh@40 -- # local IFS=, 00:08:35.387 02:28:08 -- accel/accel.sh@41 -- # jq -r . 00:08:35.647 [2024-04-27 02:28:09.018253] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:08:35.647 [2024-04-27 02:28:09.018332] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1439364 ] 00:08:35.647 EAL: No free 2048 kB hugepages reported on node 1 00:08:35.647 [2024-04-27 02:28:09.090797] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:35.647 [2024-04-27 02:28:09.181272] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:35.647 02:28:09 -- accel/accel.sh@20 -- # val= 00:08:35.647 02:28:09 -- accel/accel.sh@21 -- # case "$var" in 00:08:35.647 02:28:09 -- accel/accel.sh@19 -- # IFS=: 00:08:35.647 02:28:09 -- accel/accel.sh@19 -- # read -r var val 00:08:35.647 02:28:09 -- accel/accel.sh@20 -- # val= 00:08:35.647 02:28:09 -- accel/accel.sh@21 -- # case "$var" in 00:08:35.647 02:28:09 -- accel/accel.sh@19 -- # IFS=: 00:08:35.647 02:28:09 -- accel/accel.sh@19 -- # read -r var val 00:08:35.647 02:28:09 -- accel/accel.sh@20 -- # val= 00:08:35.647 02:28:09 -- accel/accel.sh@21 -- # case "$var" in 00:08:35.647 02:28:09 -- accel/accel.sh@19 -- # IFS=: 00:08:35.647 02:28:09 -- accel/accel.sh@19 -- # read -r var val 00:08:35.647 02:28:09 -- accel/accel.sh@20 -- # val=0x1 00:08:35.647 02:28:09 -- accel/accel.sh@21 -- # case "$var" in 00:08:35.647 02:28:09 -- accel/accel.sh@19 -- # IFS=: 00:08:35.647 02:28:09 -- accel/accel.sh@19 -- # read -r var val 00:08:35.647 02:28:09 -- accel/accel.sh@20 -- # val= 00:08:35.647 02:28:09 -- accel/accel.sh@21 -- # case "$var" in 00:08:35.647 02:28:09 -- accel/accel.sh@19 -- # IFS=: 00:08:35.647 02:28:09 -- accel/accel.sh@19 -- # read -r var val 00:08:35.647 02:28:09 -- accel/accel.sh@20 -- # val= 00:08:35.647 02:28:09 -- accel/accel.sh@21 -- # case "$var" in 00:08:35.647 02:28:09 -- accel/accel.sh@19 -- # IFS=: 00:08:35.647 02:28:09 -- accel/accel.sh@19 -- # read -r var val 00:08:35.647 02:28:09 -- accel/accel.sh@20 -- # val=decompress 00:08:35.647 02:28:09 -- accel/accel.sh@21 -- # case "$var" in 00:08:35.647 02:28:09 -- accel/accel.sh@23 -- # accel_opc=decompress 00:08:35.647 02:28:09 -- accel/accel.sh@19 -- # IFS=: 00:08:35.647 02:28:09 -- accel/accel.sh@19 -- # read -r var val 00:08:35.647 02:28:09 -- accel/accel.sh@20 -- # val='4096 bytes' 00:08:35.647 02:28:09 -- accel/accel.sh@21 -- # case "$var" in 00:08:35.647 02:28:09 -- accel/accel.sh@19 -- # IFS=: 00:08:35.647 02:28:09 -- accel/accel.sh@19 -- # read -r var val 00:08:35.647 02:28:09 -- accel/accel.sh@20 -- # val= 00:08:35.647 02:28:09 -- accel/accel.sh@21 -- # case "$var" in 00:08:35.647 02:28:09 -- accel/accel.sh@19 -- # IFS=: 00:08:35.647 02:28:09 -- accel/accel.sh@19 -- # read -r var val 00:08:35.647 02:28:09 -- accel/accel.sh@20 -- # val=software 00:08:35.647 02:28:09 -- accel/accel.sh@21 -- # case "$var" in 00:08:35.647 02:28:09 -- accel/accel.sh@22 -- # accel_module=software 00:08:35.647 02:28:09 -- accel/accel.sh@19 -- # IFS=: 00:08:35.647 02:28:09 -- accel/accel.sh@19 -- # read -r var val 00:08:35.647 02:28:09 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:08:35.647 02:28:09 -- accel/accel.sh@21 -- # case "$var" in 00:08:35.647 02:28:09 -- accel/accel.sh@19 -- # IFS=: 00:08:35.647 02:28:09 -- accel/accel.sh@19 -- # read -r var val 00:08:35.647 02:28:09 -- accel/accel.sh@20 -- # val=32 00:08:35.647 02:28:09 -- accel/accel.sh@21 -- # case "$var" in 00:08:35.647 02:28:09 -- accel/accel.sh@19 -- # IFS=: 00:08:35.647 02:28:09 -- accel/accel.sh@19 -- # read -r var val 00:08:35.647 02:28:09 -- accel/accel.sh@20 -- # val=32 00:08:35.647 02:28:09 -- accel/accel.sh@21 -- # case "$var" in 00:08:35.647 02:28:09 -- accel/accel.sh@19 -- # IFS=: 00:08:35.647 02:28:09 -- accel/accel.sh@19 -- # read -r var val 00:08:35.647 02:28:09 -- accel/accel.sh@20 -- # val=1 00:08:35.647 02:28:09 -- accel/accel.sh@21 -- # case "$var" in 00:08:35.647 02:28:09 -- accel/accel.sh@19 -- # IFS=: 00:08:35.647 02:28:09 -- accel/accel.sh@19 -- # read -r var val 00:08:35.647 02:28:09 -- accel/accel.sh@20 -- # val='1 seconds' 00:08:35.647 02:28:09 -- accel/accel.sh@21 -- # case "$var" in 00:08:35.647 02:28:09 -- accel/accel.sh@19 -- # IFS=: 00:08:35.647 02:28:09 -- accel/accel.sh@19 -- # read -r var val 00:08:35.647 02:28:09 -- accel/accel.sh@20 -- # val=Yes 00:08:35.647 02:28:09 -- accel/accel.sh@21 -- # case "$var" in 00:08:35.647 02:28:09 -- accel/accel.sh@19 -- # IFS=: 00:08:35.647 02:28:09 -- accel/accel.sh@19 -- # read -r var val 00:08:35.647 02:28:09 -- accel/accel.sh@20 -- # val= 00:08:35.647 02:28:09 -- accel/accel.sh@21 -- # case "$var" in 00:08:35.647 02:28:09 -- accel/accel.sh@19 -- # IFS=: 00:08:35.647 02:28:09 -- accel/accel.sh@19 -- # read -r var val 00:08:35.647 02:28:09 -- accel/accel.sh@20 -- # val= 00:08:35.647 02:28:09 -- accel/accel.sh@21 -- # case "$var" in 00:08:35.647 02:28:09 -- accel/accel.sh@19 -- # IFS=: 00:08:35.647 02:28:09 -- accel/accel.sh@19 -- # read -r var val 00:08:37.037 02:28:10 -- accel/accel.sh@20 -- # val= 00:08:37.037 02:28:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:37.037 02:28:10 -- accel/accel.sh@19 -- # IFS=: 00:08:37.037 02:28:10 -- accel/accel.sh@19 -- # read -r var val 00:08:37.037 02:28:10 -- accel/accel.sh@20 -- # val= 00:08:37.037 02:28:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:37.037 02:28:10 -- accel/accel.sh@19 -- # IFS=: 00:08:37.037 02:28:10 -- accel/accel.sh@19 -- # read -r var val 00:08:37.037 02:28:10 -- accel/accel.sh@20 -- # val= 00:08:37.037 02:28:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:37.037 02:28:10 -- accel/accel.sh@19 -- # IFS=: 00:08:37.037 02:28:10 -- accel/accel.sh@19 -- # read -r var val 00:08:37.037 02:28:10 -- accel/accel.sh@20 -- # val= 00:08:37.037 02:28:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:37.037 02:28:10 -- accel/accel.sh@19 -- # IFS=: 00:08:37.037 02:28:10 -- accel/accel.sh@19 -- # read -r var val 00:08:37.037 02:28:10 -- accel/accel.sh@20 -- # val= 00:08:37.037 02:28:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:37.037 02:28:10 -- accel/accel.sh@19 -- # IFS=: 00:08:37.037 02:28:10 -- accel/accel.sh@19 -- # read -r var val 00:08:37.037 02:28:10 -- accel/accel.sh@20 -- # val= 00:08:37.037 02:28:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:37.037 02:28:10 -- accel/accel.sh@19 -- # IFS=: 00:08:37.037 02:28:10 -- accel/accel.sh@19 -- # read -r var val 00:08:37.037 02:28:10 -- accel/accel.sh@27 -- # [[ -n software ]] 00:08:37.037 02:28:10 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:08:37.037 02:28:10 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:37.037 00:08:37.037 real 0m1.422s 00:08:37.037 user 0m1.272s 00:08:37.037 sys 0m0.153s 00:08:37.037 02:28:10 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:37.037 02:28:10 -- common/autotest_common.sh@10 -- # set +x 00:08:37.037 ************************************ 00:08:37.037 END TEST accel_decomp 00:08:37.037 ************************************ 00:08:37.038 02:28:10 -- accel/accel.sh@118 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 00:08:37.038 02:28:10 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:08:37.038 02:28:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:37.038 02:28:10 -- common/autotest_common.sh@10 -- # set +x 00:08:37.038 ************************************ 00:08:37.038 START TEST accel_decmop_full 00:08:37.038 ************************************ 00:08:37.038 02:28:10 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 00:08:37.038 02:28:10 -- accel/accel.sh@16 -- # local accel_opc 00:08:37.038 02:28:10 -- accel/accel.sh@17 -- # local accel_module 00:08:37.038 02:28:10 -- accel/accel.sh@19 -- # IFS=: 00:08:37.038 02:28:10 -- accel/accel.sh@19 -- # read -r var val 00:08:37.038 02:28:10 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 00:08:37.038 02:28:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 00:08:37.038 02:28:10 -- accel/accel.sh@12 -- # build_accel_config 00:08:37.038 02:28:10 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:08:37.038 02:28:10 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:08:37.038 02:28:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:37.038 02:28:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:37.038 02:28:10 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:08:37.038 02:28:10 -- accel/accel.sh@40 -- # local IFS=, 00:08:37.038 02:28:10 -- accel/accel.sh@41 -- # jq -r . 00:08:37.038 [2024-04-27 02:28:10.618463] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:08:37.038 [2024-04-27 02:28:10.618535] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1439576 ] 00:08:37.038 EAL: No free 2048 kB hugepages reported on node 1 00:08:37.298 [2024-04-27 02:28:10.690620] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:37.298 [2024-04-27 02:28:10.772388] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:37.298 02:28:10 -- accel/accel.sh@20 -- # val= 00:08:37.298 02:28:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:37.298 02:28:10 -- accel/accel.sh@19 -- # IFS=: 00:08:37.298 02:28:10 -- accel/accel.sh@19 -- # read -r var val 00:08:37.298 02:28:10 -- accel/accel.sh@20 -- # val= 00:08:37.298 02:28:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:37.298 02:28:10 -- accel/accel.sh@19 -- # IFS=: 00:08:37.298 02:28:10 -- accel/accel.sh@19 -- # read -r var val 00:08:37.298 02:28:10 -- accel/accel.sh@20 -- # val= 00:08:37.298 02:28:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:37.298 02:28:10 -- accel/accel.sh@19 -- # IFS=: 00:08:37.298 02:28:10 -- accel/accel.sh@19 -- # read -r var val 00:08:37.298 02:28:10 -- accel/accel.sh@20 -- # val=0x1 00:08:37.298 02:28:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:37.298 02:28:10 -- accel/accel.sh@19 -- # IFS=: 00:08:37.298 02:28:10 -- accel/accel.sh@19 -- # read -r var val 00:08:37.298 02:28:10 -- accel/accel.sh@20 -- # val= 00:08:37.298 02:28:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:37.298 02:28:10 -- accel/accel.sh@19 -- # IFS=: 00:08:37.298 02:28:10 -- accel/accel.sh@19 -- # read -r var val 00:08:37.298 02:28:10 -- accel/accel.sh@20 -- # val= 00:08:37.298 02:28:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:37.298 02:28:10 -- accel/accel.sh@19 -- # IFS=: 00:08:37.298 02:28:10 -- accel/accel.sh@19 -- # read -r var val 00:08:37.298 02:28:10 -- accel/accel.sh@20 -- # val=decompress 00:08:37.298 02:28:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:37.298 02:28:10 -- accel/accel.sh@23 -- # accel_opc=decompress 00:08:37.298 02:28:10 -- accel/accel.sh@19 -- # IFS=: 00:08:37.298 02:28:10 -- accel/accel.sh@19 -- # read -r var val 00:08:37.298 02:28:10 -- accel/accel.sh@20 -- # val='111250 bytes' 00:08:37.298 02:28:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:37.298 02:28:10 -- accel/accel.sh@19 -- # IFS=: 00:08:37.298 02:28:10 -- accel/accel.sh@19 -- # read -r var val 00:08:37.298 02:28:10 -- accel/accel.sh@20 -- # val= 00:08:37.298 02:28:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:37.298 02:28:10 -- accel/accel.sh@19 -- # IFS=: 00:08:37.298 02:28:10 -- accel/accel.sh@19 -- # read -r var val 00:08:37.298 02:28:10 -- accel/accel.sh@20 -- # val=software 00:08:37.298 02:28:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:37.298 02:28:10 -- accel/accel.sh@22 -- # accel_module=software 00:08:37.298 02:28:10 -- accel/accel.sh@19 -- # IFS=: 00:08:37.298 02:28:10 -- accel/accel.sh@19 -- # read -r var val 00:08:37.298 02:28:10 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:08:37.298 02:28:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:37.298 02:28:10 -- accel/accel.sh@19 -- # IFS=: 00:08:37.298 02:28:10 -- accel/accel.sh@19 -- # read -r var val 00:08:37.298 02:28:10 -- accel/accel.sh@20 -- # val=32 00:08:37.298 02:28:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:37.298 02:28:10 -- accel/accel.sh@19 -- # IFS=: 00:08:37.298 02:28:10 -- accel/accel.sh@19 -- # read -r var val 00:08:37.298 02:28:10 -- accel/accel.sh@20 -- # val=32 00:08:37.298 02:28:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:37.298 02:28:10 -- accel/accel.sh@19 -- # IFS=: 00:08:37.298 02:28:10 -- accel/accel.sh@19 -- # read -r var val 00:08:37.298 02:28:10 -- accel/accel.sh@20 -- # val=1 00:08:37.298 02:28:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:37.298 02:28:10 -- accel/accel.sh@19 -- # IFS=: 00:08:37.298 02:28:10 -- accel/accel.sh@19 -- # read -r var val 00:08:37.298 02:28:10 -- accel/accel.sh@20 -- # val='1 seconds' 00:08:37.298 02:28:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:37.298 02:28:10 -- accel/accel.sh@19 -- # IFS=: 00:08:37.298 02:28:10 -- accel/accel.sh@19 -- # read -r var val 00:08:37.298 02:28:10 -- accel/accel.sh@20 -- # val=Yes 00:08:37.298 02:28:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:37.298 02:28:10 -- accel/accel.sh@19 -- # IFS=: 00:08:37.298 02:28:10 -- accel/accel.sh@19 -- # read -r var val 00:08:37.298 02:28:10 -- accel/accel.sh@20 -- # val= 00:08:37.298 02:28:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:37.298 02:28:10 -- accel/accel.sh@19 -- # IFS=: 00:08:37.298 02:28:10 -- accel/accel.sh@19 -- # read -r var val 00:08:37.298 02:28:10 -- accel/accel.sh@20 -- # val= 00:08:37.298 02:28:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:37.298 02:28:10 -- accel/accel.sh@19 -- # IFS=: 00:08:37.298 02:28:10 -- accel/accel.sh@19 -- # read -r var val 00:08:38.679 02:28:12 -- accel/accel.sh@20 -- # val= 00:08:38.679 02:28:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:38.679 02:28:12 -- accel/accel.sh@19 -- # IFS=: 00:08:38.679 02:28:12 -- accel/accel.sh@19 -- # read -r var val 00:08:38.679 02:28:12 -- accel/accel.sh@20 -- # val= 00:08:38.679 02:28:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:38.679 02:28:12 -- accel/accel.sh@19 -- # IFS=: 00:08:38.679 02:28:12 -- accel/accel.sh@19 -- # read -r var val 00:08:38.679 02:28:12 -- accel/accel.sh@20 -- # val= 00:08:38.679 02:28:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:38.679 02:28:12 -- accel/accel.sh@19 -- # IFS=: 00:08:38.679 02:28:12 -- accel/accel.sh@19 -- # read -r var val 00:08:38.679 02:28:12 -- accel/accel.sh@20 -- # val= 00:08:38.679 02:28:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:38.679 02:28:12 -- accel/accel.sh@19 -- # IFS=: 00:08:38.679 02:28:12 -- accel/accel.sh@19 -- # read -r var val 00:08:38.679 02:28:12 -- accel/accel.sh@20 -- # val= 00:08:38.679 02:28:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:38.679 02:28:12 -- accel/accel.sh@19 -- # IFS=: 00:08:38.679 02:28:12 -- accel/accel.sh@19 -- # read -r var val 00:08:38.679 02:28:12 -- accel/accel.sh@20 -- # val= 00:08:38.679 02:28:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:38.679 02:28:12 -- accel/accel.sh@19 -- # IFS=: 00:08:38.679 02:28:12 -- accel/accel.sh@19 -- # read -r var val 00:08:38.679 02:28:12 -- accel/accel.sh@27 -- # [[ -n software ]] 00:08:38.679 02:28:12 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:08:38.679 02:28:12 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:38.679 00:08:38.679 real 0m1.417s 00:08:38.679 user 0m1.272s 00:08:38.679 sys 0m0.145s 00:08:38.679 02:28:12 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:38.679 02:28:12 -- common/autotest_common.sh@10 -- # set +x 00:08:38.679 ************************************ 00:08:38.679 END TEST accel_decmop_full 00:08:38.679 ************************************ 00:08:38.679 02:28:12 -- accel/accel.sh@119 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:08:38.679 02:28:12 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:08:38.679 02:28:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:38.679 02:28:12 -- common/autotest_common.sh@10 -- # set +x 00:08:38.679 ************************************ 00:08:38.679 START TEST accel_decomp_mcore 00:08:38.679 ************************************ 00:08:38.679 02:28:12 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:08:38.679 02:28:12 -- accel/accel.sh@16 -- # local accel_opc 00:08:38.679 02:28:12 -- accel/accel.sh@17 -- # local accel_module 00:08:38.679 02:28:12 -- accel/accel.sh@19 -- # IFS=: 00:08:38.679 02:28:12 -- accel/accel.sh@19 -- # read -r var val 00:08:38.679 02:28:12 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:08:38.679 02:28:12 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:08:38.679 02:28:12 -- accel/accel.sh@12 -- # build_accel_config 00:08:38.679 02:28:12 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:08:38.679 02:28:12 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:08:38.679 02:28:12 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:38.679 02:28:12 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:38.679 02:28:12 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:08:38.679 02:28:12 -- accel/accel.sh@40 -- # local IFS=, 00:08:38.679 02:28:12 -- accel/accel.sh@41 -- # jq -r . 00:08:38.679 [2024-04-27 02:28:12.199808] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:08:38.679 [2024-04-27 02:28:12.199854] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1439790 ] 00:08:38.679 EAL: No free 2048 kB hugepages reported on node 1 00:08:38.679 [2024-04-27 02:28:12.271128] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:38.939 [2024-04-27 02:28:12.356400] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:38.939 [2024-04-27 02:28:12.356488] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:38.939 [2024-04-27 02:28:12.356566] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:38.939 [2024-04-27 02:28:12.356568] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:38.939 02:28:12 -- accel/accel.sh@20 -- # val= 00:08:38.939 02:28:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:38.939 02:28:12 -- accel/accel.sh@19 -- # IFS=: 00:08:38.939 02:28:12 -- accel/accel.sh@19 -- # read -r var val 00:08:38.939 02:28:12 -- accel/accel.sh@20 -- # val= 00:08:38.939 02:28:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:38.939 02:28:12 -- accel/accel.sh@19 -- # IFS=: 00:08:38.939 02:28:12 -- accel/accel.sh@19 -- # read -r var val 00:08:38.939 02:28:12 -- accel/accel.sh@20 -- # val= 00:08:38.939 02:28:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:38.939 02:28:12 -- accel/accel.sh@19 -- # IFS=: 00:08:38.939 02:28:12 -- accel/accel.sh@19 -- # read -r var val 00:08:38.939 02:28:12 -- accel/accel.sh@20 -- # val=0xf 00:08:38.939 02:28:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:38.939 02:28:12 -- accel/accel.sh@19 -- # IFS=: 00:08:38.939 02:28:12 -- accel/accel.sh@19 -- # read -r var val 00:08:38.939 02:28:12 -- accel/accel.sh@20 -- # val= 00:08:38.939 02:28:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:38.939 02:28:12 -- accel/accel.sh@19 -- # IFS=: 00:08:38.939 02:28:12 -- accel/accel.sh@19 -- # read -r var val 00:08:38.939 02:28:12 -- accel/accel.sh@20 -- # val= 00:08:38.939 02:28:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:38.939 02:28:12 -- accel/accel.sh@19 -- # IFS=: 00:08:38.939 02:28:12 -- accel/accel.sh@19 -- # read -r var val 00:08:38.939 02:28:12 -- accel/accel.sh@20 -- # val=decompress 00:08:38.939 02:28:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:38.939 02:28:12 -- accel/accel.sh@23 -- # accel_opc=decompress 00:08:38.939 02:28:12 -- accel/accel.sh@19 -- # IFS=: 00:08:38.939 02:28:12 -- accel/accel.sh@19 -- # read -r var val 00:08:38.939 02:28:12 -- accel/accel.sh@20 -- # val='4096 bytes' 00:08:38.939 02:28:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:38.939 02:28:12 -- accel/accel.sh@19 -- # IFS=: 00:08:38.939 02:28:12 -- accel/accel.sh@19 -- # read -r var val 00:08:38.939 02:28:12 -- accel/accel.sh@20 -- # val= 00:08:38.939 02:28:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:38.939 02:28:12 -- accel/accel.sh@19 -- # IFS=: 00:08:38.939 02:28:12 -- accel/accel.sh@19 -- # read -r var val 00:08:38.939 02:28:12 -- accel/accel.sh@20 -- # val=software 00:08:38.939 02:28:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:38.939 02:28:12 -- accel/accel.sh@22 -- # accel_module=software 00:08:38.939 02:28:12 -- accel/accel.sh@19 -- # IFS=: 00:08:38.939 02:28:12 -- accel/accel.sh@19 -- # read -r var val 00:08:38.939 02:28:12 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:08:38.939 02:28:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:38.939 02:28:12 -- accel/accel.sh@19 -- # IFS=: 00:08:38.939 02:28:12 -- accel/accel.sh@19 -- # read -r var val 00:08:38.939 02:28:12 -- accel/accel.sh@20 -- # val=32 00:08:38.939 02:28:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:38.939 02:28:12 -- accel/accel.sh@19 -- # IFS=: 00:08:38.939 02:28:12 -- accel/accel.sh@19 -- # read -r var val 00:08:38.939 02:28:12 -- accel/accel.sh@20 -- # val=32 00:08:38.939 02:28:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:38.939 02:28:12 -- accel/accel.sh@19 -- # IFS=: 00:08:38.939 02:28:12 -- accel/accel.sh@19 -- # read -r var val 00:08:38.939 02:28:12 -- accel/accel.sh@20 -- # val=1 00:08:38.939 02:28:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:38.939 02:28:12 -- accel/accel.sh@19 -- # IFS=: 00:08:38.939 02:28:12 -- accel/accel.sh@19 -- # read -r var val 00:08:38.939 02:28:12 -- accel/accel.sh@20 -- # val='1 seconds' 00:08:38.939 02:28:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:38.939 02:28:12 -- accel/accel.sh@19 -- # IFS=: 00:08:38.939 02:28:12 -- accel/accel.sh@19 -- # read -r var val 00:08:38.939 02:28:12 -- accel/accel.sh@20 -- # val=Yes 00:08:38.939 02:28:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:38.939 02:28:12 -- accel/accel.sh@19 -- # IFS=: 00:08:38.939 02:28:12 -- accel/accel.sh@19 -- # read -r var val 00:08:38.939 02:28:12 -- accel/accel.sh@20 -- # val= 00:08:38.940 02:28:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:38.940 02:28:12 -- accel/accel.sh@19 -- # IFS=: 00:08:38.940 02:28:12 -- accel/accel.sh@19 -- # read -r var val 00:08:38.940 02:28:12 -- accel/accel.sh@20 -- # val= 00:08:38.940 02:28:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:38.940 02:28:12 -- accel/accel.sh@19 -- # IFS=: 00:08:38.940 02:28:12 -- accel/accel.sh@19 -- # read -r var val 00:08:40.334 02:28:13 -- accel/accel.sh@20 -- # val= 00:08:40.334 02:28:13 -- accel/accel.sh@21 -- # case "$var" in 00:08:40.334 02:28:13 -- accel/accel.sh@19 -- # IFS=: 00:08:40.334 02:28:13 -- accel/accel.sh@19 -- # read -r var val 00:08:40.334 02:28:13 -- accel/accel.sh@20 -- # val= 00:08:40.334 02:28:13 -- accel/accel.sh@21 -- # case "$var" in 00:08:40.334 02:28:13 -- accel/accel.sh@19 -- # IFS=: 00:08:40.334 02:28:13 -- accel/accel.sh@19 -- # read -r var val 00:08:40.334 02:28:13 -- accel/accel.sh@20 -- # val= 00:08:40.334 02:28:13 -- accel/accel.sh@21 -- # case "$var" in 00:08:40.334 02:28:13 -- accel/accel.sh@19 -- # IFS=: 00:08:40.334 02:28:13 -- accel/accel.sh@19 -- # read -r var val 00:08:40.334 02:28:13 -- accel/accel.sh@20 -- # val= 00:08:40.334 02:28:13 -- accel/accel.sh@21 -- # case "$var" in 00:08:40.334 02:28:13 -- accel/accel.sh@19 -- # IFS=: 00:08:40.334 02:28:13 -- accel/accel.sh@19 -- # read -r var val 00:08:40.334 02:28:13 -- accel/accel.sh@20 -- # val= 00:08:40.334 02:28:13 -- accel/accel.sh@21 -- # case "$var" in 00:08:40.334 02:28:13 -- accel/accel.sh@19 -- # IFS=: 00:08:40.334 02:28:13 -- accel/accel.sh@19 -- # read -r var val 00:08:40.334 02:28:13 -- accel/accel.sh@20 -- # val= 00:08:40.334 02:28:13 -- accel/accel.sh@21 -- # case "$var" in 00:08:40.334 02:28:13 -- accel/accel.sh@19 -- # IFS=: 00:08:40.334 02:28:13 -- accel/accel.sh@19 -- # read -r var val 00:08:40.334 02:28:13 -- accel/accel.sh@20 -- # val= 00:08:40.334 02:28:13 -- accel/accel.sh@21 -- # case "$var" in 00:08:40.334 02:28:13 -- accel/accel.sh@19 -- # IFS=: 00:08:40.334 02:28:13 -- accel/accel.sh@19 -- # read -r var val 00:08:40.334 02:28:13 -- accel/accel.sh@20 -- # val= 00:08:40.334 02:28:13 -- accel/accel.sh@21 -- # case "$var" in 00:08:40.334 02:28:13 -- accel/accel.sh@19 -- # IFS=: 00:08:40.334 02:28:13 -- accel/accel.sh@19 -- # read -r var val 00:08:40.334 02:28:13 -- accel/accel.sh@20 -- # val= 00:08:40.334 02:28:13 -- accel/accel.sh@21 -- # case "$var" in 00:08:40.334 02:28:13 -- accel/accel.sh@19 -- # IFS=: 00:08:40.334 02:28:13 -- accel/accel.sh@19 -- # read -r var val 00:08:40.334 02:28:13 -- accel/accel.sh@27 -- # [[ -n software ]] 00:08:40.334 02:28:13 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:08:40.334 02:28:13 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:40.334 00:08:40.334 real 0m1.410s 00:08:40.334 user 0m4.655s 00:08:40.334 sys 0m0.135s 00:08:40.334 02:28:13 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:40.334 02:28:13 -- common/autotest_common.sh@10 -- # set +x 00:08:40.334 ************************************ 00:08:40.334 END TEST accel_decomp_mcore 00:08:40.334 ************************************ 00:08:40.334 02:28:13 -- accel/accel.sh@120 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:08:40.334 02:28:13 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:08:40.334 02:28:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:40.334 02:28:13 -- common/autotest_common.sh@10 -- # set +x 00:08:40.334 ************************************ 00:08:40.334 START TEST accel_decomp_full_mcore 00:08:40.334 ************************************ 00:08:40.334 02:28:13 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:08:40.334 02:28:13 -- accel/accel.sh@16 -- # local accel_opc 00:08:40.334 02:28:13 -- accel/accel.sh@17 -- # local accel_module 00:08:40.334 02:28:13 -- accel/accel.sh@19 -- # IFS=: 00:08:40.334 02:28:13 -- accel/accel.sh@19 -- # read -r var val 00:08:40.334 02:28:13 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:08:40.334 02:28:13 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:08:40.334 02:28:13 -- accel/accel.sh@12 -- # build_accel_config 00:08:40.334 02:28:13 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:08:40.334 02:28:13 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:08:40.334 02:28:13 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:40.334 02:28:13 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:40.334 02:28:13 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:08:40.334 02:28:13 -- accel/accel.sh@40 -- # local IFS=, 00:08:40.334 02:28:13 -- accel/accel.sh@41 -- # jq -r . 00:08:40.334 [2024-04-27 02:28:13.815727] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:08:40.334 [2024-04-27 02:28:13.815788] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1440002 ] 00:08:40.334 EAL: No free 2048 kB hugepages reported on node 1 00:08:40.334 [2024-04-27 02:28:13.887924] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:40.594 [2024-04-27 02:28:13.974024] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:40.594 [2024-04-27 02:28:13.974111] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:40.594 [2024-04-27 02:28:13.974203] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:40.594 [2024-04-27 02:28:13.974205] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:40.594 02:28:14 -- accel/accel.sh@20 -- # val= 00:08:40.594 02:28:14 -- accel/accel.sh@21 -- # case "$var" in 00:08:40.594 02:28:14 -- accel/accel.sh@19 -- # IFS=: 00:08:40.594 02:28:14 -- accel/accel.sh@19 -- # read -r var val 00:08:40.594 02:28:14 -- accel/accel.sh@20 -- # val= 00:08:40.594 02:28:14 -- accel/accel.sh@21 -- # case "$var" in 00:08:40.594 02:28:14 -- accel/accel.sh@19 -- # IFS=: 00:08:40.594 02:28:14 -- accel/accel.sh@19 -- # read -r var val 00:08:40.594 02:28:14 -- accel/accel.sh@20 -- # val= 00:08:40.594 02:28:14 -- accel/accel.sh@21 -- # case "$var" in 00:08:40.594 02:28:14 -- accel/accel.sh@19 -- # IFS=: 00:08:40.594 02:28:14 -- accel/accel.sh@19 -- # read -r var val 00:08:40.594 02:28:14 -- accel/accel.sh@20 -- # val=0xf 00:08:40.594 02:28:14 -- accel/accel.sh@21 -- # case "$var" in 00:08:40.594 02:28:14 -- accel/accel.sh@19 -- # IFS=: 00:08:40.594 02:28:14 -- accel/accel.sh@19 -- # read -r var val 00:08:40.594 02:28:14 -- accel/accel.sh@20 -- # val= 00:08:40.594 02:28:14 -- accel/accel.sh@21 -- # case "$var" in 00:08:40.594 02:28:14 -- accel/accel.sh@19 -- # IFS=: 00:08:40.594 02:28:14 -- accel/accel.sh@19 -- # read -r var val 00:08:40.594 02:28:14 -- accel/accel.sh@20 -- # val= 00:08:40.594 02:28:14 -- accel/accel.sh@21 -- # case "$var" in 00:08:40.594 02:28:14 -- accel/accel.sh@19 -- # IFS=: 00:08:40.594 02:28:14 -- accel/accel.sh@19 -- # read -r var val 00:08:40.594 02:28:14 -- accel/accel.sh@20 -- # val=decompress 00:08:40.594 02:28:14 -- accel/accel.sh@21 -- # case "$var" in 00:08:40.594 02:28:14 -- accel/accel.sh@23 -- # accel_opc=decompress 00:08:40.594 02:28:14 -- accel/accel.sh@19 -- # IFS=: 00:08:40.594 02:28:14 -- accel/accel.sh@19 -- # read -r var val 00:08:40.594 02:28:14 -- accel/accel.sh@20 -- # val='111250 bytes' 00:08:40.594 02:28:14 -- accel/accel.sh@21 -- # case "$var" in 00:08:40.594 02:28:14 -- accel/accel.sh@19 -- # IFS=: 00:08:40.594 02:28:14 -- accel/accel.sh@19 -- # read -r var val 00:08:40.594 02:28:14 -- accel/accel.sh@20 -- # val= 00:08:40.594 02:28:14 -- accel/accel.sh@21 -- # case "$var" in 00:08:40.594 02:28:14 -- accel/accel.sh@19 -- # IFS=: 00:08:40.594 02:28:14 -- accel/accel.sh@19 -- # read -r var val 00:08:40.594 02:28:14 -- accel/accel.sh@20 -- # val=software 00:08:40.594 02:28:14 -- accel/accel.sh@21 -- # case "$var" in 00:08:40.594 02:28:14 -- accel/accel.sh@22 -- # accel_module=software 00:08:40.594 02:28:14 -- accel/accel.sh@19 -- # IFS=: 00:08:40.594 02:28:14 -- accel/accel.sh@19 -- # read -r var val 00:08:40.594 02:28:14 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:08:40.594 02:28:14 -- accel/accel.sh@21 -- # case "$var" in 00:08:40.594 02:28:14 -- accel/accel.sh@19 -- # IFS=: 00:08:40.594 02:28:14 -- accel/accel.sh@19 -- # read -r var val 00:08:40.594 02:28:14 -- accel/accel.sh@20 -- # val=32 00:08:40.594 02:28:14 -- accel/accel.sh@21 -- # case "$var" in 00:08:40.594 02:28:14 -- accel/accel.sh@19 -- # IFS=: 00:08:40.594 02:28:14 -- accel/accel.sh@19 -- # read -r var val 00:08:40.594 02:28:14 -- accel/accel.sh@20 -- # val=32 00:08:40.594 02:28:14 -- accel/accel.sh@21 -- # case "$var" in 00:08:40.594 02:28:14 -- accel/accel.sh@19 -- # IFS=: 00:08:40.594 02:28:14 -- accel/accel.sh@19 -- # read -r var val 00:08:40.594 02:28:14 -- accel/accel.sh@20 -- # val=1 00:08:40.594 02:28:14 -- accel/accel.sh@21 -- # case "$var" in 00:08:40.594 02:28:14 -- accel/accel.sh@19 -- # IFS=: 00:08:40.594 02:28:14 -- accel/accel.sh@19 -- # read -r var val 00:08:40.594 02:28:14 -- accel/accel.sh@20 -- # val='1 seconds' 00:08:40.594 02:28:14 -- accel/accel.sh@21 -- # case "$var" in 00:08:40.594 02:28:14 -- accel/accel.sh@19 -- # IFS=: 00:08:40.594 02:28:14 -- accel/accel.sh@19 -- # read -r var val 00:08:40.594 02:28:14 -- accel/accel.sh@20 -- # val=Yes 00:08:40.594 02:28:14 -- accel/accel.sh@21 -- # case "$var" in 00:08:40.594 02:28:14 -- accel/accel.sh@19 -- # IFS=: 00:08:40.594 02:28:14 -- accel/accel.sh@19 -- # read -r var val 00:08:40.594 02:28:14 -- accel/accel.sh@20 -- # val= 00:08:40.594 02:28:14 -- accel/accel.sh@21 -- # case "$var" in 00:08:40.594 02:28:14 -- accel/accel.sh@19 -- # IFS=: 00:08:40.594 02:28:14 -- accel/accel.sh@19 -- # read -r var val 00:08:40.594 02:28:14 -- accel/accel.sh@20 -- # val= 00:08:40.594 02:28:14 -- accel/accel.sh@21 -- # case "$var" in 00:08:40.594 02:28:14 -- accel/accel.sh@19 -- # IFS=: 00:08:40.594 02:28:14 -- accel/accel.sh@19 -- # read -r var val 00:08:41.974 02:28:15 -- accel/accel.sh@20 -- # val= 00:08:41.974 02:28:15 -- accel/accel.sh@21 -- # case "$var" in 00:08:41.974 02:28:15 -- accel/accel.sh@19 -- # IFS=: 00:08:41.974 02:28:15 -- accel/accel.sh@19 -- # read -r var val 00:08:41.974 02:28:15 -- accel/accel.sh@20 -- # val= 00:08:41.974 02:28:15 -- accel/accel.sh@21 -- # case "$var" in 00:08:41.974 02:28:15 -- accel/accel.sh@19 -- # IFS=: 00:08:41.974 02:28:15 -- accel/accel.sh@19 -- # read -r var val 00:08:41.974 02:28:15 -- accel/accel.sh@20 -- # val= 00:08:41.974 02:28:15 -- accel/accel.sh@21 -- # case "$var" in 00:08:41.974 02:28:15 -- accel/accel.sh@19 -- # IFS=: 00:08:41.974 02:28:15 -- accel/accel.sh@19 -- # read -r var val 00:08:41.974 02:28:15 -- accel/accel.sh@20 -- # val= 00:08:41.974 02:28:15 -- accel/accel.sh@21 -- # case "$var" in 00:08:41.974 02:28:15 -- accel/accel.sh@19 -- # IFS=: 00:08:41.974 02:28:15 -- accel/accel.sh@19 -- # read -r var val 00:08:41.974 02:28:15 -- accel/accel.sh@20 -- # val= 00:08:41.974 02:28:15 -- accel/accel.sh@21 -- # case "$var" in 00:08:41.974 02:28:15 -- accel/accel.sh@19 -- # IFS=: 00:08:41.974 02:28:15 -- accel/accel.sh@19 -- # read -r var val 00:08:41.974 02:28:15 -- accel/accel.sh@20 -- # val= 00:08:41.974 02:28:15 -- accel/accel.sh@21 -- # case "$var" in 00:08:41.974 02:28:15 -- accel/accel.sh@19 -- # IFS=: 00:08:41.974 02:28:15 -- accel/accel.sh@19 -- # read -r var val 00:08:41.974 02:28:15 -- accel/accel.sh@20 -- # val= 00:08:41.974 02:28:15 -- accel/accel.sh@21 -- # case "$var" in 00:08:41.974 02:28:15 -- accel/accel.sh@19 -- # IFS=: 00:08:41.974 02:28:15 -- accel/accel.sh@19 -- # read -r var val 00:08:41.974 02:28:15 -- accel/accel.sh@20 -- # val= 00:08:41.974 02:28:15 -- accel/accel.sh@21 -- # case "$var" in 00:08:41.974 02:28:15 -- accel/accel.sh@19 -- # IFS=: 00:08:41.974 02:28:15 -- accel/accel.sh@19 -- # read -r var val 00:08:41.974 02:28:15 -- accel/accel.sh@20 -- # val= 00:08:41.974 02:28:15 -- accel/accel.sh@21 -- # case "$var" in 00:08:41.974 02:28:15 -- accel/accel.sh@19 -- # IFS=: 00:08:41.974 02:28:15 -- accel/accel.sh@19 -- # read -r var val 00:08:41.974 02:28:15 -- accel/accel.sh@27 -- # [[ -n software ]] 00:08:41.974 02:28:15 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:08:41.974 02:28:15 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:41.974 00:08:41.974 real 0m1.426s 00:08:41.974 user 0m4.692s 00:08:41.974 sys 0m0.141s 00:08:41.974 02:28:15 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:41.974 02:28:15 -- common/autotest_common.sh@10 -- # set +x 00:08:41.974 ************************************ 00:08:41.974 END TEST accel_decomp_full_mcore 00:08:41.974 ************************************ 00:08:41.974 02:28:15 -- accel/accel.sh@121 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -T 2 00:08:41.974 02:28:15 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:08:41.974 02:28:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:41.974 02:28:15 -- common/autotest_common.sh@10 -- # set +x 00:08:41.974 ************************************ 00:08:41.974 START TEST accel_decomp_mthread 00:08:41.974 ************************************ 00:08:41.974 02:28:15 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -T 2 00:08:41.974 02:28:15 -- accel/accel.sh@16 -- # local accel_opc 00:08:41.974 02:28:15 -- accel/accel.sh@17 -- # local accel_module 00:08:41.974 02:28:15 -- accel/accel.sh@19 -- # IFS=: 00:08:41.974 02:28:15 -- accel/accel.sh@19 -- # read -r var val 00:08:41.974 02:28:15 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -T 2 00:08:41.974 02:28:15 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -T 2 00:08:41.974 02:28:15 -- accel/accel.sh@12 -- # build_accel_config 00:08:41.974 02:28:15 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:08:41.974 02:28:15 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:08:41.974 02:28:15 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:41.974 02:28:15 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:41.974 02:28:15 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:08:41.974 02:28:15 -- accel/accel.sh@40 -- # local IFS=, 00:08:41.974 02:28:15 -- accel/accel.sh@41 -- # jq -r . 00:08:41.974 [2024-04-27 02:28:15.454566] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:08:41.974 [2024-04-27 02:28:15.454627] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1440232 ] 00:08:41.974 EAL: No free 2048 kB hugepages reported on node 1 00:08:41.974 [2024-04-27 02:28:15.527594] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:42.235 [2024-04-27 02:28:15.611734] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:42.235 02:28:15 -- accel/accel.sh@20 -- # val= 00:08:42.235 02:28:15 -- accel/accel.sh@21 -- # case "$var" in 00:08:42.235 02:28:15 -- accel/accel.sh@19 -- # IFS=: 00:08:42.235 02:28:15 -- accel/accel.sh@19 -- # read -r var val 00:08:42.235 02:28:15 -- accel/accel.sh@20 -- # val= 00:08:42.235 02:28:15 -- accel/accel.sh@21 -- # case "$var" in 00:08:42.235 02:28:15 -- accel/accel.sh@19 -- # IFS=: 00:08:42.235 02:28:15 -- accel/accel.sh@19 -- # read -r var val 00:08:42.235 02:28:15 -- accel/accel.sh@20 -- # val= 00:08:42.235 02:28:15 -- accel/accel.sh@21 -- # case "$var" in 00:08:42.235 02:28:15 -- accel/accel.sh@19 -- # IFS=: 00:08:42.235 02:28:15 -- accel/accel.sh@19 -- # read -r var val 00:08:42.235 02:28:15 -- accel/accel.sh@20 -- # val=0x1 00:08:42.235 02:28:15 -- accel/accel.sh@21 -- # case "$var" in 00:08:42.235 02:28:15 -- accel/accel.sh@19 -- # IFS=: 00:08:42.235 02:28:15 -- accel/accel.sh@19 -- # read -r var val 00:08:42.235 02:28:15 -- accel/accel.sh@20 -- # val= 00:08:42.235 02:28:15 -- accel/accel.sh@21 -- # case "$var" in 00:08:42.235 02:28:15 -- accel/accel.sh@19 -- # IFS=: 00:08:42.235 02:28:15 -- accel/accel.sh@19 -- # read -r var val 00:08:42.235 02:28:15 -- accel/accel.sh@20 -- # val= 00:08:42.235 02:28:15 -- accel/accel.sh@21 -- # case "$var" in 00:08:42.235 02:28:15 -- accel/accel.sh@19 -- # IFS=: 00:08:42.235 02:28:15 -- accel/accel.sh@19 -- # read -r var val 00:08:42.235 02:28:15 -- accel/accel.sh@20 -- # val=decompress 00:08:42.235 02:28:15 -- accel/accel.sh@21 -- # case "$var" in 00:08:42.235 02:28:15 -- accel/accel.sh@23 -- # accel_opc=decompress 00:08:42.235 02:28:15 -- accel/accel.sh@19 -- # IFS=: 00:08:42.235 02:28:15 -- accel/accel.sh@19 -- # read -r var val 00:08:42.235 02:28:15 -- accel/accel.sh@20 -- # val='4096 bytes' 00:08:42.235 02:28:15 -- accel/accel.sh@21 -- # case "$var" in 00:08:42.235 02:28:15 -- accel/accel.sh@19 -- # IFS=: 00:08:42.235 02:28:15 -- accel/accel.sh@19 -- # read -r var val 00:08:42.235 02:28:15 -- accel/accel.sh@20 -- # val= 00:08:42.235 02:28:15 -- accel/accel.sh@21 -- # case "$var" in 00:08:42.235 02:28:15 -- accel/accel.sh@19 -- # IFS=: 00:08:42.235 02:28:15 -- accel/accel.sh@19 -- # read -r var val 00:08:42.235 02:28:15 -- accel/accel.sh@20 -- # val=software 00:08:42.235 02:28:15 -- accel/accel.sh@21 -- # case "$var" in 00:08:42.235 02:28:15 -- accel/accel.sh@22 -- # accel_module=software 00:08:42.235 02:28:15 -- accel/accel.sh@19 -- # IFS=: 00:08:42.235 02:28:15 -- accel/accel.sh@19 -- # read -r var val 00:08:42.235 02:28:15 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:08:42.235 02:28:15 -- accel/accel.sh@21 -- # case "$var" in 00:08:42.235 02:28:15 -- accel/accel.sh@19 -- # IFS=: 00:08:42.235 02:28:15 -- accel/accel.sh@19 -- # read -r var val 00:08:42.235 02:28:15 -- accel/accel.sh@20 -- # val=32 00:08:42.235 02:28:15 -- accel/accel.sh@21 -- # case "$var" in 00:08:42.235 02:28:15 -- accel/accel.sh@19 -- # IFS=: 00:08:42.235 02:28:15 -- accel/accel.sh@19 -- # read -r var val 00:08:42.235 02:28:15 -- accel/accel.sh@20 -- # val=32 00:08:42.235 02:28:15 -- accel/accel.sh@21 -- # case "$var" in 00:08:42.235 02:28:15 -- accel/accel.sh@19 -- # IFS=: 00:08:42.235 02:28:15 -- accel/accel.sh@19 -- # read -r var val 00:08:42.235 02:28:15 -- accel/accel.sh@20 -- # val=2 00:08:42.235 02:28:15 -- accel/accel.sh@21 -- # case "$var" in 00:08:42.235 02:28:15 -- accel/accel.sh@19 -- # IFS=: 00:08:42.235 02:28:15 -- accel/accel.sh@19 -- # read -r var val 00:08:42.235 02:28:15 -- accel/accel.sh@20 -- # val='1 seconds' 00:08:42.235 02:28:15 -- accel/accel.sh@21 -- # case "$var" in 00:08:42.235 02:28:15 -- accel/accel.sh@19 -- # IFS=: 00:08:42.235 02:28:15 -- accel/accel.sh@19 -- # read -r var val 00:08:42.235 02:28:15 -- accel/accel.sh@20 -- # val=Yes 00:08:42.235 02:28:15 -- accel/accel.sh@21 -- # case "$var" in 00:08:42.235 02:28:15 -- accel/accel.sh@19 -- # IFS=: 00:08:42.235 02:28:15 -- accel/accel.sh@19 -- # read -r var val 00:08:42.235 02:28:15 -- accel/accel.sh@20 -- # val= 00:08:42.235 02:28:15 -- accel/accel.sh@21 -- # case "$var" in 00:08:42.235 02:28:15 -- accel/accel.sh@19 -- # IFS=: 00:08:42.235 02:28:15 -- accel/accel.sh@19 -- # read -r var val 00:08:42.235 02:28:15 -- accel/accel.sh@20 -- # val= 00:08:42.235 02:28:15 -- accel/accel.sh@21 -- # case "$var" in 00:08:42.235 02:28:15 -- accel/accel.sh@19 -- # IFS=: 00:08:42.235 02:28:15 -- accel/accel.sh@19 -- # read -r var val 00:08:43.615 02:28:16 -- accel/accel.sh@20 -- # val= 00:08:43.615 02:28:16 -- accel/accel.sh@21 -- # case "$var" in 00:08:43.615 02:28:16 -- accel/accel.sh@19 -- # IFS=: 00:08:43.616 02:28:16 -- accel/accel.sh@19 -- # read -r var val 00:08:43.616 02:28:16 -- accel/accel.sh@20 -- # val= 00:08:43.616 02:28:16 -- accel/accel.sh@21 -- # case "$var" in 00:08:43.616 02:28:16 -- accel/accel.sh@19 -- # IFS=: 00:08:43.616 02:28:16 -- accel/accel.sh@19 -- # read -r var val 00:08:43.616 02:28:16 -- accel/accel.sh@20 -- # val= 00:08:43.616 02:28:16 -- accel/accel.sh@21 -- # case "$var" in 00:08:43.616 02:28:16 -- accel/accel.sh@19 -- # IFS=: 00:08:43.616 02:28:16 -- accel/accel.sh@19 -- # read -r var val 00:08:43.616 02:28:16 -- accel/accel.sh@20 -- # val= 00:08:43.616 02:28:16 -- accel/accel.sh@21 -- # case "$var" in 00:08:43.616 02:28:16 -- accel/accel.sh@19 -- # IFS=: 00:08:43.616 02:28:16 -- accel/accel.sh@19 -- # read -r var val 00:08:43.616 02:28:16 -- accel/accel.sh@20 -- # val= 00:08:43.616 02:28:16 -- accel/accel.sh@21 -- # case "$var" in 00:08:43.616 02:28:16 -- accel/accel.sh@19 -- # IFS=: 00:08:43.616 02:28:16 -- accel/accel.sh@19 -- # read -r var val 00:08:43.616 02:28:16 -- accel/accel.sh@20 -- # val= 00:08:43.616 02:28:16 -- accel/accel.sh@21 -- # case "$var" in 00:08:43.616 02:28:16 -- accel/accel.sh@19 -- # IFS=: 00:08:43.616 02:28:16 -- accel/accel.sh@19 -- # read -r var val 00:08:43.616 02:28:16 -- accel/accel.sh@20 -- # val= 00:08:43.616 02:28:16 -- accel/accel.sh@21 -- # case "$var" in 00:08:43.616 02:28:16 -- accel/accel.sh@19 -- # IFS=: 00:08:43.616 02:28:16 -- accel/accel.sh@19 -- # read -r var val 00:08:43.616 02:28:16 -- accel/accel.sh@27 -- # [[ -n software ]] 00:08:43.616 02:28:16 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:08:43.616 02:28:16 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:43.616 00:08:43.616 real 0m1.425s 00:08:43.616 user 0m1.296s 00:08:43.616 sys 0m0.143s 00:08:43.616 02:28:16 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:43.616 02:28:16 -- common/autotest_common.sh@10 -- # set +x 00:08:43.616 ************************************ 00:08:43.616 END TEST accel_decomp_mthread 00:08:43.616 ************************************ 00:08:43.616 02:28:16 -- accel/accel.sh@122 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:08:43.616 02:28:16 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:08:43.616 02:28:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:43.616 02:28:16 -- common/autotest_common.sh@10 -- # set +x 00:08:43.616 ************************************ 00:08:43.616 START TEST accel_deomp_full_mthread 00:08:43.616 ************************************ 00:08:43.616 02:28:17 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:08:43.616 02:28:17 -- accel/accel.sh@16 -- # local accel_opc 00:08:43.616 02:28:17 -- accel/accel.sh@17 -- # local accel_module 00:08:43.616 02:28:17 -- accel/accel.sh@19 -- # IFS=: 00:08:43.616 02:28:17 -- accel/accel.sh@19 -- # read -r var val 00:08:43.616 02:28:17 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:08:43.616 02:28:17 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:08:43.616 02:28:17 -- accel/accel.sh@12 -- # build_accel_config 00:08:43.616 02:28:17 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:08:43.616 02:28:17 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:08:43.616 02:28:17 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:43.616 02:28:17 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:43.616 02:28:17 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:08:43.616 02:28:17 -- accel/accel.sh@40 -- # local IFS=, 00:08:43.616 02:28:17 -- accel/accel.sh@41 -- # jq -r . 00:08:43.616 [2024-04-27 02:28:17.052961] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:08:43.616 [2024-04-27 02:28:17.053035] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1440531 ] 00:08:43.616 EAL: No free 2048 kB hugepages reported on node 1 00:08:43.616 [2024-04-27 02:28:17.126577] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:43.616 [2024-04-27 02:28:17.210050] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:43.876 02:28:17 -- accel/accel.sh@20 -- # val= 00:08:43.876 02:28:17 -- accel/accel.sh@21 -- # case "$var" in 00:08:43.876 02:28:17 -- accel/accel.sh@19 -- # IFS=: 00:08:43.876 02:28:17 -- accel/accel.sh@19 -- # read -r var val 00:08:43.876 02:28:17 -- accel/accel.sh@20 -- # val= 00:08:43.876 02:28:17 -- accel/accel.sh@21 -- # case "$var" in 00:08:43.876 02:28:17 -- accel/accel.sh@19 -- # IFS=: 00:08:43.876 02:28:17 -- accel/accel.sh@19 -- # read -r var val 00:08:43.876 02:28:17 -- accel/accel.sh@20 -- # val= 00:08:43.876 02:28:17 -- accel/accel.sh@21 -- # case "$var" in 00:08:43.876 02:28:17 -- accel/accel.sh@19 -- # IFS=: 00:08:43.876 02:28:17 -- accel/accel.sh@19 -- # read -r var val 00:08:43.876 02:28:17 -- accel/accel.sh@20 -- # val=0x1 00:08:43.876 02:28:17 -- accel/accel.sh@21 -- # case "$var" in 00:08:43.876 02:28:17 -- accel/accel.sh@19 -- # IFS=: 00:08:43.876 02:28:17 -- accel/accel.sh@19 -- # read -r var val 00:08:43.876 02:28:17 -- accel/accel.sh@20 -- # val= 00:08:43.876 02:28:17 -- accel/accel.sh@21 -- # case "$var" in 00:08:43.876 02:28:17 -- accel/accel.sh@19 -- # IFS=: 00:08:43.876 02:28:17 -- accel/accel.sh@19 -- # read -r var val 00:08:43.876 02:28:17 -- accel/accel.sh@20 -- # val= 00:08:43.876 02:28:17 -- accel/accel.sh@21 -- # case "$var" in 00:08:43.876 02:28:17 -- accel/accel.sh@19 -- # IFS=: 00:08:43.876 02:28:17 -- accel/accel.sh@19 -- # read -r var val 00:08:43.876 02:28:17 -- accel/accel.sh@20 -- # val=decompress 00:08:43.876 02:28:17 -- accel/accel.sh@21 -- # case "$var" in 00:08:43.876 02:28:17 -- accel/accel.sh@23 -- # accel_opc=decompress 00:08:43.876 02:28:17 -- accel/accel.sh@19 -- # IFS=: 00:08:43.876 02:28:17 -- accel/accel.sh@19 -- # read -r var val 00:08:43.876 02:28:17 -- accel/accel.sh@20 -- # val='111250 bytes' 00:08:43.876 02:28:17 -- accel/accel.sh@21 -- # case "$var" in 00:08:43.876 02:28:17 -- accel/accel.sh@19 -- # IFS=: 00:08:43.876 02:28:17 -- accel/accel.sh@19 -- # read -r var val 00:08:43.876 02:28:17 -- accel/accel.sh@20 -- # val= 00:08:43.876 02:28:17 -- accel/accel.sh@21 -- # case "$var" in 00:08:43.876 02:28:17 -- accel/accel.sh@19 -- # IFS=: 00:08:43.876 02:28:17 -- accel/accel.sh@19 -- # read -r var val 00:08:43.876 02:28:17 -- accel/accel.sh@20 -- # val=software 00:08:43.876 02:28:17 -- accel/accel.sh@21 -- # case "$var" in 00:08:43.876 02:28:17 -- accel/accel.sh@22 -- # accel_module=software 00:08:43.876 02:28:17 -- accel/accel.sh@19 -- # IFS=: 00:08:43.876 02:28:17 -- accel/accel.sh@19 -- # read -r var val 00:08:43.876 02:28:17 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:08:43.876 02:28:17 -- accel/accel.sh@21 -- # case "$var" in 00:08:43.876 02:28:17 -- accel/accel.sh@19 -- # IFS=: 00:08:43.876 02:28:17 -- accel/accel.sh@19 -- # read -r var val 00:08:43.876 02:28:17 -- accel/accel.sh@20 -- # val=32 00:08:43.876 02:28:17 -- accel/accel.sh@21 -- # case "$var" in 00:08:43.876 02:28:17 -- accel/accel.sh@19 -- # IFS=: 00:08:43.876 02:28:17 -- accel/accel.sh@19 -- # read -r var val 00:08:43.876 02:28:17 -- accel/accel.sh@20 -- # val=32 00:08:43.876 02:28:17 -- accel/accel.sh@21 -- # case "$var" in 00:08:43.876 02:28:17 -- accel/accel.sh@19 -- # IFS=: 00:08:43.876 02:28:17 -- accel/accel.sh@19 -- # read -r var val 00:08:43.876 02:28:17 -- accel/accel.sh@20 -- # val=2 00:08:43.876 02:28:17 -- accel/accel.sh@21 -- # case "$var" in 00:08:43.876 02:28:17 -- accel/accel.sh@19 -- # IFS=: 00:08:43.876 02:28:17 -- accel/accel.sh@19 -- # read -r var val 00:08:43.876 02:28:17 -- accel/accel.sh@20 -- # val='1 seconds' 00:08:43.876 02:28:17 -- accel/accel.sh@21 -- # case "$var" in 00:08:43.876 02:28:17 -- accel/accel.sh@19 -- # IFS=: 00:08:43.876 02:28:17 -- accel/accel.sh@19 -- # read -r var val 00:08:43.876 02:28:17 -- accel/accel.sh@20 -- # val=Yes 00:08:43.876 02:28:17 -- accel/accel.sh@21 -- # case "$var" in 00:08:43.876 02:28:17 -- accel/accel.sh@19 -- # IFS=: 00:08:43.876 02:28:17 -- accel/accel.sh@19 -- # read -r var val 00:08:43.876 02:28:17 -- accel/accel.sh@20 -- # val= 00:08:43.876 02:28:17 -- accel/accel.sh@21 -- # case "$var" in 00:08:43.876 02:28:17 -- accel/accel.sh@19 -- # IFS=: 00:08:43.876 02:28:17 -- accel/accel.sh@19 -- # read -r var val 00:08:43.876 02:28:17 -- accel/accel.sh@20 -- # val= 00:08:43.876 02:28:17 -- accel/accel.sh@21 -- # case "$var" in 00:08:43.876 02:28:17 -- accel/accel.sh@19 -- # IFS=: 00:08:43.876 02:28:17 -- accel/accel.sh@19 -- # read -r var val 00:08:45.257 02:28:18 -- accel/accel.sh@20 -- # val= 00:08:45.257 02:28:18 -- accel/accel.sh@21 -- # case "$var" in 00:08:45.257 02:28:18 -- accel/accel.sh@19 -- # IFS=: 00:08:45.257 02:28:18 -- accel/accel.sh@19 -- # read -r var val 00:08:45.257 02:28:18 -- accel/accel.sh@20 -- # val= 00:08:45.257 02:28:18 -- accel/accel.sh@21 -- # case "$var" in 00:08:45.257 02:28:18 -- accel/accel.sh@19 -- # IFS=: 00:08:45.257 02:28:18 -- accel/accel.sh@19 -- # read -r var val 00:08:45.257 02:28:18 -- accel/accel.sh@20 -- # val= 00:08:45.257 02:28:18 -- accel/accel.sh@21 -- # case "$var" in 00:08:45.257 02:28:18 -- accel/accel.sh@19 -- # IFS=: 00:08:45.257 02:28:18 -- accel/accel.sh@19 -- # read -r var val 00:08:45.257 02:28:18 -- accel/accel.sh@20 -- # val= 00:08:45.257 02:28:18 -- accel/accel.sh@21 -- # case "$var" in 00:08:45.257 02:28:18 -- accel/accel.sh@19 -- # IFS=: 00:08:45.257 02:28:18 -- accel/accel.sh@19 -- # read -r var val 00:08:45.257 02:28:18 -- accel/accel.sh@20 -- # val= 00:08:45.257 02:28:18 -- accel/accel.sh@21 -- # case "$var" in 00:08:45.257 02:28:18 -- accel/accel.sh@19 -- # IFS=: 00:08:45.257 02:28:18 -- accel/accel.sh@19 -- # read -r var val 00:08:45.257 02:28:18 -- accel/accel.sh@20 -- # val= 00:08:45.257 02:28:18 -- accel/accel.sh@21 -- # case "$var" in 00:08:45.257 02:28:18 -- accel/accel.sh@19 -- # IFS=: 00:08:45.257 02:28:18 -- accel/accel.sh@19 -- # read -r var val 00:08:45.257 02:28:18 -- accel/accel.sh@20 -- # val= 00:08:45.257 02:28:18 -- accel/accel.sh@21 -- # case "$var" in 00:08:45.257 02:28:18 -- accel/accel.sh@19 -- # IFS=: 00:08:45.257 02:28:18 -- accel/accel.sh@19 -- # read -r var val 00:08:45.257 02:28:18 -- accel/accel.sh@27 -- # [[ -n software ]] 00:08:45.257 02:28:18 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:08:45.257 02:28:18 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:45.257 00:08:45.257 real 0m1.440s 00:08:45.257 user 0m1.295s 00:08:45.257 sys 0m0.158s 00:08:45.257 02:28:18 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:45.257 02:28:18 -- common/autotest_common.sh@10 -- # set +x 00:08:45.257 ************************************ 00:08:45.257 END TEST accel_deomp_full_mthread 00:08:45.257 ************************************ 00:08:45.257 02:28:18 -- accel/accel.sh@124 -- # [[ n == y ]] 00:08:45.257 02:28:18 -- accel/accel.sh@137 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:08:45.257 02:28:18 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:45.257 02:28:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:45.257 02:28:18 -- common/autotest_common.sh@10 -- # set +x 00:08:45.257 02:28:18 -- accel/accel.sh@137 -- # build_accel_config 00:08:45.257 02:28:18 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:08:45.257 02:28:18 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:08:45.257 02:28:18 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:45.257 02:28:18 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:45.257 02:28:18 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:08:45.257 02:28:18 -- accel/accel.sh@40 -- # local IFS=, 00:08:45.257 02:28:18 -- accel/accel.sh@41 -- # jq -r . 00:08:45.257 ************************************ 00:08:45.257 START TEST accel_dif_functional_tests 00:08:45.257 ************************************ 00:08:45.257 02:28:18 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:08:45.257 [2024-04-27 02:28:18.687243] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:08:45.257 [2024-04-27 02:28:18.687284] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1440807 ] 00:08:45.257 EAL: No free 2048 kB hugepages reported on node 1 00:08:45.257 [2024-04-27 02:28:18.754900] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:08:45.257 [2024-04-27 02:28:18.834677] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:45.257 [2024-04-27 02:28:18.834766] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:45.257 [2024-04-27 02:28:18.834769] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:45.516 00:08:45.516 00:08:45.516 CUnit - A unit testing framework for C - Version 2.1-3 00:08:45.516 http://cunit.sourceforge.net/ 00:08:45.516 00:08:45.516 00:08:45.516 Suite: accel_dif 00:08:45.516 Test: verify: DIF generated, GUARD check ...passed 00:08:45.516 Test: verify: DIF generated, APPTAG check ...passed 00:08:45.516 Test: verify: DIF generated, REFTAG check ...passed 00:08:45.516 Test: verify: DIF not generated, GUARD check ...[2024-04-27 02:28:18.914081] dif.c: 826:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:08:45.516 [2024-04-27 02:28:18.914133] dif.c: 826:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:08:45.516 passed 00:08:45.516 Test: verify: DIF not generated, APPTAG check ...[2024-04-27 02:28:18.914180] dif.c: 841:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:08:45.516 [2024-04-27 02:28:18.914197] dif.c: 841:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:08:45.516 passed 00:08:45.516 Test: verify: DIF not generated, REFTAG check ...[2024-04-27 02:28:18.914216] dif.c: 776:_dif_reftag_check: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:08:45.516 [2024-04-27 02:28:18.914234] dif.c: 776:_dif_reftag_check: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:08:45.516 passed 00:08:45.517 Test: verify: APPTAG correct, APPTAG check ...passed 00:08:45.517 Test: verify: APPTAG incorrect, APPTAG check ...[2024-04-27 02:28:18.914280] dif.c: 841:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:08:45.517 passed 00:08:45.517 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:08:45.517 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:08:45.517 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:08:45.517 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-04-27 02:28:18.914391] dif.c: 776:_dif_reftag_check: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:08:45.517 passed 00:08:45.517 Test: generate copy: DIF generated, GUARD check ...passed 00:08:45.517 Test: generate copy: DIF generated, APTTAG check ...passed 00:08:45.517 Test: generate copy: DIF generated, REFTAG check ...passed 00:08:45.517 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:08:45.517 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:08:45.517 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:08:45.517 Test: generate copy: iovecs-len validate ...[2024-04-27 02:28:18.914566] dif.c:1190:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:08:45.517 passed 00:08:45.517 Test: generate copy: buffer alignment validate ...passed 00:08:45.517 00:08:45.517 Run Summary: Type Total Ran Passed Failed Inactive 00:08:45.517 suites 1 1 n/a 0 0 00:08:45.517 tests 20 20 20 0 0 00:08:45.517 asserts 204 204 204 0 n/a 00:08:45.517 00:08:45.517 Elapsed time = 0.002 seconds 00:08:45.517 00:08:45.517 real 0m0.486s 00:08:45.517 user 0m0.700s 00:08:45.517 sys 0m0.154s 00:08:45.517 02:28:19 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:45.517 02:28:19 -- common/autotest_common.sh@10 -- # set +x 00:08:45.517 ************************************ 00:08:45.517 END TEST accel_dif_functional_tests 00:08:45.517 ************************************ 00:08:45.776 00:08:45.776 real 0m35.632s 00:08:45.776 user 0m36.641s 00:08:45.776 sys 0m6.395s 00:08:45.776 02:28:19 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:45.776 02:28:19 -- common/autotest_common.sh@10 -- # set +x 00:08:45.776 ************************************ 00:08:45.776 END TEST accel 00:08:45.776 ************************************ 00:08:45.776 02:28:19 -- spdk/autotest.sh@180 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/accel_rpc.sh 00:08:45.776 02:28:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:08:45.776 02:28:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:45.776 02:28:19 -- common/autotest_common.sh@10 -- # set +x 00:08:45.776 ************************************ 00:08:45.776 START TEST accel_rpc 00:08:45.776 ************************************ 00:08:45.776 02:28:19 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/accel_rpc.sh 00:08:46.036 * Looking for test storage... 00:08:46.036 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel 00:08:46.036 02:28:19 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:08:46.036 02:28:19 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=1440882 00:08:46.036 02:28:19 -- accel/accel_rpc.sh@15 -- # waitforlisten 1440882 00:08:46.036 02:28:19 -- common/autotest_common.sh@817 -- # '[' -z 1440882 ']' 00:08:46.036 02:28:19 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:46.036 02:28:19 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:08:46.036 02:28:19 -- common/autotest_common.sh@822 -- # local max_retries=100 00:08:46.036 02:28:19 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:46.036 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:46.036 02:28:19 -- common/autotest_common.sh@826 -- # xtrace_disable 00:08:46.036 02:28:19 -- common/autotest_common.sh@10 -- # set +x 00:08:46.036 [2024-04-27 02:28:19.530399] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:08:46.036 [2024-04-27 02:28:19.530456] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1440882 ] 00:08:46.036 EAL: No free 2048 kB hugepages reported on node 1 00:08:46.036 [2024-04-27 02:28:19.604168] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:46.295 [2024-04-27 02:28:19.690504] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:46.864 02:28:20 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:08:46.864 02:28:20 -- common/autotest_common.sh@850 -- # return 0 00:08:46.864 02:28:20 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:08:46.864 02:28:20 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:08:46.864 02:28:20 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:08:46.864 02:28:20 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:08:46.864 02:28:20 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:08:46.864 02:28:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:08:46.864 02:28:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:46.864 02:28:20 -- common/autotest_common.sh@10 -- # set +x 00:08:47.124 ************************************ 00:08:47.124 START TEST accel_assign_opcode 00:08:47.124 ************************************ 00:08:47.124 02:28:20 -- common/autotest_common.sh@1111 -- # accel_assign_opcode_test_suite 00:08:47.124 02:28:20 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:08:47.124 02:28:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:47.124 02:28:20 -- common/autotest_common.sh@10 -- # set +x 00:08:47.124 [2024-04-27 02:28:20.492849] accel_rpc.c: 167:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:08:47.124 02:28:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:47.124 02:28:20 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:08:47.124 02:28:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:47.124 02:28:20 -- common/autotest_common.sh@10 -- # set +x 00:08:47.124 [2024-04-27 02:28:20.500860] accel_rpc.c: 167:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:08:47.124 02:28:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:47.124 02:28:20 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:08:47.124 02:28:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:47.124 02:28:20 -- common/autotest_common.sh@10 -- # set +x 00:08:47.124 02:28:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:47.124 02:28:20 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:08:47.124 02:28:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:47.124 02:28:20 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:08:47.124 02:28:20 -- common/autotest_common.sh@10 -- # set +x 00:08:47.124 02:28:20 -- accel/accel_rpc.sh@42 -- # grep software 00:08:47.124 02:28:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:47.124 software 00:08:47.124 00:08:47.124 real 0m0.258s 00:08:47.124 user 0m0.047s 00:08:47.124 sys 0m0.014s 00:08:47.124 02:28:20 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:47.384 02:28:20 -- common/autotest_common.sh@10 -- # set +x 00:08:47.384 ************************************ 00:08:47.384 END TEST accel_assign_opcode 00:08:47.384 ************************************ 00:08:47.384 02:28:20 -- accel/accel_rpc.sh@55 -- # killprocess 1440882 00:08:47.384 02:28:20 -- common/autotest_common.sh@936 -- # '[' -z 1440882 ']' 00:08:47.384 02:28:20 -- common/autotest_common.sh@940 -- # kill -0 1440882 00:08:47.384 02:28:20 -- common/autotest_common.sh@941 -- # uname 00:08:47.384 02:28:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:47.384 02:28:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1440882 00:08:47.384 02:28:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:47.384 02:28:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:47.384 02:28:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1440882' 00:08:47.384 killing process with pid 1440882 00:08:47.384 02:28:20 -- common/autotest_common.sh@955 -- # kill 1440882 00:08:47.384 02:28:20 -- common/autotest_common.sh@960 -- # wait 1440882 00:08:47.643 00:08:47.643 real 0m1.831s 00:08:47.643 user 0m1.902s 00:08:47.643 sys 0m0.543s 00:08:47.643 02:28:21 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:47.643 02:28:21 -- common/autotest_common.sh@10 -- # set +x 00:08:47.643 ************************************ 00:08:47.643 END TEST accel_rpc 00:08:47.643 ************************************ 00:08:47.643 02:28:21 -- spdk/autotest.sh@181 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/cmdline.sh 00:08:47.643 02:28:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:08:47.643 02:28:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:47.643 02:28:21 -- common/autotest_common.sh@10 -- # set +x 00:08:47.904 ************************************ 00:08:47.904 START TEST app_cmdline 00:08:47.904 ************************************ 00:08:47.904 02:28:21 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/cmdline.sh 00:08:47.904 * Looking for test storage... 00:08:47.904 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app 00:08:47.904 02:28:21 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:08:47.904 02:28:21 -- app/cmdline.sh@17 -- # spdk_tgt_pid=1441327 00:08:47.904 02:28:21 -- app/cmdline.sh@18 -- # waitforlisten 1441327 00:08:47.904 02:28:21 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:08:47.904 02:28:21 -- common/autotest_common.sh@817 -- # '[' -z 1441327 ']' 00:08:47.904 02:28:21 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:47.904 02:28:21 -- common/autotest_common.sh@822 -- # local max_retries=100 00:08:47.904 02:28:21 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:47.904 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:47.904 02:28:21 -- common/autotest_common.sh@826 -- # xtrace_disable 00:08:47.904 02:28:21 -- common/autotest_common.sh@10 -- # set +x 00:08:48.163 [2024-04-27 02:28:21.540825] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:08:48.163 [2024-04-27 02:28:21.540889] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1441327 ] 00:08:48.163 EAL: No free 2048 kB hugepages reported on node 1 00:08:48.163 [2024-04-27 02:28:21.613679] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:48.163 [2024-04-27 02:28:21.692665] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:48.768 02:28:22 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:08:48.768 02:28:22 -- common/autotest_common.sh@850 -- # return 0 00:08:48.768 02:28:22 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:08:49.027 { 00:08:49.027 "version": "SPDK v24.05-pre git sha1 6651b13f7", 00:08:49.027 "fields": { 00:08:49.027 "major": 24, 00:08:49.027 "minor": 5, 00:08:49.027 "patch": 0, 00:08:49.027 "suffix": "-pre", 00:08:49.027 "commit": "6651b13f7" 00:08:49.027 } 00:08:49.027 } 00:08:49.027 02:28:22 -- app/cmdline.sh@22 -- # expected_methods=() 00:08:49.027 02:28:22 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:08:49.027 02:28:22 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:08:49.027 02:28:22 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:08:49.027 02:28:22 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:08:49.027 02:28:22 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:08:49.027 02:28:22 -- app/cmdline.sh@26 -- # sort 00:08:49.027 02:28:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:49.027 02:28:22 -- common/autotest_common.sh@10 -- # set +x 00:08:49.027 02:28:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:49.027 02:28:22 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:08:49.027 02:28:22 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:08:49.027 02:28:22 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:08:49.027 02:28:22 -- common/autotest_common.sh@638 -- # local es=0 00:08:49.027 02:28:22 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:08:49.027 02:28:22 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:08:49.027 02:28:22 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:08:49.027 02:28:22 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:08:49.027 02:28:22 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:08:49.027 02:28:22 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:08:49.027 02:28:22 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:08:49.027 02:28:22 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:08:49.027 02:28:22 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py ]] 00:08:49.028 02:28:22 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:08:49.288 request: 00:08:49.288 { 00:08:49.288 "method": "env_dpdk_get_mem_stats", 00:08:49.288 "req_id": 1 00:08:49.288 } 00:08:49.288 Got JSON-RPC error response 00:08:49.288 response: 00:08:49.288 { 00:08:49.288 "code": -32601, 00:08:49.288 "message": "Method not found" 00:08:49.288 } 00:08:49.288 02:28:22 -- common/autotest_common.sh@641 -- # es=1 00:08:49.288 02:28:22 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:08:49.288 02:28:22 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:08:49.288 02:28:22 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:08:49.288 02:28:22 -- app/cmdline.sh@1 -- # killprocess 1441327 00:08:49.288 02:28:22 -- common/autotest_common.sh@936 -- # '[' -z 1441327 ']' 00:08:49.288 02:28:22 -- common/autotest_common.sh@940 -- # kill -0 1441327 00:08:49.288 02:28:22 -- common/autotest_common.sh@941 -- # uname 00:08:49.288 02:28:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:49.288 02:28:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1441327 00:08:49.288 02:28:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:49.288 02:28:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:49.288 02:28:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1441327' 00:08:49.288 killing process with pid 1441327 00:08:49.288 02:28:22 -- common/autotest_common.sh@955 -- # kill 1441327 00:08:49.288 02:28:22 -- common/autotest_common.sh@960 -- # wait 1441327 00:08:49.547 00:08:49.547 real 0m1.773s 00:08:49.547 user 0m2.038s 00:08:49.547 sys 0m0.501s 00:08:49.547 02:28:23 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:49.547 02:28:23 -- common/autotest_common.sh@10 -- # set +x 00:08:49.547 ************************************ 00:08:49.547 END TEST app_cmdline 00:08:49.547 ************************************ 00:08:49.806 02:28:23 -- spdk/autotest.sh@182 -- # run_test version /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/version.sh 00:08:49.806 02:28:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:08:49.806 02:28:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:49.806 02:28:23 -- common/autotest_common.sh@10 -- # set +x 00:08:49.806 ************************************ 00:08:49.806 START TEST version 00:08:49.806 ************************************ 00:08:49.806 02:28:23 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/version.sh 00:08:50.065 * Looking for test storage... 00:08:50.065 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app 00:08:50.065 02:28:23 -- app/version.sh@17 -- # get_header_version major 00:08:50.065 02:28:23 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-phy-autotest/spdk/include/spdk/version.h 00:08:50.065 02:28:23 -- app/version.sh@14 -- # cut -f2 00:08:50.065 02:28:23 -- app/version.sh@14 -- # tr -d '"' 00:08:50.065 02:28:23 -- app/version.sh@17 -- # major=24 00:08:50.065 02:28:23 -- app/version.sh@18 -- # get_header_version minor 00:08:50.065 02:28:23 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-phy-autotest/spdk/include/spdk/version.h 00:08:50.065 02:28:23 -- app/version.sh@14 -- # cut -f2 00:08:50.065 02:28:23 -- app/version.sh@14 -- # tr -d '"' 00:08:50.065 02:28:23 -- app/version.sh@18 -- # minor=5 00:08:50.065 02:28:23 -- app/version.sh@19 -- # get_header_version patch 00:08:50.065 02:28:23 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-phy-autotest/spdk/include/spdk/version.h 00:08:50.065 02:28:23 -- app/version.sh@14 -- # cut -f2 00:08:50.065 02:28:23 -- app/version.sh@14 -- # tr -d '"' 00:08:50.065 02:28:23 -- app/version.sh@19 -- # patch=0 00:08:50.065 02:28:23 -- app/version.sh@20 -- # get_header_version suffix 00:08:50.065 02:28:23 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-phy-autotest/spdk/include/spdk/version.h 00:08:50.065 02:28:23 -- app/version.sh@14 -- # cut -f2 00:08:50.065 02:28:23 -- app/version.sh@14 -- # tr -d '"' 00:08:50.065 02:28:23 -- app/version.sh@20 -- # suffix=-pre 00:08:50.065 02:28:23 -- app/version.sh@22 -- # version=24.5 00:08:50.065 02:28:23 -- app/version.sh@25 -- # (( patch != 0 )) 00:08:50.065 02:28:23 -- app/version.sh@28 -- # version=24.5rc0 00:08:50.065 02:28:23 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python 00:08:50.065 02:28:23 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:08:50.065 02:28:23 -- app/version.sh@30 -- # py_version=24.5rc0 00:08:50.065 02:28:23 -- app/version.sh@31 -- # [[ 24.5rc0 == \2\4\.\5\r\c\0 ]] 00:08:50.065 00:08:50.065 real 0m0.196s 00:08:50.065 user 0m0.106s 00:08:50.065 sys 0m0.139s 00:08:50.065 02:28:23 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:50.065 02:28:23 -- common/autotest_common.sh@10 -- # set +x 00:08:50.065 ************************************ 00:08:50.065 END TEST version 00:08:50.065 ************************************ 00:08:50.065 02:28:23 -- spdk/autotest.sh@184 -- # '[' 0 -eq 1 ']' 00:08:50.065 02:28:23 -- spdk/autotest.sh@194 -- # uname -s 00:08:50.065 02:28:23 -- spdk/autotest.sh@194 -- # [[ Linux == Linux ]] 00:08:50.065 02:28:23 -- spdk/autotest.sh@195 -- # [[ 0 -eq 1 ]] 00:08:50.065 02:28:23 -- spdk/autotest.sh@195 -- # [[ 0 -eq 1 ]] 00:08:50.065 02:28:23 -- spdk/autotest.sh@207 -- # '[' 0 -eq 1 ']' 00:08:50.065 02:28:23 -- spdk/autotest.sh@254 -- # '[' 0 -eq 1 ']' 00:08:50.065 02:28:23 -- spdk/autotest.sh@258 -- # timing_exit lib 00:08:50.065 02:28:23 -- common/autotest_common.sh@716 -- # xtrace_disable 00:08:50.065 02:28:23 -- common/autotest_common.sh@10 -- # set +x 00:08:50.065 02:28:23 -- spdk/autotest.sh@260 -- # '[' 0 -eq 1 ']' 00:08:50.065 02:28:23 -- spdk/autotest.sh@268 -- # '[' 0 -eq 1 ']' 00:08:50.065 02:28:23 -- spdk/autotest.sh@277 -- # '[' 1 -eq 1 ']' 00:08:50.065 02:28:23 -- spdk/autotest.sh@278 -- # export NET_TYPE 00:08:50.065 02:28:23 -- spdk/autotest.sh@281 -- # '[' rdma = rdma ']' 00:08:50.065 02:28:23 -- spdk/autotest.sh@282 -- # run_test nvmf_rdma /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=rdma 00:08:50.065 02:28:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:50.065 02:28:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:50.065 02:28:23 -- common/autotest_common.sh@10 -- # set +x 00:08:50.325 ************************************ 00:08:50.325 START TEST nvmf_rdma 00:08:50.325 ************************************ 00:08:50.325 02:28:23 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=rdma 00:08:50.325 * Looking for test storage... 00:08:50.584 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf 00:08:50.584 02:28:23 -- nvmf/nvmf.sh@10 -- # uname -s 00:08:50.584 02:28:23 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:08:50.584 02:28:23 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:08:50.584 02:28:23 -- nvmf/common.sh@7 -- # uname -s 00:08:50.584 02:28:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:50.584 02:28:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:50.584 02:28:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:50.584 02:28:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:50.584 02:28:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:50.584 02:28:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:50.584 02:28:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:50.584 02:28:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:50.584 02:28:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:50.584 02:28:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:50.584 02:28:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:08:50.584 02:28:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:08:50.584 02:28:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:50.584 02:28:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:50.584 02:28:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:50.584 02:28:23 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:50.584 02:28:23 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:08:50.585 02:28:23 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:50.585 02:28:23 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:50.585 02:28:23 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:50.585 02:28:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:50.585 02:28:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:50.585 02:28:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:50.585 02:28:23 -- paths/export.sh@5 -- # export PATH 00:08:50.585 02:28:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:50.585 02:28:23 -- nvmf/common.sh@47 -- # : 0 00:08:50.585 02:28:23 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:08:50.585 02:28:23 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:08:50.585 02:28:23 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:50.585 02:28:23 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:50.585 02:28:23 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:50.585 02:28:23 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:08:50.585 02:28:23 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:08:50.585 02:28:23 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:08:50.585 02:28:23 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:08:50.585 02:28:23 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:08:50.585 02:28:23 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:08:50.585 02:28:23 -- common/autotest_common.sh@710 -- # xtrace_disable 00:08:50.585 02:28:23 -- common/autotest_common.sh@10 -- # set +x 00:08:50.585 02:28:23 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:08:50.585 02:28:23 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=rdma 00:08:50.585 02:28:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:50.585 02:28:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:50.585 02:28:23 -- common/autotest_common.sh@10 -- # set +x 00:08:50.585 ************************************ 00:08:50.585 START TEST nvmf_example 00:08:50.585 ************************************ 00:08:50.585 02:28:24 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=rdma 00:08:50.845 * Looking for test storage... 00:08:50.845 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:08:50.845 02:28:24 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:08:50.845 02:28:24 -- nvmf/common.sh@7 -- # uname -s 00:08:50.845 02:28:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:50.845 02:28:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:50.845 02:28:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:50.845 02:28:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:50.845 02:28:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:50.845 02:28:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:50.845 02:28:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:50.845 02:28:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:50.845 02:28:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:50.845 02:28:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:50.845 02:28:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:08:50.845 02:28:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:08:50.845 02:28:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:50.845 02:28:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:50.845 02:28:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:50.845 02:28:24 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:50.845 02:28:24 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:08:50.845 02:28:24 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:50.845 02:28:24 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:50.845 02:28:24 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:50.845 02:28:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:50.845 02:28:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:50.845 02:28:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:50.845 02:28:24 -- paths/export.sh@5 -- # export PATH 00:08:50.845 02:28:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:50.845 02:28:24 -- nvmf/common.sh@47 -- # : 0 00:08:50.845 02:28:24 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:08:50.845 02:28:24 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:08:50.845 02:28:24 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:50.845 02:28:24 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:50.845 02:28:24 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:50.845 02:28:24 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:08:50.845 02:28:24 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:08:50.845 02:28:24 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:08:50.845 02:28:24 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:08:50.845 02:28:24 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:08:50.845 02:28:24 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:08:50.845 02:28:24 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:08:50.845 02:28:24 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:08:50.845 02:28:24 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:08:50.845 02:28:24 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:08:50.845 02:28:24 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:08:50.845 02:28:24 -- common/autotest_common.sh@710 -- # xtrace_disable 00:08:50.845 02:28:24 -- common/autotest_common.sh@10 -- # set +x 00:08:50.845 02:28:24 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:08:50.845 02:28:24 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:08:50.845 02:28:24 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:50.845 02:28:24 -- nvmf/common.sh@437 -- # prepare_net_devs 00:08:50.845 02:28:24 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:08:50.845 02:28:24 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:08:50.845 02:28:24 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:50.845 02:28:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:50.845 02:28:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:50.845 02:28:24 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:08:50.845 02:28:24 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:08:50.845 02:28:24 -- nvmf/common.sh@285 -- # xtrace_disable 00:08:50.845 02:28:24 -- common/autotest_common.sh@10 -- # set +x 00:08:57.418 02:28:29 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:57.418 02:28:29 -- nvmf/common.sh@291 -- # pci_devs=() 00:08:57.418 02:28:29 -- nvmf/common.sh@291 -- # local -a pci_devs 00:08:57.418 02:28:29 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:08:57.418 02:28:29 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:08:57.418 02:28:29 -- nvmf/common.sh@293 -- # pci_drivers=() 00:08:57.418 02:28:29 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:08:57.418 02:28:29 -- nvmf/common.sh@295 -- # net_devs=() 00:08:57.418 02:28:29 -- nvmf/common.sh@295 -- # local -ga net_devs 00:08:57.418 02:28:29 -- nvmf/common.sh@296 -- # e810=() 00:08:57.418 02:28:29 -- nvmf/common.sh@296 -- # local -ga e810 00:08:57.418 02:28:29 -- nvmf/common.sh@297 -- # x722=() 00:08:57.418 02:28:29 -- nvmf/common.sh@297 -- # local -ga x722 00:08:57.418 02:28:29 -- nvmf/common.sh@298 -- # mlx=() 00:08:57.418 02:28:29 -- nvmf/common.sh@298 -- # local -ga mlx 00:08:57.418 02:28:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:57.418 02:28:29 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:57.418 02:28:29 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:57.418 02:28:29 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:57.418 02:28:29 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:57.418 02:28:29 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:57.418 02:28:29 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:57.418 02:28:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:57.418 02:28:29 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:57.418 02:28:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:57.418 02:28:29 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:57.418 02:28:29 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:08:57.418 02:28:29 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:08:57.418 02:28:29 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:08:57.418 02:28:29 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:08:57.418 02:28:29 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:08:57.418 02:28:29 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:08:57.418 02:28:29 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:08:57.418 02:28:29 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:57.418 02:28:29 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:08:57.418 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:08:57.418 02:28:29 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:08:57.418 02:28:29 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:08:57.418 02:28:29 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:08:57.418 02:28:29 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:08:57.418 02:28:29 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:57.418 02:28:29 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:57.418 02:28:29 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:57.418 02:28:29 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:08:57.418 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:08:57.418 02:28:29 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:08:57.418 02:28:29 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:08:57.418 02:28:29 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:08:57.418 02:28:29 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:08:57.418 02:28:29 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:57.418 02:28:29 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:57.418 02:28:29 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:08:57.418 02:28:29 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:08:57.418 02:28:29 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:57.418 02:28:29 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:57.418 02:28:29 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:57.418 02:28:29 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:57.418 02:28:29 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:08:57.418 Found net devices under 0000:18:00.0: mlx_0_0 00:08:57.418 02:28:29 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:57.418 02:28:29 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:57.418 02:28:29 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:57.418 02:28:29 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:57.418 02:28:29 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:57.418 02:28:29 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:08:57.418 Found net devices under 0000:18:00.1: mlx_0_1 00:08:57.418 02:28:29 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:57.418 02:28:29 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:08:57.418 02:28:29 -- nvmf/common.sh@403 -- # is_hw=yes 00:08:57.418 02:28:29 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:08:57.418 02:28:29 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:08:57.418 02:28:29 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:08:57.419 02:28:29 -- nvmf/common.sh@409 -- # rdma_device_init 00:08:57.419 02:28:29 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:08:57.419 02:28:29 -- nvmf/common.sh@58 -- # uname 00:08:57.419 02:28:29 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:08:57.419 02:28:29 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:08:57.419 02:28:29 -- nvmf/common.sh@63 -- # modprobe ib_core 00:08:57.419 02:28:29 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:08:57.419 02:28:29 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:08:57.419 02:28:29 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:08:57.419 02:28:30 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:08:57.419 02:28:30 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:08:57.419 02:28:30 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:08:57.419 02:28:30 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:08:57.419 02:28:30 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:08:57.419 02:28:30 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:57.419 02:28:30 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:57.419 02:28:30 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:57.419 02:28:30 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:57.419 02:28:30 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:57.419 02:28:30 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:57.419 02:28:30 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:57.419 02:28:30 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:08:57.419 02:28:30 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:08:57.419 02:28:30 -- nvmf/common.sh@105 -- # continue 2 00:08:57.419 02:28:30 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:57.419 02:28:30 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:57.419 02:28:30 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:08:57.419 02:28:30 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:57.419 02:28:30 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:08:57.419 02:28:30 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:08:57.419 02:28:30 -- nvmf/common.sh@105 -- # continue 2 00:08:57.419 02:28:30 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:57.419 02:28:30 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:08:57.419 02:28:30 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:08:57.419 02:28:30 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:08:57.419 02:28:30 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:57.419 02:28:30 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:57.419 02:28:30 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:08:57.419 02:28:30 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:08:57.419 02:28:30 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:08:57.419 60: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:08:57.419 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:08:57.419 altname enp24s0f0np0 00:08:57.419 altname ens785f0np0 00:08:57.419 inet 192.168.100.8/24 scope global mlx_0_0 00:08:57.419 valid_lft forever preferred_lft forever 00:08:57.419 02:28:30 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:57.419 02:28:30 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:08:57.419 02:28:30 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:08:57.419 02:28:30 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:57.419 02:28:30 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:08:57.419 02:28:30 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:57.419 02:28:30 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:08:57.419 02:28:30 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:08:57.419 02:28:30 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:08:57.419 61: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:08:57.419 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:08:57.419 altname enp24s0f1np1 00:08:57.419 altname ens785f1np1 00:08:57.419 inet 192.168.100.9/24 scope global mlx_0_1 00:08:57.419 valid_lft forever preferred_lft forever 00:08:57.419 02:28:30 -- nvmf/common.sh@411 -- # return 0 00:08:57.419 02:28:30 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:08:57.419 02:28:30 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:08:57.419 02:28:30 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:08:57.419 02:28:30 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:08:57.419 02:28:30 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:08:57.419 02:28:30 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:57.419 02:28:30 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:57.419 02:28:30 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:57.419 02:28:30 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:57.419 02:28:30 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:57.419 02:28:30 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:57.419 02:28:30 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:57.419 02:28:30 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:08:57.419 02:28:30 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:08:57.419 02:28:30 -- nvmf/common.sh@105 -- # continue 2 00:08:57.419 02:28:30 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:57.419 02:28:30 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:57.419 02:28:30 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:08:57.419 02:28:30 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:57.419 02:28:30 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:08:57.419 02:28:30 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:08:57.419 02:28:30 -- nvmf/common.sh@105 -- # continue 2 00:08:57.419 02:28:30 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:57.419 02:28:30 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:08:57.419 02:28:30 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:08:57.419 02:28:30 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:08:57.419 02:28:30 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:57.419 02:28:30 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:57.419 02:28:30 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:57.419 02:28:30 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:08:57.419 02:28:30 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:08:57.419 02:28:30 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:57.419 02:28:30 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:08:57.419 02:28:30 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:57.419 02:28:30 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:08:57.419 192.168.100.9' 00:08:57.419 02:28:30 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:08:57.419 192.168.100.9' 00:08:57.419 02:28:30 -- nvmf/common.sh@446 -- # head -n 1 00:08:57.419 02:28:30 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:08:57.419 02:28:30 -- nvmf/common.sh@447 -- # tail -n +2 00:08:57.419 02:28:30 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:08:57.419 192.168.100.9' 00:08:57.419 02:28:30 -- nvmf/common.sh@447 -- # head -n 1 00:08:57.419 02:28:30 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:08:57.419 02:28:30 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:08:57.419 02:28:30 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:08:57.419 02:28:30 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:08:57.419 02:28:30 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:08:57.419 02:28:30 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:08:57.419 02:28:30 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:08:57.419 02:28:30 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:08:57.419 02:28:30 -- common/autotest_common.sh@710 -- # xtrace_disable 00:08:57.419 02:28:30 -- common/autotest_common.sh@10 -- # set +x 00:08:57.419 02:28:30 -- target/nvmf_example.sh@29 -- # '[' rdma == tcp ']' 00:08:57.419 02:28:30 -- target/nvmf_example.sh@34 -- # nvmfpid=1444554 00:08:57.419 02:28:30 -- target/nvmf_example.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:08:57.419 02:28:30 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:08:57.419 02:28:30 -- target/nvmf_example.sh@36 -- # waitforlisten 1444554 00:08:57.419 02:28:30 -- common/autotest_common.sh@817 -- # '[' -z 1444554 ']' 00:08:57.419 02:28:30 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:57.419 02:28:30 -- common/autotest_common.sh@822 -- # local max_retries=100 00:08:57.419 02:28:30 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:57.419 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:57.419 02:28:30 -- common/autotest_common.sh@826 -- # xtrace_disable 00:08:57.419 02:28:30 -- common/autotest_common.sh@10 -- # set +x 00:08:57.419 EAL: No free 2048 kB hugepages reported on node 1 00:08:57.679 02:28:31 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:08:57.679 02:28:31 -- common/autotest_common.sh@850 -- # return 0 00:08:57.679 02:28:31 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:08:57.679 02:28:31 -- common/autotest_common.sh@716 -- # xtrace_disable 00:08:57.679 02:28:31 -- common/autotest_common.sh@10 -- # set +x 00:08:57.679 02:28:31 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:08:57.679 02:28:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:57.679 02:28:31 -- common/autotest_common.sh@10 -- # set +x 00:08:57.938 02:28:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:57.938 02:28:31 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:08:57.938 02:28:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:57.938 02:28:31 -- common/autotest_common.sh@10 -- # set +x 00:08:57.938 02:28:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:57.938 02:28:31 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:08:57.938 02:28:31 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:08:57.938 02:28:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:57.938 02:28:31 -- common/autotest_common.sh@10 -- # set +x 00:08:57.938 02:28:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:57.938 02:28:31 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:08:57.938 02:28:31 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:08:57.938 02:28:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:57.938 02:28:31 -- common/autotest_common.sh@10 -- # set +x 00:08:57.938 02:28:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:57.938 02:28:31 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:08:57.938 02:28:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:57.938 02:28:31 -- common/autotest_common.sh@10 -- # set +x 00:08:57.938 02:28:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:57.938 02:28:31 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:08:57.938 02:28:31 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:08:57.938 EAL: No free 2048 kB hugepages reported on node 1 00:09:10.162 Initializing NVMe Controllers 00:09:10.162 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:09:10.162 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:09:10.162 Initialization complete. Launching workers. 00:09:10.162 ======================================================== 00:09:10.162 Latency(us) 00:09:10.162 Device Information : IOPS MiB/s Average min max 00:09:10.162 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 25761.21 100.63 2484.32 628.95 12663.07 00:09:10.162 ======================================================== 00:09:10.162 Total : 25761.21 100.63 2484.32 628.95 12663.07 00:09:10.162 00:09:10.162 02:28:42 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:09:10.162 02:28:42 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:09:10.162 02:28:42 -- nvmf/common.sh@477 -- # nvmfcleanup 00:09:10.162 02:28:42 -- nvmf/common.sh@117 -- # sync 00:09:10.162 02:28:42 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:09:10.162 02:28:42 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:09:10.162 02:28:42 -- nvmf/common.sh@120 -- # set +e 00:09:10.162 02:28:42 -- nvmf/common.sh@121 -- # for i in {1..20} 00:09:10.162 02:28:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:09:10.162 rmmod nvme_rdma 00:09:10.162 rmmod nvme_fabrics 00:09:10.162 02:28:42 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:09:10.162 02:28:42 -- nvmf/common.sh@124 -- # set -e 00:09:10.162 02:28:42 -- nvmf/common.sh@125 -- # return 0 00:09:10.162 02:28:42 -- nvmf/common.sh@478 -- # '[' -n 1444554 ']' 00:09:10.162 02:28:42 -- nvmf/common.sh@479 -- # killprocess 1444554 00:09:10.162 02:28:42 -- common/autotest_common.sh@936 -- # '[' -z 1444554 ']' 00:09:10.162 02:28:42 -- common/autotest_common.sh@940 -- # kill -0 1444554 00:09:10.162 02:28:42 -- common/autotest_common.sh@941 -- # uname 00:09:10.162 02:28:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:09:10.162 02:28:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1444554 00:09:10.162 02:28:42 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:09:10.162 02:28:42 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:09:10.162 02:28:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1444554' 00:09:10.162 killing process with pid 1444554 00:09:10.162 02:28:42 -- common/autotest_common.sh@955 -- # kill 1444554 00:09:10.162 02:28:42 -- common/autotest_common.sh@960 -- # wait 1444554 00:09:10.162 [2024-04-27 02:28:42.799300] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:09:10.162 nvmf threads initialize successfully 00:09:10.162 bdev subsystem init successfully 00:09:10.162 created a nvmf target service 00:09:10.163 create targets's poll groups done 00:09:10.163 all subsystems of target started 00:09:10.163 nvmf target is running 00:09:10.163 all subsystems of target stopped 00:09:10.163 destroy targets's poll groups done 00:09:10.163 destroyed the nvmf target service 00:09:10.163 bdev subsystem finish successfully 00:09:10.163 nvmf threads destroy successfully 00:09:10.163 02:28:43 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:09:10.163 02:28:43 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:09:10.163 02:28:43 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:09:10.163 02:28:43 -- common/autotest_common.sh@716 -- # xtrace_disable 00:09:10.163 02:28:43 -- common/autotest_common.sh@10 -- # set +x 00:09:10.163 00:09:10.163 real 0m18.932s 00:09:10.163 user 0m52.149s 00:09:10.163 sys 0m5.038s 00:09:10.163 02:28:43 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:09:10.163 02:28:43 -- common/autotest_common.sh@10 -- # set +x 00:09:10.163 ************************************ 00:09:10.163 END TEST nvmf_example 00:09:10.163 ************************************ 00:09:10.163 02:28:43 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=rdma 00:09:10.163 02:28:43 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:09:10.163 02:28:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:10.163 02:28:43 -- common/autotest_common.sh@10 -- # set +x 00:09:10.163 ************************************ 00:09:10.163 START TEST nvmf_filesystem 00:09:10.163 ************************************ 00:09:10.163 02:28:43 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=rdma 00:09:10.163 * Looking for test storage... 00:09:10.163 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:09:10.163 02:28:43 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh 00:09:10.163 02:28:43 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:09:10.163 02:28:43 -- common/autotest_common.sh@34 -- # set -e 00:09:10.163 02:28:43 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:09:10.163 02:28:43 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:09:10.163 02:28:43 -- common/autotest_common.sh@38 -- # '[' -z /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output ']' 00:09:10.163 02:28:43 -- common/autotest_common.sh@43 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/build_config.sh ]] 00:09:10.163 02:28:43 -- common/autotest_common.sh@44 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/build_config.sh 00:09:10.163 02:28:43 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:09:10.163 02:28:43 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:09:10.163 02:28:43 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:09:10.163 02:28:43 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:09:10.163 02:28:43 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:09:10.163 02:28:43 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:09:10.163 02:28:43 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:09:10.163 02:28:43 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:09:10.163 02:28:43 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:09:10.163 02:28:43 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:09:10.163 02:28:43 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:09:10.163 02:28:43 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:09:10.163 02:28:43 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:09:10.163 02:28:43 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:09:10.163 02:28:43 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:09:10.163 02:28:43 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:09:10.163 02:28:43 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:09:10.163 02:28:43 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:09:10.163 02:28:43 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk 00:09:10.163 02:28:43 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:09:10.163 02:28:43 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:09:10.163 02:28:43 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:09:10.163 02:28:43 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:09:10.163 02:28:43 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:09:10.163 02:28:43 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:09:10.163 02:28:43 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:09:10.163 02:28:43 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:09:10.163 02:28:43 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:09:10.163 02:28:43 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:09:10.163 02:28:43 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:09:10.163 02:28:43 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:09:10.163 02:28:43 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:09:10.163 02:28:43 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:09:10.163 02:28:43 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:09:10.163 02:28:43 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:09:10.163 02:28:43 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build 00:09:10.163 02:28:43 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:09:10.163 02:28:43 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:09:10.163 02:28:43 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:09:10.163 02:28:43 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:09:10.163 02:28:43 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:09:10.163 02:28:43 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:09:10.163 02:28:43 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:09:10.163 02:28:43 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:09:10.163 02:28:43 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:09:10.163 02:28:43 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:09:10.163 02:28:43 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:09:10.163 02:28:43 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:09:10.163 02:28:43 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:09:10.163 02:28:43 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:09:10.163 02:28:43 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:09:10.163 02:28:43 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:09:10.163 02:28:43 -- common/build_config.sh@53 -- # CONFIG_HAVE_EVP_MAC=y 00:09:10.163 02:28:43 -- common/build_config.sh@54 -- # CONFIG_URING_ZNS=n 00:09:10.163 02:28:43 -- common/build_config.sh@55 -- # CONFIG_WERROR=y 00:09:10.163 02:28:43 -- common/build_config.sh@56 -- # CONFIG_HAVE_LIBBSD=n 00:09:10.163 02:28:43 -- common/build_config.sh@57 -- # CONFIG_UBSAN=y 00:09:10.163 02:28:43 -- common/build_config.sh@58 -- # CONFIG_IPSEC_MB_DIR= 00:09:10.163 02:28:43 -- common/build_config.sh@59 -- # CONFIG_GOLANG=n 00:09:10.163 02:28:43 -- common/build_config.sh@60 -- # CONFIG_ISAL=y 00:09:10.163 02:28:43 -- common/build_config.sh@61 -- # CONFIG_IDXD_KERNEL=n 00:09:10.163 02:28:43 -- common/build_config.sh@62 -- # CONFIG_DPDK_LIB_DIR= 00:09:10.163 02:28:43 -- common/build_config.sh@63 -- # CONFIG_RDMA_PROV=verbs 00:09:10.163 02:28:43 -- common/build_config.sh@64 -- # CONFIG_APPS=y 00:09:10.163 02:28:43 -- common/build_config.sh@65 -- # CONFIG_SHARED=y 00:09:10.163 02:28:43 -- common/build_config.sh@66 -- # CONFIG_HAVE_KEYUTILS=n 00:09:10.163 02:28:43 -- common/build_config.sh@67 -- # CONFIG_FC_PATH= 00:09:10.163 02:28:43 -- common/build_config.sh@68 -- # CONFIG_DPDK_PKG_CONFIG=n 00:09:10.163 02:28:43 -- common/build_config.sh@69 -- # CONFIG_FC=n 00:09:10.163 02:28:43 -- common/build_config.sh@70 -- # CONFIG_AVAHI=n 00:09:10.163 02:28:43 -- common/build_config.sh@71 -- # CONFIG_FIO_PLUGIN=y 00:09:10.163 02:28:43 -- common/build_config.sh@72 -- # CONFIG_RAID5F=n 00:09:10.163 02:28:43 -- common/build_config.sh@73 -- # CONFIG_EXAMPLES=y 00:09:10.163 02:28:43 -- common/build_config.sh@74 -- # CONFIG_TESTS=y 00:09:10.163 02:28:43 -- common/build_config.sh@75 -- # CONFIG_CRYPTO_MLX5=n 00:09:10.163 02:28:43 -- common/build_config.sh@76 -- # CONFIG_MAX_LCORES= 00:09:10.163 02:28:43 -- common/build_config.sh@77 -- # CONFIG_IPSEC_MB=n 00:09:10.163 02:28:43 -- common/build_config.sh@78 -- # CONFIG_PGO_DIR= 00:09:10.163 02:28:43 -- common/build_config.sh@79 -- # CONFIG_DEBUG=y 00:09:10.163 02:28:43 -- common/build_config.sh@80 -- # CONFIG_DPDK_COMPRESSDEV=n 00:09:10.163 02:28:43 -- common/build_config.sh@81 -- # CONFIG_CROSS_PREFIX= 00:09:10.163 02:28:43 -- common/build_config.sh@82 -- # CONFIG_URING=n 00:09:10.163 02:28:43 -- common/autotest_common.sh@53 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/applications.sh 00:09:10.163 02:28:43 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/applications.sh 00:09:10.163 02:28:43 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common 00:09:10.163 02:28:43 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common 00:09:10.163 02:28:43 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:09:10.164 02:28:43 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin 00:09:10.164 02:28:43 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app 00:09:10.164 02:28:43 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples 00:09:10.164 02:28:43 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:09:10.164 02:28:43 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:09:10.164 02:28:43 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:09:10.164 02:28:43 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:09:10.164 02:28:43 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:09:10.164 02:28:43 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:09:10.164 02:28:43 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/include/spdk/config.h ]] 00:09:10.164 02:28:43 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:09:10.164 #define SPDK_CONFIG_H 00:09:10.164 #define SPDK_CONFIG_APPS 1 00:09:10.164 #define SPDK_CONFIG_ARCH native 00:09:10.164 #undef SPDK_CONFIG_ASAN 00:09:10.164 #undef SPDK_CONFIG_AVAHI 00:09:10.164 #undef SPDK_CONFIG_CET 00:09:10.164 #define SPDK_CONFIG_COVERAGE 1 00:09:10.164 #define SPDK_CONFIG_CROSS_PREFIX 00:09:10.164 #undef SPDK_CONFIG_CRYPTO 00:09:10.164 #undef SPDK_CONFIG_CRYPTO_MLX5 00:09:10.164 #undef SPDK_CONFIG_CUSTOMOCF 00:09:10.164 #undef SPDK_CONFIG_DAOS 00:09:10.164 #define SPDK_CONFIG_DAOS_DIR 00:09:10.164 #define SPDK_CONFIG_DEBUG 1 00:09:10.164 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:09:10.164 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build 00:09:10.164 #define SPDK_CONFIG_DPDK_INC_DIR 00:09:10.164 #define SPDK_CONFIG_DPDK_LIB_DIR 00:09:10.164 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:09:10.164 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk 00:09:10.164 #define SPDK_CONFIG_EXAMPLES 1 00:09:10.164 #undef SPDK_CONFIG_FC 00:09:10.164 #define SPDK_CONFIG_FC_PATH 00:09:10.164 #define SPDK_CONFIG_FIO_PLUGIN 1 00:09:10.164 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:09:10.164 #undef SPDK_CONFIG_FUSE 00:09:10.164 #undef SPDK_CONFIG_FUZZER 00:09:10.164 #define SPDK_CONFIG_FUZZER_LIB 00:09:10.164 #undef SPDK_CONFIG_GOLANG 00:09:10.164 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:09:10.164 #define SPDK_CONFIG_HAVE_EVP_MAC 1 00:09:10.164 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:09:10.164 #undef SPDK_CONFIG_HAVE_KEYUTILS 00:09:10.164 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:09:10.164 #undef SPDK_CONFIG_HAVE_LIBBSD 00:09:10.164 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:09:10.164 #define SPDK_CONFIG_IDXD 1 00:09:10.164 #undef SPDK_CONFIG_IDXD_KERNEL 00:09:10.164 #undef SPDK_CONFIG_IPSEC_MB 00:09:10.164 #define SPDK_CONFIG_IPSEC_MB_DIR 00:09:10.164 #define SPDK_CONFIG_ISAL 1 00:09:10.164 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:09:10.164 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:09:10.164 #define SPDK_CONFIG_LIBDIR 00:09:10.164 #undef SPDK_CONFIG_LTO 00:09:10.164 #define SPDK_CONFIG_MAX_LCORES 00:09:10.164 #define SPDK_CONFIG_NVME_CUSE 1 00:09:10.164 #undef SPDK_CONFIG_OCF 00:09:10.164 #define SPDK_CONFIG_OCF_PATH 00:09:10.164 #define SPDK_CONFIG_OPENSSL_PATH 00:09:10.164 #undef SPDK_CONFIG_PGO_CAPTURE 00:09:10.164 #define SPDK_CONFIG_PGO_DIR 00:09:10.164 #undef SPDK_CONFIG_PGO_USE 00:09:10.164 #define SPDK_CONFIG_PREFIX /usr/local 00:09:10.164 #undef SPDK_CONFIG_RAID5F 00:09:10.164 #undef SPDK_CONFIG_RBD 00:09:10.164 #define SPDK_CONFIG_RDMA 1 00:09:10.164 #define SPDK_CONFIG_RDMA_PROV verbs 00:09:10.164 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:09:10.164 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:09:10.164 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:09:10.164 #define SPDK_CONFIG_SHARED 1 00:09:10.164 #undef SPDK_CONFIG_SMA 00:09:10.164 #define SPDK_CONFIG_TESTS 1 00:09:10.164 #undef SPDK_CONFIG_TSAN 00:09:10.164 #define SPDK_CONFIG_UBLK 1 00:09:10.164 #define SPDK_CONFIG_UBSAN 1 00:09:10.164 #undef SPDK_CONFIG_UNIT_TESTS 00:09:10.164 #undef SPDK_CONFIG_URING 00:09:10.164 #define SPDK_CONFIG_URING_PATH 00:09:10.164 #undef SPDK_CONFIG_URING_ZNS 00:09:10.164 #undef SPDK_CONFIG_USDT 00:09:10.164 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:09:10.164 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:09:10.164 #undef SPDK_CONFIG_VFIO_USER 00:09:10.164 #define SPDK_CONFIG_VFIO_USER_DIR 00:09:10.164 #define SPDK_CONFIG_VHOST 1 00:09:10.164 #define SPDK_CONFIG_VIRTIO 1 00:09:10.164 #undef SPDK_CONFIG_VTUNE 00:09:10.164 #define SPDK_CONFIG_VTUNE_DIR 00:09:10.164 #define SPDK_CONFIG_WERROR 1 00:09:10.164 #define SPDK_CONFIG_WPDK_DIR 00:09:10.164 #undef SPDK_CONFIG_XNVME 00:09:10.164 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:09:10.164 02:28:43 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:09:10.164 02:28:43 -- common/autotest_common.sh@54 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:09:10.164 02:28:43 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:10.164 02:28:43 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:10.164 02:28:43 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:10.164 02:28:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:10.164 02:28:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:10.164 02:28:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:10.164 02:28:43 -- paths/export.sh@5 -- # export PATH 00:09:10.164 02:28:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:10.164 02:28:43 -- common/autotest_common.sh@55 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/common 00:09:10.164 02:28:43 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/common 00:09:10.164 02:28:43 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm 00:09:10.164 02:28:43 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm 00:09:10.164 02:28:43 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/../../../ 00:09:10.164 02:28:43 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:09:10.165 02:28:43 -- pm/common@67 -- # TEST_TAG=N/A 00:09:10.165 02:28:43 -- pm/common@68 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-phy-autotest/spdk/.run_test_name 00:09:10.165 02:28:43 -- pm/common@70 -- # PM_OUTPUTDIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power 00:09:10.165 02:28:43 -- pm/common@71 -- # uname -s 00:09:10.165 02:28:43 -- pm/common@71 -- # PM_OS=Linux 00:09:10.165 02:28:43 -- pm/common@73 -- # MONITOR_RESOURCES=(collect-cpu-load collect-vmstat) 00:09:10.165 02:28:43 -- pm/common@74 -- # [[ Linux == FreeBSD ]] 00:09:10.165 02:28:43 -- pm/common@76 -- # [[ Linux == Linux ]] 00:09:10.165 02:28:43 -- pm/common@76 -- # [[ ............................... != QEMU ]] 00:09:10.165 02:28:43 -- pm/common@76 -- # [[ ! -e /.dockerenv ]] 00:09:10.165 02:28:43 -- pm/common@79 -- # MONITOR_RESOURCES+=(collect-cpu-temp) 00:09:10.165 02:28:43 -- pm/common@80 -- # MONITOR_RESOURCES+=(collect-bmc-pm) 00:09:10.165 02:28:43 -- pm/common@83 -- # MONITOR_RESOURCES_PIDS=() 00:09:10.165 02:28:43 -- pm/common@83 -- # declare -A MONITOR_RESOURCES_PIDS 00:09:10.165 02:28:43 -- pm/common@85 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power 00:09:10.165 02:28:43 -- common/autotest_common.sh@57 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@58 -- # export RUN_NIGHTLY 00:09:10.165 02:28:43 -- common/autotest_common.sh@61 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@62 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:09:10.165 02:28:43 -- common/autotest_common.sh@63 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@64 -- # export SPDK_RUN_VALGRIND 00:09:10.165 02:28:43 -- common/autotest_common.sh@65 -- # : 1 00:09:10.165 02:28:43 -- common/autotest_common.sh@66 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:09:10.165 02:28:43 -- common/autotest_common.sh@67 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@68 -- # export SPDK_TEST_UNITTEST 00:09:10.165 02:28:43 -- common/autotest_common.sh@69 -- # : 00:09:10.165 02:28:43 -- common/autotest_common.sh@70 -- # export SPDK_TEST_AUTOBUILD 00:09:10.165 02:28:43 -- common/autotest_common.sh@71 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@72 -- # export SPDK_TEST_RELEASE_BUILD 00:09:10.165 02:28:43 -- common/autotest_common.sh@73 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@74 -- # export SPDK_TEST_ISAL 00:09:10.165 02:28:43 -- common/autotest_common.sh@75 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@76 -- # export SPDK_TEST_ISCSI 00:09:10.165 02:28:43 -- common/autotest_common.sh@77 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@78 -- # export SPDK_TEST_ISCSI_INITIATOR 00:09:10.165 02:28:43 -- common/autotest_common.sh@79 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@80 -- # export SPDK_TEST_NVME 00:09:10.165 02:28:43 -- common/autotest_common.sh@81 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@82 -- # export SPDK_TEST_NVME_PMR 00:09:10.165 02:28:43 -- common/autotest_common.sh@83 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@84 -- # export SPDK_TEST_NVME_BP 00:09:10.165 02:28:43 -- common/autotest_common.sh@85 -- # : 1 00:09:10.165 02:28:43 -- common/autotest_common.sh@86 -- # export SPDK_TEST_NVME_CLI 00:09:10.165 02:28:43 -- common/autotest_common.sh@87 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@88 -- # export SPDK_TEST_NVME_CUSE 00:09:10.165 02:28:43 -- common/autotest_common.sh@89 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@90 -- # export SPDK_TEST_NVME_FDP 00:09:10.165 02:28:43 -- common/autotest_common.sh@91 -- # : 1 00:09:10.165 02:28:43 -- common/autotest_common.sh@92 -- # export SPDK_TEST_NVMF 00:09:10.165 02:28:43 -- common/autotest_common.sh@93 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@94 -- # export SPDK_TEST_VFIOUSER 00:09:10.165 02:28:43 -- common/autotest_common.sh@95 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@96 -- # export SPDK_TEST_VFIOUSER_QEMU 00:09:10.165 02:28:43 -- common/autotest_common.sh@97 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@98 -- # export SPDK_TEST_FUZZER 00:09:10.165 02:28:43 -- common/autotest_common.sh@99 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@100 -- # export SPDK_TEST_FUZZER_SHORT 00:09:10.165 02:28:43 -- common/autotest_common.sh@101 -- # : rdma 00:09:10.165 02:28:43 -- common/autotest_common.sh@102 -- # export SPDK_TEST_NVMF_TRANSPORT 00:09:10.165 02:28:43 -- common/autotest_common.sh@103 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@104 -- # export SPDK_TEST_RBD 00:09:10.165 02:28:43 -- common/autotest_common.sh@105 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@106 -- # export SPDK_TEST_VHOST 00:09:10.165 02:28:43 -- common/autotest_common.sh@107 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@108 -- # export SPDK_TEST_BLOCKDEV 00:09:10.165 02:28:43 -- common/autotest_common.sh@109 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@110 -- # export SPDK_TEST_IOAT 00:09:10.165 02:28:43 -- common/autotest_common.sh@111 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@112 -- # export SPDK_TEST_BLOBFS 00:09:10.165 02:28:43 -- common/autotest_common.sh@113 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@114 -- # export SPDK_TEST_VHOST_INIT 00:09:10.165 02:28:43 -- common/autotest_common.sh@115 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@116 -- # export SPDK_TEST_LVOL 00:09:10.165 02:28:43 -- common/autotest_common.sh@117 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@118 -- # export SPDK_TEST_VBDEV_COMPRESS 00:09:10.165 02:28:43 -- common/autotest_common.sh@119 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@120 -- # export SPDK_RUN_ASAN 00:09:10.165 02:28:43 -- common/autotest_common.sh@121 -- # : 1 00:09:10.165 02:28:43 -- common/autotest_common.sh@122 -- # export SPDK_RUN_UBSAN 00:09:10.165 02:28:43 -- common/autotest_common.sh@123 -- # : 00:09:10.165 02:28:43 -- common/autotest_common.sh@124 -- # export SPDK_RUN_EXTERNAL_DPDK 00:09:10.165 02:28:43 -- common/autotest_common.sh@125 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@126 -- # export SPDK_RUN_NON_ROOT 00:09:10.165 02:28:43 -- common/autotest_common.sh@127 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@128 -- # export SPDK_TEST_CRYPTO 00:09:10.165 02:28:43 -- common/autotest_common.sh@129 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@130 -- # export SPDK_TEST_FTL 00:09:10.165 02:28:43 -- common/autotest_common.sh@131 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@132 -- # export SPDK_TEST_OCF 00:09:10.165 02:28:43 -- common/autotest_common.sh@133 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@134 -- # export SPDK_TEST_VMD 00:09:10.165 02:28:43 -- common/autotest_common.sh@135 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@136 -- # export SPDK_TEST_OPAL 00:09:10.165 02:28:43 -- common/autotest_common.sh@137 -- # : 00:09:10.165 02:28:43 -- common/autotest_common.sh@138 -- # export SPDK_TEST_NATIVE_DPDK 00:09:10.165 02:28:43 -- common/autotest_common.sh@139 -- # : true 00:09:10.165 02:28:43 -- common/autotest_common.sh@140 -- # export SPDK_AUTOTEST_X 00:09:10.165 02:28:43 -- common/autotest_common.sh@141 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@142 -- # export SPDK_TEST_RAID5 00:09:10.165 02:28:43 -- common/autotest_common.sh@143 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@144 -- # export SPDK_TEST_URING 00:09:10.165 02:28:43 -- common/autotest_common.sh@145 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@146 -- # export SPDK_TEST_USDT 00:09:10.165 02:28:43 -- common/autotest_common.sh@147 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@148 -- # export SPDK_TEST_USE_IGB_UIO 00:09:10.165 02:28:43 -- common/autotest_common.sh@149 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@150 -- # export SPDK_TEST_SCHEDULER 00:09:10.165 02:28:43 -- common/autotest_common.sh@151 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@152 -- # export SPDK_TEST_SCANBUILD 00:09:10.165 02:28:43 -- common/autotest_common.sh@153 -- # : mlx5 00:09:10.165 02:28:43 -- common/autotest_common.sh@154 -- # export SPDK_TEST_NVMF_NICS 00:09:10.165 02:28:43 -- common/autotest_common.sh@155 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@156 -- # export SPDK_TEST_SMA 00:09:10.165 02:28:43 -- common/autotest_common.sh@157 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@158 -- # export SPDK_TEST_DAOS 00:09:10.165 02:28:43 -- common/autotest_common.sh@159 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@160 -- # export SPDK_TEST_XNVME 00:09:10.165 02:28:43 -- common/autotest_common.sh@161 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@162 -- # export SPDK_TEST_ACCEL_DSA 00:09:10.165 02:28:43 -- common/autotest_common.sh@163 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@164 -- # export SPDK_TEST_ACCEL_IAA 00:09:10.165 02:28:43 -- common/autotest_common.sh@166 -- # : 00:09:10.165 02:28:43 -- common/autotest_common.sh@167 -- # export SPDK_TEST_FUZZER_TARGET 00:09:10.165 02:28:43 -- common/autotest_common.sh@168 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@169 -- # export SPDK_TEST_NVMF_MDNS 00:09:10.165 02:28:43 -- common/autotest_common.sh@170 -- # : 0 00:09:10.165 02:28:43 -- common/autotest_common.sh@171 -- # export SPDK_JSONRPC_GO_CLIENT 00:09:10.165 02:28:43 -- common/autotest_common.sh@174 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib 00:09:10.165 02:28:43 -- common/autotest_common.sh@174 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib 00:09:10.165 02:28:43 -- common/autotest_common.sh@175 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib 00:09:10.165 02:28:43 -- common/autotest_common.sh@175 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib 00:09:10.165 02:28:43 -- common/autotest_common.sh@176 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:09:10.165 02:28:43 -- common/autotest_common.sh@176 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:09:10.165 02:28:43 -- common/autotest_common.sh@177 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:09:10.166 02:28:43 -- common/autotest_common.sh@177 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:09:10.166 02:28:43 -- common/autotest_common.sh@180 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:09:10.166 02:28:43 -- common/autotest_common.sh@180 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:09:10.166 02:28:43 -- common/autotest_common.sh@184 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python 00:09:10.166 02:28:43 -- common/autotest_common.sh@184 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python 00:09:10.166 02:28:43 -- common/autotest_common.sh@188 -- # export PYTHONDONTWRITEBYTECODE=1 00:09:10.166 02:28:43 -- common/autotest_common.sh@188 -- # PYTHONDONTWRITEBYTECODE=1 00:09:10.166 02:28:43 -- common/autotest_common.sh@192 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:09:10.166 02:28:43 -- common/autotest_common.sh@192 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:09:10.166 02:28:43 -- common/autotest_common.sh@193 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:09:10.166 02:28:43 -- common/autotest_common.sh@193 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:09:10.166 02:28:43 -- common/autotest_common.sh@197 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:09:10.166 02:28:43 -- common/autotest_common.sh@198 -- # rm -rf /var/tmp/asan_suppression_file 00:09:10.166 02:28:43 -- common/autotest_common.sh@199 -- # cat 00:09:10.166 02:28:43 -- common/autotest_common.sh@225 -- # echo leak:libfuse3.so 00:09:10.166 02:28:43 -- common/autotest_common.sh@227 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:09:10.166 02:28:43 -- common/autotest_common.sh@227 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:09:10.166 02:28:43 -- common/autotest_common.sh@229 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:09:10.166 02:28:43 -- common/autotest_common.sh@229 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:09:10.166 02:28:43 -- common/autotest_common.sh@231 -- # '[' -z /var/spdk/dependencies ']' 00:09:10.166 02:28:43 -- common/autotest_common.sh@234 -- # export DEPENDENCY_DIR 00:09:10.166 02:28:43 -- common/autotest_common.sh@238 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin 00:09:10.166 02:28:43 -- common/autotest_common.sh@238 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin 00:09:10.166 02:28:43 -- common/autotest_common.sh@239 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples 00:09:10.166 02:28:43 -- common/autotest_common.sh@239 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples 00:09:10.166 02:28:43 -- common/autotest_common.sh@242 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:09:10.166 02:28:43 -- common/autotest_common.sh@242 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:09:10.166 02:28:43 -- common/autotest_common.sh@243 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:09:10.166 02:28:43 -- common/autotest_common.sh@243 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:09:10.166 02:28:43 -- common/autotest_common.sh@245 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:09:10.166 02:28:43 -- common/autotest_common.sh@245 -- # AR_TOOL=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:09:10.166 02:28:43 -- common/autotest_common.sh@248 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:09:10.166 02:28:43 -- common/autotest_common.sh@248 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:09:10.166 02:28:43 -- common/autotest_common.sh@251 -- # '[' 0 -eq 0 ']' 00:09:10.166 02:28:43 -- common/autotest_common.sh@252 -- # export valgrind= 00:09:10.166 02:28:43 -- common/autotest_common.sh@252 -- # valgrind= 00:09:10.166 02:28:43 -- common/autotest_common.sh@258 -- # uname -s 00:09:10.166 02:28:43 -- common/autotest_common.sh@258 -- # '[' Linux = Linux ']' 00:09:10.166 02:28:43 -- common/autotest_common.sh@259 -- # HUGEMEM=4096 00:09:10.166 02:28:43 -- common/autotest_common.sh@260 -- # export CLEAR_HUGE=yes 00:09:10.166 02:28:43 -- common/autotest_common.sh@260 -- # CLEAR_HUGE=yes 00:09:10.166 02:28:43 -- common/autotest_common.sh@261 -- # [[ 0 -eq 1 ]] 00:09:10.166 02:28:43 -- common/autotest_common.sh@261 -- # [[ 0 -eq 1 ]] 00:09:10.166 02:28:43 -- common/autotest_common.sh@268 -- # MAKE=make 00:09:10.166 02:28:43 -- common/autotest_common.sh@269 -- # MAKEFLAGS=-j72 00:09:10.166 02:28:43 -- common/autotest_common.sh@285 -- # export HUGEMEM=4096 00:09:10.166 02:28:43 -- common/autotest_common.sh@285 -- # HUGEMEM=4096 00:09:10.166 02:28:43 -- common/autotest_common.sh@287 -- # NO_HUGE=() 00:09:10.166 02:28:43 -- common/autotest_common.sh@288 -- # TEST_MODE= 00:09:10.166 02:28:43 -- common/autotest_common.sh@289 -- # for i in "$@" 00:09:10.166 02:28:43 -- common/autotest_common.sh@290 -- # case "$i" in 00:09:10.166 02:28:43 -- common/autotest_common.sh@295 -- # TEST_TRANSPORT=rdma 00:09:10.166 02:28:43 -- common/autotest_common.sh@307 -- # [[ -z 1446455 ]] 00:09:10.166 02:28:43 -- common/autotest_common.sh@307 -- # kill -0 1446455 00:09:10.166 02:28:43 -- common/autotest_common.sh@1666 -- # set_test_storage 2147483648 00:09:10.166 02:28:43 -- common/autotest_common.sh@317 -- # [[ -v testdir ]] 00:09:10.166 02:28:43 -- common/autotest_common.sh@319 -- # local requested_size=2147483648 00:09:10.166 02:28:43 -- common/autotest_common.sh@320 -- # local mount target_dir 00:09:10.166 02:28:43 -- common/autotest_common.sh@322 -- # local -A mounts fss sizes avails uses 00:09:10.166 02:28:43 -- common/autotest_common.sh@323 -- # local source fs size avail mount use 00:09:10.166 02:28:43 -- common/autotest_common.sh@325 -- # local storage_fallback storage_candidates 00:09:10.166 02:28:43 -- common/autotest_common.sh@327 -- # mktemp -udt spdk.XXXXXX 00:09:10.166 02:28:43 -- common/autotest_common.sh@327 -- # storage_fallback=/tmp/spdk.Yvhq9Y 00:09:10.166 02:28:43 -- common/autotest_common.sh@332 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:09:10.166 02:28:43 -- common/autotest_common.sh@334 -- # [[ -n '' ]] 00:09:10.166 02:28:43 -- common/autotest_common.sh@339 -- # [[ -n '' ]] 00:09:10.166 02:28:43 -- common/autotest_common.sh@344 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target /tmp/spdk.Yvhq9Y/tests/target /tmp/spdk.Yvhq9Y 00:09:10.166 02:28:43 -- common/autotest_common.sh@347 -- # requested_size=2214592512 00:09:10.166 02:28:43 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:09:10.166 02:28:43 -- common/autotest_common.sh@316 -- # df -T 00:09:10.166 02:28:43 -- common/autotest_common.sh@316 -- # grep -v Filesystem 00:09:10.166 02:28:43 -- common/autotest_common.sh@350 -- # mounts["$mount"]=spdk_devtmpfs 00:09:10.166 02:28:43 -- common/autotest_common.sh@350 -- # fss["$mount"]=devtmpfs 00:09:10.166 02:28:43 -- common/autotest_common.sh@351 -- # avails["$mount"]=67108864 00:09:10.166 02:28:43 -- common/autotest_common.sh@351 -- # sizes["$mount"]=67108864 00:09:10.166 02:28:43 -- common/autotest_common.sh@352 -- # uses["$mount"]=0 00:09:10.166 02:28:43 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:09:10.166 02:28:43 -- common/autotest_common.sh@350 -- # mounts["$mount"]=/dev/pmem0 00:09:10.166 02:28:43 -- common/autotest_common.sh@350 -- # fss["$mount"]=ext2 00:09:10.166 02:28:43 -- common/autotest_common.sh@351 -- # avails["$mount"]=988676096 00:09:10.166 02:28:43 -- common/autotest_common.sh@351 -- # sizes["$mount"]=5284429824 00:09:10.166 02:28:43 -- common/autotest_common.sh@352 -- # uses["$mount"]=4295753728 00:09:10.166 02:28:43 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:09:10.166 02:28:43 -- common/autotest_common.sh@350 -- # mounts["$mount"]=spdk_root 00:09:10.166 02:28:43 -- common/autotest_common.sh@350 -- # fss["$mount"]=overlay 00:09:10.166 02:28:43 -- common/autotest_common.sh@351 -- # avails["$mount"]=56099581952 00:09:10.166 02:28:43 -- common/autotest_common.sh@351 -- # sizes["$mount"]=61742698496 00:09:10.166 02:28:43 -- common/autotest_common.sh@352 -- # uses["$mount"]=5643116544 00:09:10.166 02:28:43 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:09:10.166 02:28:43 -- common/autotest_common.sh@350 -- # mounts["$mount"]=/dev/sda1 00:09:10.166 02:28:43 -- common/autotest_common.sh@350 -- # fss["$mount"]=xfs 00:09:10.166 02:28:43 -- common/autotest_common.sh@351 -- # avails["$mount"]=221821267968 00:09:10.166 02:28:43 -- common/autotest_common.sh@351 -- # sizes["$mount"]=239938535424 00:09:10.166 02:28:43 -- common/autotest_common.sh@352 -- # uses["$mount"]=18117267456 00:09:10.166 02:28:43 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:09:10.166 02:28:43 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:09:10.166 02:28:43 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:09:10.166 02:28:43 -- common/autotest_common.sh@351 -- # avails["$mount"]=30870069248 00:09:10.166 02:28:43 -- common/autotest_common.sh@351 -- # sizes["$mount"]=30871347200 00:09:10.166 02:28:43 -- common/autotest_common.sh@352 -- # uses["$mount"]=1277952 00:09:10.166 02:28:43 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:09:10.166 02:28:43 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:09:10.166 02:28:43 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:09:10.166 02:28:43 -- common/autotest_common.sh@351 -- # avails["$mount"]=12339372032 00:09:10.166 02:28:43 -- common/autotest_common.sh@351 -- # sizes["$mount"]=12348542976 00:09:10.166 02:28:43 -- common/autotest_common.sh@352 -- # uses["$mount"]=9170944 00:09:10.166 02:28:43 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:09:10.166 02:28:43 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:09:10.166 02:28:43 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:09:10.166 02:28:43 -- common/autotest_common.sh@351 -- # avails["$mount"]=30870867968 00:09:10.166 02:28:43 -- common/autotest_common.sh@351 -- # sizes["$mount"]=30871351296 00:09:10.166 02:28:43 -- common/autotest_common.sh@352 -- # uses["$mount"]=483328 00:09:10.166 02:28:43 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:09:10.166 02:28:43 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:09:10.166 02:28:43 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:09:10.166 02:28:43 -- common/autotest_common.sh@351 -- # avails["$mount"]=6174265344 00:09:10.166 02:28:43 -- common/autotest_common.sh@351 -- # sizes["$mount"]=6174269440 00:09:10.166 02:28:43 -- common/autotest_common.sh@352 -- # uses["$mount"]=4096 00:09:10.166 02:28:43 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:09:10.167 02:28:43 -- common/autotest_common.sh@355 -- # printf '* Looking for test storage...\n' 00:09:10.167 * Looking for test storage... 00:09:10.167 02:28:43 -- common/autotest_common.sh@357 -- # local target_space new_size 00:09:10.167 02:28:43 -- common/autotest_common.sh@358 -- # for target_dir in "${storage_candidates[@]}" 00:09:10.167 02:28:43 -- common/autotest_common.sh@361 -- # df /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:09:10.167 02:28:43 -- common/autotest_common.sh@361 -- # awk '$1 !~ /Filesystem/{print $6}' 00:09:10.167 02:28:43 -- common/autotest_common.sh@361 -- # mount=/ 00:09:10.167 02:28:43 -- common/autotest_common.sh@363 -- # target_space=56099581952 00:09:10.167 02:28:43 -- common/autotest_common.sh@364 -- # (( target_space == 0 || target_space < requested_size )) 00:09:10.167 02:28:43 -- common/autotest_common.sh@367 -- # (( target_space >= requested_size )) 00:09:10.167 02:28:43 -- common/autotest_common.sh@369 -- # [[ overlay == tmpfs ]] 00:09:10.167 02:28:43 -- common/autotest_common.sh@369 -- # [[ overlay == ramfs ]] 00:09:10.167 02:28:43 -- common/autotest_common.sh@369 -- # [[ / == / ]] 00:09:10.167 02:28:43 -- common/autotest_common.sh@370 -- # new_size=7857709056 00:09:10.167 02:28:43 -- common/autotest_common.sh@371 -- # (( new_size * 100 / sizes[/] > 95 )) 00:09:10.167 02:28:43 -- common/autotest_common.sh@376 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:09:10.167 02:28:43 -- common/autotest_common.sh@376 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:09:10.167 02:28:43 -- common/autotest_common.sh@377 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:09:10.167 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:09:10.167 02:28:43 -- common/autotest_common.sh@378 -- # return 0 00:09:10.167 02:28:43 -- common/autotest_common.sh@1668 -- # set -o errtrace 00:09:10.167 02:28:43 -- common/autotest_common.sh@1669 -- # shopt -s extdebug 00:09:10.167 02:28:43 -- common/autotest_common.sh@1670 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:09:10.167 02:28:43 -- common/autotest_common.sh@1672 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:09:10.167 02:28:43 -- common/autotest_common.sh@1673 -- # true 00:09:10.167 02:28:43 -- common/autotest_common.sh@1675 -- # xtrace_fd 00:09:10.167 02:28:43 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:09:10.167 02:28:43 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:09:10.167 02:28:43 -- common/autotest_common.sh@27 -- # exec 00:09:10.167 02:28:43 -- common/autotest_common.sh@29 -- # exec 00:09:10.167 02:28:43 -- common/autotest_common.sh@31 -- # xtrace_restore 00:09:10.167 02:28:43 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:09:10.167 02:28:43 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:09:10.167 02:28:43 -- common/autotest_common.sh@18 -- # set -x 00:09:10.167 02:28:43 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:09:10.167 02:28:43 -- nvmf/common.sh@7 -- # uname -s 00:09:10.167 02:28:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:10.167 02:28:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:10.167 02:28:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:10.167 02:28:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:10.167 02:28:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:10.167 02:28:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:10.167 02:28:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:10.167 02:28:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:10.167 02:28:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:10.167 02:28:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:10.167 02:28:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:09:10.167 02:28:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:09:10.167 02:28:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:10.167 02:28:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:10.167 02:28:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:09:10.167 02:28:43 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:09:10.167 02:28:43 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:09:10.167 02:28:43 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:10.167 02:28:43 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:10.167 02:28:43 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:10.167 02:28:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:10.167 02:28:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:10.167 02:28:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:10.167 02:28:43 -- paths/export.sh@5 -- # export PATH 00:09:10.167 02:28:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:10.167 02:28:43 -- nvmf/common.sh@47 -- # : 0 00:09:10.167 02:28:43 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:09:10.167 02:28:43 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:09:10.167 02:28:43 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:09:10.167 02:28:43 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:10.167 02:28:43 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:10.167 02:28:43 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:09:10.167 02:28:43 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:09:10.167 02:28:43 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:09:10.167 02:28:43 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:09:10.167 02:28:43 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:09:10.167 02:28:43 -- target/filesystem.sh@15 -- # nvmftestinit 00:09:10.167 02:28:43 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:09:10.167 02:28:43 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:10.167 02:28:43 -- nvmf/common.sh@437 -- # prepare_net_devs 00:09:10.167 02:28:43 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:09:10.167 02:28:43 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:09:10.167 02:28:43 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:10.167 02:28:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:10.167 02:28:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:10.167 02:28:43 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:09:10.167 02:28:43 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:09:10.167 02:28:43 -- nvmf/common.sh@285 -- # xtrace_disable 00:09:10.167 02:28:43 -- common/autotest_common.sh@10 -- # set +x 00:09:15.442 02:28:49 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:15.442 02:28:49 -- nvmf/common.sh@291 -- # pci_devs=() 00:09:15.442 02:28:49 -- nvmf/common.sh@291 -- # local -a pci_devs 00:09:15.442 02:28:49 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:09:15.442 02:28:49 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:09:15.442 02:28:49 -- nvmf/common.sh@293 -- # pci_drivers=() 00:09:15.442 02:28:49 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:09:15.442 02:28:49 -- nvmf/common.sh@295 -- # net_devs=() 00:09:15.442 02:28:49 -- nvmf/common.sh@295 -- # local -ga net_devs 00:09:15.442 02:28:49 -- nvmf/common.sh@296 -- # e810=() 00:09:15.442 02:28:49 -- nvmf/common.sh@296 -- # local -ga e810 00:09:15.442 02:28:49 -- nvmf/common.sh@297 -- # x722=() 00:09:15.442 02:28:49 -- nvmf/common.sh@297 -- # local -ga x722 00:09:15.442 02:28:49 -- nvmf/common.sh@298 -- # mlx=() 00:09:15.442 02:28:49 -- nvmf/common.sh@298 -- # local -ga mlx 00:09:15.442 02:28:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:15.442 02:28:49 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:15.442 02:28:49 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:15.442 02:28:49 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:15.442 02:28:49 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:15.442 02:28:49 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:15.442 02:28:49 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:15.442 02:28:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:15.442 02:28:49 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:15.442 02:28:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:15.442 02:28:49 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:15.442 02:28:49 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:09:15.442 02:28:49 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:09:15.442 02:28:49 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:09:15.442 02:28:49 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:09:15.442 02:28:49 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:09:15.442 02:28:49 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:09:15.442 02:28:49 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:09:15.442 02:28:49 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:15.442 02:28:49 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:09:15.442 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:09:15.442 02:28:49 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:09:15.442 02:28:49 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:09:15.442 02:28:49 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:09:15.442 02:28:49 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:09:15.442 02:28:49 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:09:15.442 02:28:49 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:09:15.442 02:28:49 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:15.442 02:28:49 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:09:15.442 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:09:15.442 02:28:49 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:09:15.442 02:28:49 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:09:15.442 02:28:49 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:09:15.442 02:28:49 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:09:15.442 02:28:49 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:09:15.442 02:28:49 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:09:15.442 02:28:49 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:09:15.442 02:28:49 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:09:15.442 02:28:49 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:15.442 02:28:49 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:15.442 02:28:49 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:15.442 02:28:49 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:15.442 02:28:49 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:09:15.442 Found net devices under 0000:18:00.0: mlx_0_0 00:09:15.442 02:28:49 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:15.442 02:28:49 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:15.442 02:28:49 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:15.442 02:28:49 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:15.442 02:28:49 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:15.442 02:28:49 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:09:15.442 Found net devices under 0000:18:00.1: mlx_0_1 00:09:15.442 02:28:49 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:15.442 02:28:49 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:09:15.442 02:28:49 -- nvmf/common.sh@403 -- # is_hw=yes 00:09:15.442 02:28:49 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:09:15.442 02:28:49 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:09:15.442 02:28:49 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:09:15.442 02:28:49 -- nvmf/common.sh@409 -- # rdma_device_init 00:09:15.442 02:28:49 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:09:15.442 02:28:49 -- nvmf/common.sh@58 -- # uname 00:09:15.442 02:28:49 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:09:15.442 02:28:49 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:09:15.442 02:28:49 -- nvmf/common.sh@63 -- # modprobe ib_core 00:09:15.442 02:28:49 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:09:15.442 02:28:49 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:09:15.442 02:28:49 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:09:15.442 02:28:49 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:09:15.442 02:28:49 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:09:15.442 02:28:49 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:09:15.442 02:28:49 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:09:15.703 02:28:49 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:09:15.703 02:28:49 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:09:15.703 02:28:49 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:09:15.703 02:28:49 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:09:15.703 02:28:49 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:09:15.703 02:28:49 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:09:15.703 02:28:49 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:15.703 02:28:49 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:15.703 02:28:49 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:09:15.703 02:28:49 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:09:15.703 02:28:49 -- nvmf/common.sh@105 -- # continue 2 00:09:15.703 02:28:49 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:15.703 02:28:49 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:15.703 02:28:49 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:09:15.703 02:28:49 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:15.703 02:28:49 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:09:15.703 02:28:49 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:09:15.703 02:28:49 -- nvmf/common.sh@105 -- # continue 2 00:09:15.703 02:28:49 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:09:15.703 02:28:49 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:09:15.703 02:28:49 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:09:15.703 02:28:49 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:09:15.703 02:28:49 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:15.703 02:28:49 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:15.703 02:28:49 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:09:15.703 02:28:49 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:09:15.703 02:28:49 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:09:15.703 60: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:09:15.703 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:09:15.703 altname enp24s0f0np0 00:09:15.703 altname ens785f0np0 00:09:15.703 inet 192.168.100.8/24 scope global mlx_0_0 00:09:15.703 valid_lft forever preferred_lft forever 00:09:15.703 02:28:49 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:09:15.703 02:28:49 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:09:15.703 02:28:49 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:09:15.703 02:28:49 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:15.703 02:28:49 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:09:15.703 02:28:49 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:15.703 02:28:49 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:09:15.703 02:28:49 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:09:15.703 02:28:49 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:09:15.703 61: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:09:15.703 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:09:15.703 altname enp24s0f1np1 00:09:15.703 altname ens785f1np1 00:09:15.703 inet 192.168.100.9/24 scope global mlx_0_1 00:09:15.703 valid_lft forever preferred_lft forever 00:09:15.703 02:28:49 -- nvmf/common.sh@411 -- # return 0 00:09:15.703 02:28:49 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:09:15.703 02:28:49 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:09:15.703 02:28:49 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:09:15.703 02:28:49 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:09:15.703 02:28:49 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:09:15.703 02:28:49 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:09:15.703 02:28:49 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:09:15.703 02:28:49 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:09:15.703 02:28:49 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:09:15.703 02:28:49 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:09:15.703 02:28:49 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:15.703 02:28:49 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:15.703 02:28:49 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:09:15.703 02:28:49 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:09:15.703 02:28:49 -- nvmf/common.sh@105 -- # continue 2 00:09:15.703 02:28:49 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:15.703 02:28:49 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:15.703 02:28:49 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:09:15.703 02:28:49 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:15.703 02:28:49 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:09:15.703 02:28:49 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:09:15.703 02:28:49 -- nvmf/common.sh@105 -- # continue 2 00:09:15.703 02:28:49 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:09:15.703 02:28:49 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:09:15.703 02:28:49 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:09:15.703 02:28:49 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:09:15.703 02:28:49 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:15.703 02:28:49 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:15.703 02:28:49 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:09:15.703 02:28:49 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:09:15.703 02:28:49 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:09:15.703 02:28:49 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:09:15.703 02:28:49 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:15.703 02:28:49 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:15.703 02:28:49 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:09:15.703 192.168.100.9' 00:09:15.703 02:28:49 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:09:15.703 192.168.100.9' 00:09:15.703 02:28:49 -- nvmf/common.sh@446 -- # head -n 1 00:09:15.703 02:28:49 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:09:15.703 02:28:49 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:09:15.703 192.168.100.9' 00:09:15.703 02:28:49 -- nvmf/common.sh@447 -- # tail -n +2 00:09:15.703 02:28:49 -- nvmf/common.sh@447 -- # head -n 1 00:09:15.703 02:28:49 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:09:15.703 02:28:49 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:09:15.703 02:28:49 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:09:15.703 02:28:49 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:09:15.703 02:28:49 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:09:15.703 02:28:49 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:09:15.703 02:28:49 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:09:15.703 02:28:49 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:09:15.703 02:28:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:15.703 02:28:49 -- common/autotest_common.sh@10 -- # set +x 00:09:15.964 ************************************ 00:09:15.964 START TEST nvmf_filesystem_no_in_capsule 00:09:15.964 ************************************ 00:09:15.964 02:28:49 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_part 0 00:09:15.964 02:28:49 -- target/filesystem.sh@47 -- # in_capsule=0 00:09:15.964 02:28:49 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:09:15.964 02:28:49 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:09:15.964 02:28:49 -- common/autotest_common.sh@710 -- # xtrace_disable 00:09:15.964 02:28:49 -- common/autotest_common.sh@10 -- # set +x 00:09:15.964 02:28:49 -- nvmf/common.sh@470 -- # nvmfpid=1449176 00:09:15.964 02:28:49 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:15.964 02:28:49 -- nvmf/common.sh@471 -- # waitforlisten 1449176 00:09:15.964 02:28:49 -- common/autotest_common.sh@817 -- # '[' -z 1449176 ']' 00:09:15.964 02:28:49 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:15.964 02:28:49 -- common/autotest_common.sh@822 -- # local max_retries=100 00:09:15.964 02:28:49 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:15.964 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:15.964 02:28:49 -- common/autotest_common.sh@826 -- # xtrace_disable 00:09:15.964 02:28:49 -- common/autotest_common.sh@10 -- # set +x 00:09:15.964 [2024-04-27 02:28:49.480121] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:09:15.964 [2024-04-27 02:28:49.480176] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:15.964 EAL: No free 2048 kB hugepages reported on node 1 00:09:15.964 [2024-04-27 02:28:49.552892] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:16.224 [2024-04-27 02:28:49.643943] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:16.224 [2024-04-27 02:28:49.643987] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:16.224 [2024-04-27 02:28:49.643998] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:09:16.224 [2024-04-27 02:28:49.644007] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:09:16.224 [2024-04-27 02:28:49.644015] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:16.224 [2024-04-27 02:28:49.644070] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:16.224 [2024-04-27 02:28:49.644088] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:16.224 [2024-04-27 02:28:49.644172] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:16.224 [2024-04-27 02:28:49.644174] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:09:16.794 02:28:50 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:09:16.794 02:28:50 -- common/autotest_common.sh@850 -- # return 0 00:09:16.794 02:28:50 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:09:16.794 02:28:50 -- common/autotest_common.sh@716 -- # xtrace_disable 00:09:16.794 02:28:50 -- common/autotest_common.sh@10 -- # set +x 00:09:16.794 02:28:50 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:16.794 02:28:50 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:09:16.794 02:28:50 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -c 0 00:09:16.794 02:28:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:16.794 02:28:50 -- common/autotest_common.sh@10 -- # set +x 00:09:16.794 [2024-04-27 02:28:50.339394] rdma.c:2712:nvmf_rdma_create: *WARNING*: In capsule data size is set to 256, this is minimum size required to support msdbd=16 00:09:16.794 [2024-04-27 02:28:50.361129] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xabd4d0/0xac19c0) succeed. 00:09:16.794 [2024-04-27 02:28:50.371441] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xabeb10/0xb03050) succeed. 00:09:17.053 02:28:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:17.053 02:28:50 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:09:17.053 02:28:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:17.053 02:28:50 -- common/autotest_common.sh@10 -- # set +x 00:09:17.054 Malloc1 00:09:17.054 02:28:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:17.054 02:28:50 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:09:17.054 02:28:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:17.054 02:28:50 -- common/autotest_common.sh@10 -- # set +x 00:09:17.054 02:28:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:17.054 02:28:50 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:09:17.054 02:28:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:17.054 02:28:50 -- common/autotest_common.sh@10 -- # set +x 00:09:17.054 02:28:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:17.054 02:28:50 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:09:17.054 02:28:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:17.054 02:28:50 -- common/autotest_common.sh@10 -- # set +x 00:09:17.054 [2024-04-27 02:28:50.638242] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:09:17.054 02:28:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:17.054 02:28:50 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:09:17.054 02:28:50 -- common/autotest_common.sh@1364 -- # local bdev_name=Malloc1 00:09:17.054 02:28:50 -- common/autotest_common.sh@1365 -- # local bdev_info 00:09:17.054 02:28:50 -- common/autotest_common.sh@1366 -- # local bs 00:09:17.054 02:28:50 -- common/autotest_common.sh@1367 -- # local nb 00:09:17.054 02:28:50 -- common/autotest_common.sh@1368 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:09:17.054 02:28:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:17.054 02:28:50 -- common/autotest_common.sh@10 -- # set +x 00:09:17.054 02:28:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:17.054 02:28:50 -- common/autotest_common.sh@1368 -- # bdev_info='[ 00:09:17.054 { 00:09:17.054 "name": "Malloc1", 00:09:17.054 "aliases": [ 00:09:17.054 "37a7d596-8553-4678-818e-76215a58b4ef" 00:09:17.054 ], 00:09:17.054 "product_name": "Malloc disk", 00:09:17.054 "block_size": 512, 00:09:17.054 "num_blocks": 1048576, 00:09:17.054 "uuid": "37a7d596-8553-4678-818e-76215a58b4ef", 00:09:17.054 "assigned_rate_limits": { 00:09:17.054 "rw_ios_per_sec": 0, 00:09:17.054 "rw_mbytes_per_sec": 0, 00:09:17.054 "r_mbytes_per_sec": 0, 00:09:17.054 "w_mbytes_per_sec": 0 00:09:17.054 }, 00:09:17.054 "claimed": true, 00:09:17.054 "claim_type": "exclusive_write", 00:09:17.054 "zoned": false, 00:09:17.054 "supported_io_types": { 00:09:17.054 "read": true, 00:09:17.054 "write": true, 00:09:17.054 "unmap": true, 00:09:17.054 "write_zeroes": true, 00:09:17.054 "flush": true, 00:09:17.054 "reset": true, 00:09:17.054 "compare": false, 00:09:17.054 "compare_and_write": false, 00:09:17.054 "abort": true, 00:09:17.054 "nvme_admin": false, 00:09:17.054 "nvme_io": false 00:09:17.054 }, 00:09:17.054 "memory_domains": [ 00:09:17.054 { 00:09:17.054 "dma_device_id": "system", 00:09:17.054 "dma_device_type": 1 00:09:17.054 }, 00:09:17.054 { 00:09:17.054 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:09:17.054 "dma_device_type": 2 00:09:17.054 } 00:09:17.054 ], 00:09:17.054 "driver_specific": {} 00:09:17.054 } 00:09:17.054 ]' 00:09:17.054 02:28:50 -- common/autotest_common.sh@1369 -- # jq '.[] .block_size' 00:09:17.314 02:28:50 -- common/autotest_common.sh@1369 -- # bs=512 00:09:17.314 02:28:50 -- common/autotest_common.sh@1370 -- # jq '.[] .num_blocks' 00:09:17.314 02:28:50 -- common/autotest_common.sh@1370 -- # nb=1048576 00:09:17.314 02:28:50 -- common/autotest_common.sh@1373 -- # bdev_size=512 00:09:17.314 02:28:50 -- common/autotest_common.sh@1374 -- # echo 512 00:09:17.314 02:28:50 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:09:17.314 02:28:50 -- target/filesystem.sh@60 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:09:18.251 02:28:51 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:09:18.251 02:28:51 -- common/autotest_common.sh@1184 -- # local i=0 00:09:18.251 02:28:51 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:09:18.251 02:28:51 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:09:18.251 02:28:51 -- common/autotest_common.sh@1191 -- # sleep 2 00:09:20.158 02:28:53 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:09:20.158 02:28:53 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:09:20.158 02:28:53 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:09:20.442 02:28:53 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:09:20.442 02:28:53 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:09:20.442 02:28:53 -- common/autotest_common.sh@1194 -- # return 0 00:09:20.442 02:28:53 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:09:20.442 02:28:53 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:09:20.442 02:28:53 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:09:20.442 02:28:53 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:09:20.442 02:28:53 -- setup/common.sh@76 -- # local dev=nvme0n1 00:09:20.442 02:28:53 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:09:20.442 02:28:53 -- setup/common.sh@80 -- # echo 536870912 00:09:20.442 02:28:53 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:09:20.442 02:28:53 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:09:20.442 02:28:53 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:09:20.442 02:28:53 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:09:20.443 02:28:53 -- target/filesystem.sh@69 -- # partprobe 00:09:20.443 02:28:53 -- target/filesystem.sh@70 -- # sleep 1 00:09:21.382 02:28:54 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:09:21.382 02:28:54 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:09:21.382 02:28:54 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:09:21.382 02:28:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:21.382 02:28:54 -- common/autotest_common.sh@10 -- # set +x 00:09:21.642 ************************************ 00:09:21.642 START TEST filesystem_ext4 00:09:21.642 ************************************ 00:09:21.642 02:28:55 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create ext4 nvme0n1 00:09:21.642 02:28:55 -- target/filesystem.sh@18 -- # fstype=ext4 00:09:21.642 02:28:55 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:09:21.642 02:28:55 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:09:21.642 02:28:55 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:09:21.642 02:28:55 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:09:21.642 02:28:55 -- common/autotest_common.sh@914 -- # local i=0 00:09:21.642 02:28:55 -- common/autotest_common.sh@915 -- # local force 00:09:21.642 02:28:55 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:09:21.642 02:28:55 -- common/autotest_common.sh@918 -- # force=-F 00:09:21.642 02:28:55 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:09:21.642 mke2fs 1.46.5 (30-Dec-2021) 00:09:21.901 Discarding device blocks: 0/522240 done 00:09:21.901 Creating filesystem with 522240 1k blocks and 130560 inodes 00:09:21.901 Filesystem UUID: b50c45d4-0738-4a16-b99f-57dfb3c12b13 00:09:21.901 Superblock backups stored on blocks: 00:09:21.901 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:09:21.901 00:09:21.901 Allocating group tables: 0/64 done 00:09:21.901 Writing inode tables: 0/64 done 00:09:21.901 Creating journal (8192 blocks): done 00:09:21.901 Writing superblocks and filesystem accounting information: 0/64 done 00:09:21.901 00:09:21.901 02:28:55 -- common/autotest_common.sh@931 -- # return 0 00:09:21.901 02:28:55 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:09:21.901 02:28:55 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:09:21.901 02:28:55 -- target/filesystem.sh@25 -- # sync 00:09:21.901 02:28:55 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:09:21.901 02:28:55 -- target/filesystem.sh@27 -- # sync 00:09:21.901 02:28:55 -- target/filesystem.sh@29 -- # i=0 00:09:21.901 02:28:55 -- target/filesystem.sh@30 -- # umount /mnt/device 00:09:21.901 02:28:55 -- target/filesystem.sh@37 -- # kill -0 1449176 00:09:21.901 02:28:55 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:09:21.901 02:28:55 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:09:21.901 02:28:55 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:09:21.901 02:28:55 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:09:21.901 00:09:21.901 real 0m0.193s 00:09:21.901 user 0m0.019s 00:09:21.901 sys 0m0.078s 00:09:21.901 02:28:55 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:09:21.901 02:28:55 -- common/autotest_common.sh@10 -- # set +x 00:09:21.901 ************************************ 00:09:21.901 END TEST filesystem_ext4 00:09:21.901 ************************************ 00:09:21.901 02:28:55 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:09:21.901 02:28:55 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:09:21.901 02:28:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:21.901 02:28:55 -- common/autotest_common.sh@10 -- # set +x 00:09:22.162 ************************************ 00:09:22.162 START TEST filesystem_btrfs 00:09:22.162 ************************************ 00:09:22.162 02:28:55 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create btrfs nvme0n1 00:09:22.162 02:28:55 -- target/filesystem.sh@18 -- # fstype=btrfs 00:09:22.162 02:28:55 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:09:22.162 02:28:55 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:09:22.162 02:28:55 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:09:22.162 02:28:55 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:09:22.162 02:28:55 -- common/autotest_common.sh@914 -- # local i=0 00:09:22.162 02:28:55 -- common/autotest_common.sh@915 -- # local force 00:09:22.162 02:28:55 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:09:22.162 02:28:55 -- common/autotest_common.sh@920 -- # force=-f 00:09:22.162 02:28:55 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:09:22.162 btrfs-progs v6.6.2 00:09:22.162 See https://btrfs.readthedocs.io for more information. 00:09:22.162 00:09:22.162 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:09:22.162 NOTE: several default settings have changed in version 5.15, please make sure 00:09:22.162 this does not affect your deployments: 00:09:22.162 - DUP for metadata (-m dup) 00:09:22.162 - enabled no-holes (-O no-holes) 00:09:22.162 - enabled free-space-tree (-R free-space-tree) 00:09:22.162 00:09:22.162 Label: (null) 00:09:22.162 UUID: 3ece819d-978d-4bf3-a4e8-eb2081d51c71 00:09:22.162 Node size: 16384 00:09:22.162 Sector size: 4096 00:09:22.162 Filesystem size: 510.00MiB 00:09:22.162 Block group profiles: 00:09:22.162 Data: single 8.00MiB 00:09:22.162 Metadata: DUP 32.00MiB 00:09:22.162 System: DUP 8.00MiB 00:09:22.162 SSD detected: yes 00:09:22.162 Zoned device: no 00:09:22.162 Incompat features: extref, skinny-metadata, no-holes, free-space-tree 00:09:22.162 Runtime features: free-space-tree 00:09:22.162 Checksum: crc32c 00:09:22.162 Number of devices: 1 00:09:22.162 Devices: 00:09:22.162 ID SIZE PATH 00:09:22.162 1 510.00MiB /dev/nvme0n1p1 00:09:22.162 00:09:22.162 02:28:55 -- common/autotest_common.sh@931 -- # return 0 00:09:22.162 02:28:55 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:09:22.162 02:28:55 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:09:22.422 02:28:55 -- target/filesystem.sh@25 -- # sync 00:09:22.422 02:28:55 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:09:22.422 02:28:55 -- target/filesystem.sh@27 -- # sync 00:09:22.422 02:28:55 -- target/filesystem.sh@29 -- # i=0 00:09:22.422 02:28:55 -- target/filesystem.sh@30 -- # umount /mnt/device 00:09:22.422 02:28:55 -- target/filesystem.sh@37 -- # kill -0 1449176 00:09:22.422 02:28:55 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:09:22.422 02:28:55 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:09:22.422 02:28:55 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:09:22.422 02:28:55 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:09:22.422 00:09:22.422 real 0m0.275s 00:09:22.422 user 0m0.032s 00:09:22.422 sys 0m0.134s 00:09:22.422 02:28:55 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:09:22.422 02:28:55 -- common/autotest_common.sh@10 -- # set +x 00:09:22.422 ************************************ 00:09:22.422 END TEST filesystem_btrfs 00:09:22.422 ************************************ 00:09:22.422 02:28:55 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:09:22.422 02:28:55 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:09:22.422 02:28:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:22.422 02:28:55 -- common/autotest_common.sh@10 -- # set +x 00:09:22.682 ************************************ 00:09:22.682 START TEST filesystem_xfs 00:09:22.682 ************************************ 00:09:22.682 02:28:56 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create xfs nvme0n1 00:09:22.682 02:28:56 -- target/filesystem.sh@18 -- # fstype=xfs 00:09:22.682 02:28:56 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:09:22.682 02:28:56 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:09:22.682 02:28:56 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:09:22.682 02:28:56 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:09:22.682 02:28:56 -- common/autotest_common.sh@914 -- # local i=0 00:09:22.682 02:28:56 -- common/autotest_common.sh@915 -- # local force 00:09:22.682 02:28:56 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:09:22.682 02:28:56 -- common/autotest_common.sh@920 -- # force=-f 00:09:22.682 02:28:56 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:09:22.682 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:09:22.682 = sectsz=512 attr=2, projid32bit=1 00:09:22.682 = crc=1 finobt=1, sparse=1, rmapbt=0 00:09:22.682 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:09:22.682 data = bsize=4096 blocks=130560, imaxpct=25 00:09:22.682 = sunit=0 swidth=0 blks 00:09:22.682 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:09:22.682 log =internal log bsize=4096 blocks=16384, version=2 00:09:22.682 = sectsz=512 sunit=0 blks, lazy-count=1 00:09:22.682 realtime =none extsz=4096 blocks=0, rtextents=0 00:09:22.682 Discarding blocks...Done. 00:09:22.682 02:28:56 -- common/autotest_common.sh@931 -- # return 0 00:09:22.682 02:28:56 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:09:22.682 02:28:56 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:09:22.682 02:28:56 -- target/filesystem.sh@25 -- # sync 00:09:22.682 02:28:56 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:09:22.682 02:28:56 -- target/filesystem.sh@27 -- # sync 00:09:22.682 02:28:56 -- target/filesystem.sh@29 -- # i=0 00:09:22.682 02:28:56 -- target/filesystem.sh@30 -- # umount /mnt/device 00:09:22.682 02:28:56 -- target/filesystem.sh@37 -- # kill -0 1449176 00:09:22.682 02:28:56 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:09:22.682 02:28:56 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:09:22.682 02:28:56 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:09:22.682 02:28:56 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:09:22.682 00:09:22.682 real 0m0.223s 00:09:22.683 user 0m0.036s 00:09:22.683 sys 0m0.072s 00:09:22.683 02:28:56 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:09:22.683 02:28:56 -- common/autotest_common.sh@10 -- # set +x 00:09:22.683 ************************************ 00:09:22.683 END TEST filesystem_xfs 00:09:22.683 ************************************ 00:09:22.943 02:28:56 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:09:22.943 02:28:56 -- target/filesystem.sh@93 -- # sync 00:09:22.943 02:28:56 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:09:23.881 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:23.881 02:28:57 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:09:23.881 02:28:57 -- common/autotest_common.sh@1205 -- # local i=0 00:09:23.881 02:28:57 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:09:23.881 02:28:57 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:23.881 02:28:57 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:09:23.881 02:28:57 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:23.881 02:28:57 -- common/autotest_common.sh@1217 -- # return 0 00:09:23.881 02:28:57 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:09:23.881 02:28:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:23.881 02:28:57 -- common/autotest_common.sh@10 -- # set +x 00:09:23.881 02:28:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:23.881 02:28:57 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:09:23.881 02:28:57 -- target/filesystem.sh@101 -- # killprocess 1449176 00:09:23.881 02:28:57 -- common/autotest_common.sh@936 -- # '[' -z 1449176 ']' 00:09:23.881 02:28:57 -- common/autotest_common.sh@940 -- # kill -0 1449176 00:09:23.881 02:28:57 -- common/autotest_common.sh@941 -- # uname 00:09:23.881 02:28:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:09:23.881 02:28:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1449176 00:09:23.881 02:28:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:09:23.881 02:28:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:09:23.881 02:28:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1449176' 00:09:23.881 killing process with pid 1449176 00:09:23.882 02:28:57 -- common/autotest_common.sh@955 -- # kill 1449176 00:09:23.882 02:28:57 -- common/autotest_common.sh@960 -- # wait 1449176 00:09:23.882 [2024-04-27 02:28:57.468895] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:09:24.450 02:28:57 -- target/filesystem.sh@102 -- # nvmfpid= 00:09:24.451 00:09:24.451 real 0m8.457s 00:09:24.451 user 0m32.982s 00:09:24.451 sys 0m1.436s 00:09:24.451 02:28:57 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:09:24.451 02:28:57 -- common/autotest_common.sh@10 -- # set +x 00:09:24.451 ************************************ 00:09:24.451 END TEST nvmf_filesystem_no_in_capsule 00:09:24.451 ************************************ 00:09:24.451 02:28:57 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:09:24.451 02:28:57 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:09:24.451 02:28:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:24.451 02:28:57 -- common/autotest_common.sh@10 -- # set +x 00:09:24.451 ************************************ 00:09:24.451 START TEST nvmf_filesystem_in_capsule 00:09:24.451 ************************************ 00:09:24.451 02:28:58 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_part 4096 00:09:24.451 02:28:58 -- target/filesystem.sh@47 -- # in_capsule=4096 00:09:24.451 02:28:58 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:09:24.451 02:28:58 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:09:24.451 02:28:58 -- common/autotest_common.sh@710 -- # xtrace_disable 00:09:24.451 02:28:58 -- common/autotest_common.sh@10 -- # set +x 00:09:24.451 02:28:58 -- nvmf/common.sh@470 -- # nvmfpid=1450525 00:09:24.451 02:28:58 -- nvmf/common.sh@471 -- # waitforlisten 1450525 00:09:24.451 02:28:58 -- common/autotest_common.sh@817 -- # '[' -z 1450525 ']' 00:09:24.451 02:28:58 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:24.451 02:28:58 -- common/autotest_common.sh@822 -- # local max_retries=100 00:09:24.451 02:28:58 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:24.451 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:24.451 02:28:58 -- common/autotest_common.sh@826 -- # xtrace_disable 00:09:24.451 02:28:58 -- common/autotest_common.sh@10 -- # set +x 00:09:24.451 02:28:58 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:24.711 [2024-04-27 02:28:58.109229] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:09:24.711 [2024-04-27 02:28:58.109280] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:24.711 EAL: No free 2048 kB hugepages reported on node 1 00:09:24.711 [2024-04-27 02:28:58.181718] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:24.711 [2024-04-27 02:28:58.271954] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:24.711 [2024-04-27 02:28:58.271998] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:24.711 [2024-04-27 02:28:58.272008] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:09:24.711 [2024-04-27 02:28:58.272017] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:09:24.711 [2024-04-27 02:28:58.272025] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:24.711 [2024-04-27 02:28:58.272071] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:24.711 [2024-04-27 02:28:58.272158] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:24.711 [2024-04-27 02:28:58.272236] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:24.711 [2024-04-27 02:28:58.272237] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:09:25.649 02:28:58 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:09:25.649 02:28:58 -- common/autotest_common.sh@850 -- # return 0 00:09:25.649 02:28:58 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:09:25.649 02:28:58 -- common/autotest_common.sh@716 -- # xtrace_disable 00:09:25.649 02:28:58 -- common/autotest_common.sh@10 -- # set +x 00:09:25.650 02:28:58 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:25.650 02:28:58 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:09:25.650 02:28:58 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -c 4096 00:09:25.650 02:28:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:25.650 02:28:58 -- common/autotest_common.sh@10 -- # set +x 00:09:25.650 [2024-04-27 02:28:59.000265] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xc074d0/0xc0b9c0) succeed. 00:09:25.650 [2024-04-27 02:28:59.010711] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xc08b10/0xc4d050) succeed. 00:09:25.650 02:28:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:25.650 02:28:59 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:09:25.650 02:28:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:25.650 02:28:59 -- common/autotest_common.sh@10 -- # set +x 00:09:25.650 Malloc1 00:09:25.650 02:28:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:25.650 02:28:59 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:09:25.650 02:28:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:25.650 02:28:59 -- common/autotest_common.sh@10 -- # set +x 00:09:25.909 02:28:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:25.909 02:28:59 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:09:25.909 02:28:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:25.909 02:28:59 -- common/autotest_common.sh@10 -- # set +x 00:09:25.909 02:28:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:25.909 02:28:59 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:09:25.909 02:28:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:25.909 02:28:59 -- common/autotest_common.sh@10 -- # set +x 00:09:25.909 [2024-04-27 02:28:59.293926] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:09:25.909 02:28:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:25.909 02:28:59 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:09:25.909 02:28:59 -- common/autotest_common.sh@1364 -- # local bdev_name=Malloc1 00:09:25.909 02:28:59 -- common/autotest_common.sh@1365 -- # local bdev_info 00:09:25.909 02:28:59 -- common/autotest_common.sh@1366 -- # local bs 00:09:25.909 02:28:59 -- common/autotest_common.sh@1367 -- # local nb 00:09:25.909 02:28:59 -- common/autotest_common.sh@1368 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:09:25.909 02:28:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:25.909 02:28:59 -- common/autotest_common.sh@10 -- # set +x 00:09:25.909 02:28:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:25.909 02:28:59 -- common/autotest_common.sh@1368 -- # bdev_info='[ 00:09:25.909 { 00:09:25.909 "name": "Malloc1", 00:09:25.909 "aliases": [ 00:09:25.909 "bbbe4041-9842-4de6-b168-78b9c2666043" 00:09:25.909 ], 00:09:25.909 "product_name": "Malloc disk", 00:09:25.909 "block_size": 512, 00:09:25.909 "num_blocks": 1048576, 00:09:25.909 "uuid": "bbbe4041-9842-4de6-b168-78b9c2666043", 00:09:25.909 "assigned_rate_limits": { 00:09:25.909 "rw_ios_per_sec": 0, 00:09:25.909 "rw_mbytes_per_sec": 0, 00:09:25.909 "r_mbytes_per_sec": 0, 00:09:25.909 "w_mbytes_per_sec": 0 00:09:25.909 }, 00:09:25.909 "claimed": true, 00:09:25.909 "claim_type": "exclusive_write", 00:09:25.909 "zoned": false, 00:09:25.909 "supported_io_types": { 00:09:25.909 "read": true, 00:09:25.909 "write": true, 00:09:25.909 "unmap": true, 00:09:25.909 "write_zeroes": true, 00:09:25.909 "flush": true, 00:09:25.909 "reset": true, 00:09:25.909 "compare": false, 00:09:25.909 "compare_and_write": false, 00:09:25.909 "abort": true, 00:09:25.909 "nvme_admin": false, 00:09:25.909 "nvme_io": false 00:09:25.909 }, 00:09:25.909 "memory_domains": [ 00:09:25.909 { 00:09:25.909 "dma_device_id": "system", 00:09:25.909 "dma_device_type": 1 00:09:25.909 }, 00:09:25.909 { 00:09:25.909 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:09:25.909 "dma_device_type": 2 00:09:25.909 } 00:09:25.909 ], 00:09:25.909 "driver_specific": {} 00:09:25.909 } 00:09:25.909 ]' 00:09:25.909 02:28:59 -- common/autotest_common.sh@1369 -- # jq '.[] .block_size' 00:09:25.909 02:28:59 -- common/autotest_common.sh@1369 -- # bs=512 00:09:25.909 02:28:59 -- common/autotest_common.sh@1370 -- # jq '.[] .num_blocks' 00:09:25.909 02:28:59 -- common/autotest_common.sh@1370 -- # nb=1048576 00:09:25.909 02:28:59 -- common/autotest_common.sh@1373 -- # bdev_size=512 00:09:25.909 02:28:59 -- common/autotest_common.sh@1374 -- # echo 512 00:09:25.909 02:28:59 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:09:25.909 02:28:59 -- target/filesystem.sh@60 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:09:26.848 02:29:00 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:09:26.848 02:29:00 -- common/autotest_common.sh@1184 -- # local i=0 00:09:26.848 02:29:00 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:09:26.848 02:29:00 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:09:26.848 02:29:00 -- common/autotest_common.sh@1191 -- # sleep 2 00:09:29.385 02:29:02 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:09:29.385 02:29:02 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:09:29.385 02:29:02 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:09:29.385 02:29:02 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:09:29.385 02:29:02 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:09:29.385 02:29:02 -- common/autotest_common.sh@1194 -- # return 0 00:09:29.385 02:29:02 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:09:29.385 02:29:02 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:09:29.385 02:29:02 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:09:29.385 02:29:02 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:09:29.385 02:29:02 -- setup/common.sh@76 -- # local dev=nvme0n1 00:09:29.385 02:29:02 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:09:29.385 02:29:02 -- setup/common.sh@80 -- # echo 536870912 00:09:29.386 02:29:02 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:09:29.386 02:29:02 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:09:29.386 02:29:02 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:09:29.386 02:29:02 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:09:29.386 02:29:02 -- target/filesystem.sh@69 -- # partprobe 00:09:29.386 02:29:02 -- target/filesystem.sh@70 -- # sleep 1 00:09:30.323 02:29:03 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:09:30.323 02:29:03 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:09:30.323 02:29:03 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:09:30.323 02:29:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:30.323 02:29:03 -- common/autotest_common.sh@10 -- # set +x 00:09:30.323 ************************************ 00:09:30.323 START TEST filesystem_in_capsule_ext4 00:09:30.323 ************************************ 00:09:30.323 02:29:03 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create ext4 nvme0n1 00:09:30.323 02:29:03 -- target/filesystem.sh@18 -- # fstype=ext4 00:09:30.323 02:29:03 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:09:30.324 02:29:03 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:09:30.324 02:29:03 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:09:30.324 02:29:03 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:09:30.324 02:29:03 -- common/autotest_common.sh@914 -- # local i=0 00:09:30.324 02:29:03 -- common/autotest_common.sh@915 -- # local force 00:09:30.324 02:29:03 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:09:30.324 02:29:03 -- common/autotest_common.sh@918 -- # force=-F 00:09:30.324 02:29:03 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:09:30.324 mke2fs 1.46.5 (30-Dec-2021) 00:09:30.324 Discarding device blocks: 0/522240 done 00:09:30.324 Creating filesystem with 522240 1k blocks and 130560 inodes 00:09:30.324 Filesystem UUID: b8be757b-f827-4172-8b18-8ba7e7c14049 00:09:30.324 Superblock backups stored on blocks: 00:09:30.324 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:09:30.324 00:09:30.324 Allocating group tables: 0/64 done 00:09:30.324 Writing inode tables: 0/64 done 00:09:30.324 Creating journal (8192 blocks): done 00:09:30.324 Writing superblocks and filesystem accounting information: 0/64 done 00:09:30.324 00:09:30.324 02:29:03 -- common/autotest_common.sh@931 -- # return 0 00:09:30.324 02:29:03 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:09:30.324 02:29:03 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:09:30.324 02:29:03 -- target/filesystem.sh@25 -- # sync 00:09:30.324 02:29:03 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:09:30.324 02:29:03 -- target/filesystem.sh@27 -- # sync 00:09:30.324 02:29:03 -- target/filesystem.sh@29 -- # i=0 00:09:30.324 02:29:03 -- target/filesystem.sh@30 -- # umount /mnt/device 00:09:30.582 02:29:03 -- target/filesystem.sh@37 -- # kill -0 1450525 00:09:30.582 02:29:03 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:09:30.582 02:29:03 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:09:30.582 02:29:03 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:09:30.582 02:29:03 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:09:30.582 00:09:30.582 real 0m0.208s 00:09:30.582 user 0m0.035s 00:09:30.582 sys 0m0.071s 00:09:30.582 02:29:03 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:09:30.582 02:29:03 -- common/autotest_common.sh@10 -- # set +x 00:09:30.582 ************************************ 00:09:30.582 END TEST filesystem_in_capsule_ext4 00:09:30.582 ************************************ 00:09:30.582 02:29:04 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:09:30.582 02:29:04 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:09:30.582 02:29:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:30.582 02:29:04 -- common/autotest_common.sh@10 -- # set +x 00:09:30.841 ************************************ 00:09:30.841 START TEST filesystem_in_capsule_btrfs 00:09:30.841 ************************************ 00:09:30.841 02:29:04 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create btrfs nvme0n1 00:09:30.841 02:29:04 -- target/filesystem.sh@18 -- # fstype=btrfs 00:09:30.841 02:29:04 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:09:30.841 02:29:04 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:09:30.841 02:29:04 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:09:30.841 02:29:04 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:09:30.841 02:29:04 -- common/autotest_common.sh@914 -- # local i=0 00:09:30.841 02:29:04 -- common/autotest_common.sh@915 -- # local force 00:09:30.841 02:29:04 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:09:30.841 02:29:04 -- common/autotest_common.sh@920 -- # force=-f 00:09:30.841 02:29:04 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:09:30.841 btrfs-progs v6.6.2 00:09:30.841 See https://btrfs.readthedocs.io for more information. 00:09:30.841 00:09:30.841 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:09:30.841 NOTE: several default settings have changed in version 5.15, please make sure 00:09:30.841 this does not affect your deployments: 00:09:30.841 - DUP for metadata (-m dup) 00:09:30.841 - enabled no-holes (-O no-holes) 00:09:30.841 - enabled free-space-tree (-R free-space-tree) 00:09:30.841 00:09:30.841 Label: (null) 00:09:30.841 UUID: 604d84ac-a232-4cbd-b8d8-e582953f895f 00:09:30.841 Node size: 16384 00:09:30.841 Sector size: 4096 00:09:30.841 Filesystem size: 510.00MiB 00:09:30.841 Block group profiles: 00:09:30.841 Data: single 8.00MiB 00:09:30.841 Metadata: DUP 32.00MiB 00:09:30.841 System: DUP 8.00MiB 00:09:30.841 SSD detected: yes 00:09:30.841 Zoned device: no 00:09:30.841 Incompat features: extref, skinny-metadata, no-holes, free-space-tree 00:09:30.841 Runtime features: free-space-tree 00:09:30.841 Checksum: crc32c 00:09:30.841 Number of devices: 1 00:09:30.841 Devices: 00:09:30.841 ID SIZE PATH 00:09:30.841 1 510.00MiB /dev/nvme0n1p1 00:09:30.841 00:09:30.841 02:29:04 -- common/autotest_common.sh@931 -- # return 0 00:09:30.841 02:29:04 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:09:30.841 02:29:04 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:09:30.841 02:29:04 -- target/filesystem.sh@25 -- # sync 00:09:30.841 02:29:04 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:09:30.841 02:29:04 -- target/filesystem.sh@27 -- # sync 00:09:30.841 02:29:04 -- target/filesystem.sh@29 -- # i=0 00:09:30.841 02:29:04 -- target/filesystem.sh@30 -- # umount /mnt/device 00:09:30.841 02:29:04 -- target/filesystem.sh@37 -- # kill -0 1450525 00:09:30.841 02:29:04 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:09:30.841 02:29:04 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:09:31.100 02:29:04 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:09:31.100 02:29:04 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:09:31.100 00:09:31.100 real 0m0.266s 00:09:31.100 user 0m0.035s 00:09:31.100 sys 0m0.128s 00:09:31.100 02:29:04 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:09:31.100 02:29:04 -- common/autotest_common.sh@10 -- # set +x 00:09:31.100 ************************************ 00:09:31.100 END TEST filesystem_in_capsule_btrfs 00:09:31.100 ************************************ 00:09:31.100 02:29:04 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:09:31.100 02:29:04 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:09:31.100 02:29:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:31.100 02:29:04 -- common/autotest_common.sh@10 -- # set +x 00:09:31.100 ************************************ 00:09:31.100 START TEST filesystem_in_capsule_xfs 00:09:31.100 ************************************ 00:09:31.100 02:29:04 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create xfs nvme0n1 00:09:31.100 02:29:04 -- target/filesystem.sh@18 -- # fstype=xfs 00:09:31.100 02:29:04 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:09:31.100 02:29:04 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:09:31.100 02:29:04 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:09:31.100 02:29:04 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:09:31.100 02:29:04 -- common/autotest_common.sh@914 -- # local i=0 00:09:31.100 02:29:04 -- common/autotest_common.sh@915 -- # local force 00:09:31.100 02:29:04 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:09:31.100 02:29:04 -- common/autotest_common.sh@920 -- # force=-f 00:09:31.100 02:29:04 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:09:31.360 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:09:31.360 = sectsz=512 attr=2, projid32bit=1 00:09:31.360 = crc=1 finobt=1, sparse=1, rmapbt=0 00:09:31.360 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:09:31.360 data = bsize=4096 blocks=130560, imaxpct=25 00:09:31.360 = sunit=0 swidth=0 blks 00:09:31.360 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:09:31.360 log =internal log bsize=4096 blocks=16384, version=2 00:09:31.360 = sectsz=512 sunit=0 blks, lazy-count=1 00:09:31.360 realtime =none extsz=4096 blocks=0, rtextents=0 00:09:31.360 Discarding blocks...Done. 00:09:31.360 02:29:04 -- common/autotest_common.sh@931 -- # return 0 00:09:31.360 02:29:04 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:09:31.360 02:29:04 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:09:31.360 02:29:04 -- target/filesystem.sh@25 -- # sync 00:09:31.360 02:29:04 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:09:31.360 02:29:04 -- target/filesystem.sh@27 -- # sync 00:09:31.360 02:29:04 -- target/filesystem.sh@29 -- # i=0 00:09:31.360 02:29:04 -- target/filesystem.sh@30 -- # umount /mnt/device 00:09:31.360 02:29:04 -- target/filesystem.sh@37 -- # kill -0 1450525 00:09:31.360 02:29:04 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:09:31.360 02:29:04 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:09:31.360 02:29:04 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:09:31.360 02:29:04 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:09:31.360 00:09:31.360 real 0m0.209s 00:09:31.360 user 0m0.028s 00:09:31.360 sys 0m0.076s 00:09:31.360 02:29:04 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:09:31.360 02:29:04 -- common/autotest_common.sh@10 -- # set +x 00:09:31.360 ************************************ 00:09:31.360 END TEST filesystem_in_capsule_xfs 00:09:31.360 ************************************ 00:09:31.360 02:29:04 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:09:31.360 02:29:04 -- target/filesystem.sh@93 -- # sync 00:09:31.360 02:29:04 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:09:32.740 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:32.740 02:29:05 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:09:32.740 02:29:05 -- common/autotest_common.sh@1205 -- # local i=0 00:09:32.740 02:29:05 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:09:32.740 02:29:05 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:32.740 02:29:05 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:09:32.740 02:29:05 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:32.740 02:29:05 -- common/autotest_common.sh@1217 -- # return 0 00:09:32.740 02:29:05 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:09:32.740 02:29:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:32.740 02:29:05 -- common/autotest_common.sh@10 -- # set +x 00:09:32.740 02:29:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:32.740 02:29:05 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:09:32.740 02:29:05 -- target/filesystem.sh@101 -- # killprocess 1450525 00:09:32.740 02:29:05 -- common/autotest_common.sh@936 -- # '[' -z 1450525 ']' 00:09:32.740 02:29:05 -- common/autotest_common.sh@940 -- # kill -0 1450525 00:09:32.740 02:29:05 -- common/autotest_common.sh@941 -- # uname 00:09:32.740 02:29:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:09:32.740 02:29:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1450525 00:09:32.740 02:29:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:09:32.740 02:29:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:09:32.740 02:29:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1450525' 00:09:32.740 killing process with pid 1450525 00:09:32.740 02:29:06 -- common/autotest_common.sh@955 -- # kill 1450525 00:09:32.740 02:29:06 -- common/autotest_common.sh@960 -- # wait 1450525 00:09:32.740 [2024-04-27 02:29:06.143784] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:09:32.999 02:29:06 -- target/filesystem.sh@102 -- # nvmfpid= 00:09:32.999 00:09:32.999 real 0m8.502s 00:09:32.999 user 0m33.071s 00:09:32.999 sys 0m1.490s 00:09:32.999 02:29:06 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:09:32.999 02:29:06 -- common/autotest_common.sh@10 -- # set +x 00:09:32.999 ************************************ 00:09:32.999 END TEST nvmf_filesystem_in_capsule 00:09:32.999 ************************************ 00:09:32.999 02:29:06 -- target/filesystem.sh@108 -- # nvmftestfini 00:09:32.999 02:29:06 -- nvmf/common.sh@477 -- # nvmfcleanup 00:09:32.999 02:29:06 -- nvmf/common.sh@117 -- # sync 00:09:33.000 02:29:06 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:09:33.000 02:29:06 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:09:33.000 02:29:06 -- nvmf/common.sh@120 -- # set +e 00:09:33.000 02:29:06 -- nvmf/common.sh@121 -- # for i in {1..20} 00:09:33.000 02:29:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:09:33.000 rmmod nvme_rdma 00:09:33.259 rmmod nvme_fabrics 00:09:33.259 02:29:06 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:09:33.259 02:29:06 -- nvmf/common.sh@124 -- # set -e 00:09:33.259 02:29:06 -- nvmf/common.sh@125 -- # return 0 00:09:33.259 02:29:06 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:09:33.259 02:29:06 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:09:33.259 02:29:06 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:09:33.259 00:09:33.259 real 0m23.467s 00:09:33.259 user 1m7.890s 00:09:33.259 sys 0m7.715s 00:09:33.259 02:29:06 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:09:33.259 02:29:06 -- common/autotest_common.sh@10 -- # set +x 00:09:33.259 ************************************ 00:09:33.259 END TEST nvmf_filesystem 00:09:33.259 ************************************ 00:09:33.259 02:29:06 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=rdma 00:09:33.259 02:29:06 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:09:33.259 02:29:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:33.259 02:29:06 -- common/autotest_common.sh@10 -- # set +x 00:09:33.259 ************************************ 00:09:33.259 START TEST nvmf_discovery 00:09:33.259 ************************************ 00:09:33.259 02:29:06 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=rdma 00:09:33.519 * Looking for test storage... 00:09:33.519 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:09:33.519 02:29:06 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:09:33.519 02:29:06 -- nvmf/common.sh@7 -- # uname -s 00:09:33.519 02:29:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:33.519 02:29:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:33.519 02:29:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:33.519 02:29:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:33.519 02:29:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:33.519 02:29:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:33.519 02:29:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:33.519 02:29:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:33.519 02:29:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:33.519 02:29:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:33.519 02:29:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:09:33.519 02:29:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:09:33.519 02:29:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:33.519 02:29:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:33.519 02:29:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:09:33.519 02:29:06 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:09:33.519 02:29:06 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:09:33.519 02:29:06 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:33.519 02:29:06 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:33.519 02:29:06 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:33.519 02:29:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:33.519 02:29:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:33.519 02:29:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:33.519 02:29:06 -- paths/export.sh@5 -- # export PATH 00:09:33.519 02:29:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:33.519 02:29:06 -- nvmf/common.sh@47 -- # : 0 00:09:33.519 02:29:06 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:09:33.519 02:29:06 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:09:33.519 02:29:06 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:09:33.519 02:29:06 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:33.519 02:29:06 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:33.519 02:29:06 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:09:33.519 02:29:06 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:09:33.519 02:29:06 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:09:33.520 02:29:06 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:09:33.520 02:29:06 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:09:33.520 02:29:06 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:09:33.520 02:29:06 -- target/discovery.sh@15 -- # hash nvme 00:09:33.520 02:29:06 -- target/discovery.sh@20 -- # nvmftestinit 00:09:33.520 02:29:06 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:09:33.520 02:29:06 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:33.520 02:29:06 -- nvmf/common.sh@437 -- # prepare_net_devs 00:09:33.520 02:29:06 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:09:33.520 02:29:06 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:09:33.520 02:29:06 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:33.520 02:29:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:33.520 02:29:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:33.520 02:29:06 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:09:33.520 02:29:06 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:09:33.520 02:29:06 -- nvmf/common.sh@285 -- # xtrace_disable 00:09:33.520 02:29:06 -- common/autotest_common.sh@10 -- # set +x 00:09:38.801 02:29:12 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:38.801 02:29:12 -- nvmf/common.sh@291 -- # pci_devs=() 00:09:38.801 02:29:12 -- nvmf/common.sh@291 -- # local -a pci_devs 00:09:38.801 02:29:12 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:09:38.802 02:29:12 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:09:38.802 02:29:12 -- nvmf/common.sh@293 -- # pci_drivers=() 00:09:38.802 02:29:12 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:09:38.802 02:29:12 -- nvmf/common.sh@295 -- # net_devs=() 00:09:38.802 02:29:12 -- nvmf/common.sh@295 -- # local -ga net_devs 00:09:38.802 02:29:12 -- nvmf/common.sh@296 -- # e810=() 00:09:38.802 02:29:12 -- nvmf/common.sh@296 -- # local -ga e810 00:09:38.802 02:29:12 -- nvmf/common.sh@297 -- # x722=() 00:09:38.802 02:29:12 -- nvmf/common.sh@297 -- # local -ga x722 00:09:38.802 02:29:12 -- nvmf/common.sh@298 -- # mlx=() 00:09:38.802 02:29:12 -- nvmf/common.sh@298 -- # local -ga mlx 00:09:38.802 02:29:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:38.802 02:29:12 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:38.802 02:29:12 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:38.802 02:29:12 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:38.802 02:29:12 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:38.802 02:29:12 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:38.802 02:29:12 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:38.802 02:29:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:38.802 02:29:12 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:38.802 02:29:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:38.802 02:29:12 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:38.802 02:29:12 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:09:38.802 02:29:12 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:09:38.802 02:29:12 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:09:38.802 02:29:12 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:09:38.802 02:29:12 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:09:38.802 02:29:12 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:09:38.802 02:29:12 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:09:38.802 02:29:12 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:38.802 02:29:12 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:09:38.802 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:09:38.802 02:29:12 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:09:38.802 02:29:12 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:09:38.802 02:29:12 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:09:38.802 02:29:12 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:09:38.802 02:29:12 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:09:38.802 02:29:12 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:09:38.802 02:29:12 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:38.802 02:29:12 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:09:38.802 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:09:38.802 02:29:12 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:09:38.802 02:29:12 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:09:38.802 02:29:12 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:09:38.802 02:29:12 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:09:38.802 02:29:12 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:09:38.802 02:29:12 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:09:38.802 02:29:12 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:09:38.802 02:29:12 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:09:38.802 02:29:12 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:38.802 02:29:12 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:38.802 02:29:12 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:38.802 02:29:12 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:38.802 02:29:12 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:09:38.802 Found net devices under 0000:18:00.0: mlx_0_0 00:09:38.802 02:29:12 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:38.802 02:29:12 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:38.802 02:29:12 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:38.802 02:29:12 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:38.802 02:29:12 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:38.802 02:29:12 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:09:38.802 Found net devices under 0000:18:00.1: mlx_0_1 00:09:38.802 02:29:12 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:38.802 02:29:12 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:09:38.802 02:29:12 -- nvmf/common.sh@403 -- # is_hw=yes 00:09:38.802 02:29:12 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:09:38.802 02:29:12 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:09:38.802 02:29:12 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:09:38.802 02:29:12 -- nvmf/common.sh@409 -- # rdma_device_init 00:09:38.802 02:29:12 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:09:38.802 02:29:12 -- nvmf/common.sh@58 -- # uname 00:09:38.802 02:29:12 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:09:38.802 02:29:12 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:09:38.802 02:29:12 -- nvmf/common.sh@63 -- # modprobe ib_core 00:09:38.802 02:29:12 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:09:38.802 02:29:12 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:09:38.802 02:29:12 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:09:38.802 02:29:12 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:09:38.802 02:29:12 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:09:38.802 02:29:12 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:09:38.802 02:29:12 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:09:38.802 02:29:12 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:09:38.802 02:29:12 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:09:38.802 02:29:12 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:09:38.802 02:29:12 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:09:38.802 02:29:12 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:09:39.063 02:29:12 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:09:39.063 02:29:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:39.063 02:29:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:39.063 02:29:12 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:09:39.063 02:29:12 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:09:39.063 02:29:12 -- nvmf/common.sh@105 -- # continue 2 00:09:39.063 02:29:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:39.063 02:29:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:39.063 02:29:12 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:09:39.063 02:29:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:39.063 02:29:12 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:09:39.063 02:29:12 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:09:39.063 02:29:12 -- nvmf/common.sh@105 -- # continue 2 00:09:39.063 02:29:12 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:09:39.063 02:29:12 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:09:39.063 02:29:12 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:09:39.063 02:29:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:09:39.063 02:29:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:39.063 02:29:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:39.063 02:29:12 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:09:39.063 02:29:12 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:09:39.063 02:29:12 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:09:39.063 60: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:09:39.063 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:09:39.063 altname enp24s0f0np0 00:09:39.063 altname ens785f0np0 00:09:39.063 inet 192.168.100.8/24 scope global mlx_0_0 00:09:39.063 valid_lft forever preferred_lft forever 00:09:39.063 02:29:12 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:09:39.063 02:29:12 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:09:39.063 02:29:12 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:09:39.063 02:29:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:09:39.063 02:29:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:39.063 02:29:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:39.063 02:29:12 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:09:39.063 02:29:12 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:09:39.063 02:29:12 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:09:39.063 61: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:09:39.063 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:09:39.063 altname enp24s0f1np1 00:09:39.063 altname ens785f1np1 00:09:39.063 inet 192.168.100.9/24 scope global mlx_0_1 00:09:39.063 valid_lft forever preferred_lft forever 00:09:39.063 02:29:12 -- nvmf/common.sh@411 -- # return 0 00:09:39.063 02:29:12 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:09:39.063 02:29:12 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:09:39.063 02:29:12 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:09:39.063 02:29:12 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:09:39.063 02:29:12 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:09:39.063 02:29:12 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:09:39.063 02:29:12 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:09:39.063 02:29:12 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:09:39.063 02:29:12 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:09:39.063 02:29:12 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:09:39.063 02:29:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:39.063 02:29:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:39.063 02:29:12 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:09:39.063 02:29:12 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:09:39.063 02:29:12 -- nvmf/common.sh@105 -- # continue 2 00:09:39.063 02:29:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:39.063 02:29:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:39.063 02:29:12 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:09:39.063 02:29:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:39.063 02:29:12 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:09:39.063 02:29:12 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:09:39.063 02:29:12 -- nvmf/common.sh@105 -- # continue 2 00:09:39.063 02:29:12 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:09:39.063 02:29:12 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:09:39.063 02:29:12 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:09:39.063 02:29:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:39.063 02:29:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:09:39.063 02:29:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:39.063 02:29:12 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:09:39.063 02:29:12 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:09:39.063 02:29:12 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:09:39.063 02:29:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:09:39.063 02:29:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:39.063 02:29:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:39.063 02:29:12 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:09:39.063 192.168.100.9' 00:09:39.063 02:29:12 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:09:39.063 192.168.100.9' 00:09:39.063 02:29:12 -- nvmf/common.sh@446 -- # head -n 1 00:09:39.063 02:29:12 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:09:39.063 02:29:12 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:09:39.063 192.168.100.9' 00:09:39.063 02:29:12 -- nvmf/common.sh@447 -- # head -n 1 00:09:39.063 02:29:12 -- nvmf/common.sh@447 -- # tail -n +2 00:09:39.063 02:29:12 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:09:39.063 02:29:12 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:09:39.063 02:29:12 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:09:39.063 02:29:12 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:09:39.063 02:29:12 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:09:39.063 02:29:12 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:09:39.063 02:29:12 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:09:39.063 02:29:12 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:09:39.063 02:29:12 -- common/autotest_common.sh@710 -- # xtrace_disable 00:09:39.063 02:29:12 -- common/autotest_common.sh@10 -- # set +x 00:09:39.063 02:29:12 -- nvmf/common.sh@470 -- # nvmfpid=1454741 00:09:39.063 02:29:12 -- nvmf/common.sh@471 -- # waitforlisten 1454741 00:09:39.063 02:29:12 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:39.063 02:29:12 -- common/autotest_common.sh@817 -- # '[' -z 1454741 ']' 00:09:39.063 02:29:12 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:39.063 02:29:12 -- common/autotest_common.sh@822 -- # local max_retries=100 00:09:39.063 02:29:12 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:39.063 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:39.063 02:29:12 -- common/autotest_common.sh@826 -- # xtrace_disable 00:09:39.063 02:29:12 -- common/autotest_common.sh@10 -- # set +x 00:09:39.063 [2024-04-27 02:29:12.636765] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:09:39.063 [2024-04-27 02:29:12.636824] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:39.063 EAL: No free 2048 kB hugepages reported on node 1 00:09:39.323 [2024-04-27 02:29:12.705178] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:39.323 [2024-04-27 02:29:12.794106] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:39.323 [2024-04-27 02:29:12.794155] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:39.323 [2024-04-27 02:29:12.794164] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:09:39.323 [2024-04-27 02:29:12.794188] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:09:39.323 [2024-04-27 02:29:12.794196] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:39.323 [2024-04-27 02:29:12.794266] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:39.323 [2024-04-27 02:29:12.794329] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:39.323 [2024-04-27 02:29:12.794411] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:39.323 [2024-04-27 02:29:12.794413] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:09:39.891 02:29:13 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:09:39.891 02:29:13 -- common/autotest_common.sh@850 -- # return 0 00:09:39.891 02:29:13 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:09:39.891 02:29:13 -- common/autotest_common.sh@716 -- # xtrace_disable 00:09:39.891 02:29:13 -- common/autotest_common.sh@10 -- # set +x 00:09:39.891 02:29:13 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:39.891 02:29:13 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:09:39.891 02:29:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:39.891 02:29:13 -- common/autotest_common.sh@10 -- # set +x 00:09:40.151 [2024-04-27 02:29:13.531585] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x8524d0/0x8569c0) succeed. 00:09:40.151 [2024-04-27 02:29:13.542067] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x853b10/0x898050) succeed. 00:09:40.151 02:29:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:40.151 02:29:13 -- target/discovery.sh@26 -- # seq 1 4 00:09:40.151 02:29:13 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:09:40.151 02:29:13 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:09:40.151 02:29:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:40.151 02:29:13 -- common/autotest_common.sh@10 -- # set +x 00:09:40.151 Null1 00:09:40.151 02:29:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:40.151 02:29:13 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:09:40.151 02:29:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:40.151 02:29:13 -- common/autotest_common.sh@10 -- # set +x 00:09:40.151 02:29:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:40.151 02:29:13 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:09:40.151 02:29:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:40.151 02:29:13 -- common/autotest_common.sh@10 -- # set +x 00:09:40.151 02:29:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:40.151 02:29:13 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:09:40.151 02:29:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:40.151 02:29:13 -- common/autotest_common.sh@10 -- # set +x 00:09:40.151 [2024-04-27 02:29:13.714278] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:09:40.151 02:29:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:40.151 02:29:13 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:09:40.151 02:29:13 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:09:40.151 02:29:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:40.151 02:29:13 -- common/autotest_common.sh@10 -- # set +x 00:09:40.151 Null2 00:09:40.151 02:29:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:40.151 02:29:13 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:09:40.151 02:29:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:40.151 02:29:13 -- common/autotest_common.sh@10 -- # set +x 00:09:40.151 02:29:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:40.151 02:29:13 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:09:40.151 02:29:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:40.151 02:29:13 -- common/autotest_common.sh@10 -- # set +x 00:09:40.151 02:29:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:40.151 02:29:13 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t rdma -a 192.168.100.8 -s 4420 00:09:40.151 02:29:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:40.151 02:29:13 -- common/autotest_common.sh@10 -- # set +x 00:09:40.151 02:29:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:40.151 02:29:13 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:09:40.151 02:29:13 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:09:40.151 02:29:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:40.151 02:29:13 -- common/autotest_common.sh@10 -- # set +x 00:09:40.151 Null3 00:09:40.151 02:29:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:40.151 02:29:13 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:09:40.151 02:29:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:40.151 02:29:13 -- common/autotest_common.sh@10 -- # set +x 00:09:40.151 02:29:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:40.151 02:29:13 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:09:40.152 02:29:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:40.152 02:29:13 -- common/autotest_common.sh@10 -- # set +x 00:09:40.419 02:29:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:40.419 02:29:13 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t rdma -a 192.168.100.8 -s 4420 00:09:40.419 02:29:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:40.419 02:29:13 -- common/autotest_common.sh@10 -- # set +x 00:09:40.419 02:29:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:40.419 02:29:13 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:09:40.419 02:29:13 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:09:40.419 02:29:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:40.419 02:29:13 -- common/autotest_common.sh@10 -- # set +x 00:09:40.419 Null4 00:09:40.419 02:29:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:40.419 02:29:13 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:09:40.419 02:29:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:40.419 02:29:13 -- common/autotest_common.sh@10 -- # set +x 00:09:40.419 02:29:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:40.419 02:29:13 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:09:40.419 02:29:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:40.419 02:29:13 -- common/autotest_common.sh@10 -- # set +x 00:09:40.419 02:29:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:40.419 02:29:13 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t rdma -a 192.168.100.8 -s 4420 00:09:40.419 02:29:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:40.419 02:29:13 -- common/autotest_common.sh@10 -- # set +x 00:09:40.419 02:29:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:40.419 02:29:13 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:09:40.419 02:29:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:40.420 02:29:13 -- common/autotest_common.sh@10 -- # set +x 00:09:40.420 02:29:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:40.420 02:29:13 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 192.168.100.8 -s 4430 00:09:40.420 02:29:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:40.420 02:29:13 -- common/autotest_common.sh@10 -- # set +x 00:09:40.420 02:29:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:40.420 02:29:13 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 4420 00:09:40.420 00:09:40.420 Discovery Log Number of Records 6, Generation counter 6 00:09:40.420 =====Discovery Log Entry 0====== 00:09:40.420 trtype: rdma 00:09:40.420 adrfam: ipv4 00:09:40.420 subtype: current discovery subsystem 00:09:40.420 treq: not required 00:09:40.420 portid: 0 00:09:40.420 trsvcid: 4420 00:09:40.420 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:09:40.420 traddr: 192.168.100.8 00:09:40.420 eflags: explicit discovery connections, duplicate discovery information 00:09:40.420 rdma_prtype: not specified 00:09:40.420 rdma_qptype: connected 00:09:40.420 rdma_cms: rdma-cm 00:09:40.420 rdma_pkey: 0x0000 00:09:40.420 =====Discovery Log Entry 1====== 00:09:40.420 trtype: rdma 00:09:40.420 adrfam: ipv4 00:09:40.420 subtype: nvme subsystem 00:09:40.420 treq: not required 00:09:40.420 portid: 0 00:09:40.420 trsvcid: 4420 00:09:40.420 subnqn: nqn.2016-06.io.spdk:cnode1 00:09:40.420 traddr: 192.168.100.8 00:09:40.420 eflags: none 00:09:40.420 rdma_prtype: not specified 00:09:40.420 rdma_qptype: connected 00:09:40.420 rdma_cms: rdma-cm 00:09:40.420 rdma_pkey: 0x0000 00:09:40.420 =====Discovery Log Entry 2====== 00:09:40.420 trtype: rdma 00:09:40.420 adrfam: ipv4 00:09:40.420 subtype: nvme subsystem 00:09:40.420 treq: not required 00:09:40.420 portid: 0 00:09:40.420 trsvcid: 4420 00:09:40.420 subnqn: nqn.2016-06.io.spdk:cnode2 00:09:40.420 traddr: 192.168.100.8 00:09:40.420 eflags: none 00:09:40.420 rdma_prtype: not specified 00:09:40.420 rdma_qptype: connected 00:09:40.420 rdma_cms: rdma-cm 00:09:40.420 rdma_pkey: 0x0000 00:09:40.420 =====Discovery Log Entry 3====== 00:09:40.420 trtype: rdma 00:09:40.420 adrfam: ipv4 00:09:40.420 subtype: nvme subsystem 00:09:40.420 treq: not required 00:09:40.420 portid: 0 00:09:40.420 trsvcid: 4420 00:09:40.420 subnqn: nqn.2016-06.io.spdk:cnode3 00:09:40.420 traddr: 192.168.100.8 00:09:40.420 eflags: none 00:09:40.420 rdma_prtype: not specified 00:09:40.420 rdma_qptype: connected 00:09:40.420 rdma_cms: rdma-cm 00:09:40.420 rdma_pkey: 0x0000 00:09:40.420 =====Discovery Log Entry 4====== 00:09:40.420 trtype: rdma 00:09:40.420 adrfam: ipv4 00:09:40.420 subtype: nvme subsystem 00:09:40.420 treq: not required 00:09:40.420 portid: 0 00:09:40.420 trsvcid: 4420 00:09:40.420 subnqn: nqn.2016-06.io.spdk:cnode4 00:09:40.420 traddr: 192.168.100.8 00:09:40.420 eflags: none 00:09:40.420 rdma_prtype: not specified 00:09:40.420 rdma_qptype: connected 00:09:40.420 rdma_cms: rdma-cm 00:09:40.420 rdma_pkey: 0x0000 00:09:40.420 =====Discovery Log Entry 5====== 00:09:40.420 trtype: rdma 00:09:40.420 adrfam: ipv4 00:09:40.420 subtype: discovery subsystem referral 00:09:40.420 treq: not required 00:09:40.420 portid: 0 00:09:40.420 trsvcid: 4430 00:09:40.420 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:09:40.420 traddr: 192.168.100.8 00:09:40.420 eflags: none 00:09:40.420 rdma_prtype: unrecognized 00:09:40.420 rdma_qptype: unrecognized 00:09:40.420 rdma_cms: unrecognized 00:09:40.420 rdma_pkey: 0x0000 00:09:40.420 02:29:13 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:09:40.420 Perform nvmf subsystem discovery via RPC 00:09:40.420 02:29:13 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:09:40.420 02:29:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:40.420 02:29:13 -- common/autotest_common.sh@10 -- # set +x 00:09:40.420 [2024-04-27 02:29:13.926667] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:09:40.420 [ 00:09:40.420 { 00:09:40.420 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:09:40.420 "subtype": "Discovery", 00:09:40.420 "listen_addresses": [ 00:09:40.420 { 00:09:40.420 "transport": "RDMA", 00:09:40.420 "trtype": "RDMA", 00:09:40.420 "adrfam": "IPv4", 00:09:40.420 "traddr": "192.168.100.8", 00:09:40.420 "trsvcid": "4420" 00:09:40.420 } 00:09:40.420 ], 00:09:40.420 "allow_any_host": true, 00:09:40.420 "hosts": [] 00:09:40.420 }, 00:09:40.420 { 00:09:40.420 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:09:40.420 "subtype": "NVMe", 00:09:40.420 "listen_addresses": [ 00:09:40.420 { 00:09:40.420 "transport": "RDMA", 00:09:40.420 "trtype": "RDMA", 00:09:40.420 "adrfam": "IPv4", 00:09:40.420 "traddr": "192.168.100.8", 00:09:40.420 "trsvcid": "4420" 00:09:40.420 } 00:09:40.420 ], 00:09:40.420 "allow_any_host": true, 00:09:40.420 "hosts": [], 00:09:40.420 "serial_number": "SPDK00000000000001", 00:09:40.420 "model_number": "SPDK bdev Controller", 00:09:40.420 "max_namespaces": 32, 00:09:40.420 "min_cntlid": 1, 00:09:40.420 "max_cntlid": 65519, 00:09:40.420 "namespaces": [ 00:09:40.420 { 00:09:40.420 "nsid": 1, 00:09:40.420 "bdev_name": "Null1", 00:09:40.420 "name": "Null1", 00:09:40.420 "nguid": "DAB287984B9642C9946976F706A722DC", 00:09:40.420 "uuid": "dab28798-4b96-42c9-9469-76f706a722dc" 00:09:40.420 } 00:09:40.420 ] 00:09:40.420 }, 00:09:40.420 { 00:09:40.420 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:09:40.420 "subtype": "NVMe", 00:09:40.420 "listen_addresses": [ 00:09:40.420 { 00:09:40.420 "transport": "RDMA", 00:09:40.420 "trtype": "RDMA", 00:09:40.420 "adrfam": "IPv4", 00:09:40.420 "traddr": "192.168.100.8", 00:09:40.420 "trsvcid": "4420" 00:09:40.420 } 00:09:40.420 ], 00:09:40.420 "allow_any_host": true, 00:09:40.420 "hosts": [], 00:09:40.420 "serial_number": "SPDK00000000000002", 00:09:40.420 "model_number": "SPDK bdev Controller", 00:09:40.420 "max_namespaces": 32, 00:09:40.420 "min_cntlid": 1, 00:09:40.420 "max_cntlid": 65519, 00:09:40.420 "namespaces": [ 00:09:40.420 { 00:09:40.420 "nsid": 1, 00:09:40.420 "bdev_name": "Null2", 00:09:40.420 "name": "Null2", 00:09:40.420 "nguid": "8D957F6A5DAD484F99CF4926D4541CC3", 00:09:40.420 "uuid": "8d957f6a-5dad-484f-99cf-4926d4541cc3" 00:09:40.420 } 00:09:40.420 ] 00:09:40.420 }, 00:09:40.420 { 00:09:40.420 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:09:40.420 "subtype": "NVMe", 00:09:40.420 "listen_addresses": [ 00:09:40.420 { 00:09:40.420 "transport": "RDMA", 00:09:40.420 "trtype": "RDMA", 00:09:40.420 "adrfam": "IPv4", 00:09:40.420 "traddr": "192.168.100.8", 00:09:40.420 "trsvcid": "4420" 00:09:40.420 } 00:09:40.420 ], 00:09:40.420 "allow_any_host": true, 00:09:40.420 "hosts": [], 00:09:40.420 "serial_number": "SPDK00000000000003", 00:09:40.420 "model_number": "SPDK bdev Controller", 00:09:40.420 "max_namespaces": 32, 00:09:40.420 "min_cntlid": 1, 00:09:40.420 "max_cntlid": 65519, 00:09:40.420 "namespaces": [ 00:09:40.420 { 00:09:40.420 "nsid": 1, 00:09:40.420 "bdev_name": "Null3", 00:09:40.420 "name": "Null3", 00:09:40.420 "nguid": "F62B4A20E7C541D4B19B6C48193789DA", 00:09:40.420 "uuid": "f62b4a20-e7c5-41d4-b19b-6c48193789da" 00:09:40.420 } 00:09:40.420 ] 00:09:40.420 }, 00:09:40.420 { 00:09:40.420 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:09:40.420 "subtype": "NVMe", 00:09:40.420 "listen_addresses": [ 00:09:40.420 { 00:09:40.420 "transport": "RDMA", 00:09:40.420 "trtype": "RDMA", 00:09:40.420 "adrfam": "IPv4", 00:09:40.420 "traddr": "192.168.100.8", 00:09:40.420 "trsvcid": "4420" 00:09:40.420 } 00:09:40.420 ], 00:09:40.420 "allow_any_host": true, 00:09:40.420 "hosts": [], 00:09:40.420 "serial_number": "SPDK00000000000004", 00:09:40.420 "model_number": "SPDK bdev Controller", 00:09:40.420 "max_namespaces": 32, 00:09:40.420 "min_cntlid": 1, 00:09:40.420 "max_cntlid": 65519, 00:09:40.420 "namespaces": [ 00:09:40.420 { 00:09:40.420 "nsid": 1, 00:09:40.420 "bdev_name": "Null4", 00:09:40.420 "name": "Null4", 00:09:40.420 "nguid": "6C9F3A139426478989F1E164700E4697", 00:09:40.420 "uuid": "6c9f3a13-9426-4789-89f1-e164700e4697" 00:09:40.420 } 00:09:40.420 ] 00:09:40.420 } 00:09:40.420 ] 00:09:40.420 02:29:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:40.420 02:29:13 -- target/discovery.sh@42 -- # seq 1 4 00:09:40.420 02:29:13 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:09:40.420 02:29:13 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:09:40.420 02:29:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:40.420 02:29:13 -- common/autotest_common.sh@10 -- # set +x 00:09:40.420 02:29:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:40.420 02:29:13 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:09:40.420 02:29:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:40.420 02:29:13 -- common/autotest_common.sh@10 -- # set +x 00:09:40.420 02:29:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:40.420 02:29:13 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:09:40.420 02:29:13 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:09:40.420 02:29:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:40.421 02:29:13 -- common/autotest_common.sh@10 -- # set +x 00:09:40.421 02:29:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:40.421 02:29:13 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:09:40.421 02:29:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:40.421 02:29:13 -- common/autotest_common.sh@10 -- # set +x 00:09:40.421 02:29:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:40.421 02:29:13 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:09:40.421 02:29:13 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:09:40.421 02:29:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:40.421 02:29:13 -- common/autotest_common.sh@10 -- # set +x 00:09:40.421 02:29:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:40.421 02:29:14 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:09:40.421 02:29:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:40.421 02:29:14 -- common/autotest_common.sh@10 -- # set +x 00:09:40.421 02:29:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:40.421 02:29:14 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:09:40.421 02:29:14 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:09:40.421 02:29:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:40.421 02:29:14 -- common/autotest_common.sh@10 -- # set +x 00:09:40.421 02:29:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:40.421 02:29:14 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:09:40.421 02:29:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:40.421 02:29:14 -- common/autotest_common.sh@10 -- # set +x 00:09:40.421 02:29:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:40.421 02:29:14 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 192.168.100.8 -s 4430 00:09:40.421 02:29:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:40.421 02:29:14 -- common/autotest_common.sh@10 -- # set +x 00:09:40.722 02:29:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:40.722 02:29:14 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:09:40.722 02:29:14 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:09:40.722 02:29:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:40.722 02:29:14 -- common/autotest_common.sh@10 -- # set +x 00:09:40.722 02:29:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:40.722 02:29:14 -- target/discovery.sh@49 -- # check_bdevs= 00:09:40.722 02:29:14 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:09:40.722 02:29:14 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:09:40.722 02:29:14 -- target/discovery.sh@57 -- # nvmftestfini 00:09:40.722 02:29:14 -- nvmf/common.sh@477 -- # nvmfcleanup 00:09:40.722 02:29:14 -- nvmf/common.sh@117 -- # sync 00:09:40.722 02:29:14 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:09:40.722 02:29:14 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:09:40.722 02:29:14 -- nvmf/common.sh@120 -- # set +e 00:09:40.722 02:29:14 -- nvmf/common.sh@121 -- # for i in {1..20} 00:09:40.722 02:29:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:09:40.722 rmmod nvme_rdma 00:09:40.722 rmmod nvme_fabrics 00:09:40.722 02:29:14 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:09:40.722 02:29:14 -- nvmf/common.sh@124 -- # set -e 00:09:40.722 02:29:14 -- nvmf/common.sh@125 -- # return 0 00:09:40.722 02:29:14 -- nvmf/common.sh@478 -- # '[' -n 1454741 ']' 00:09:40.722 02:29:14 -- nvmf/common.sh@479 -- # killprocess 1454741 00:09:40.722 02:29:14 -- common/autotest_common.sh@936 -- # '[' -z 1454741 ']' 00:09:40.722 02:29:14 -- common/autotest_common.sh@940 -- # kill -0 1454741 00:09:40.722 02:29:14 -- common/autotest_common.sh@941 -- # uname 00:09:40.722 02:29:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:09:40.723 02:29:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1454741 00:09:40.723 02:29:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:09:40.723 02:29:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:09:40.723 02:29:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1454741' 00:09:40.723 killing process with pid 1454741 00:09:40.723 02:29:14 -- common/autotest_common.sh@955 -- # kill 1454741 00:09:40.723 [2024-04-27 02:29:14.193568] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:09:40.723 02:29:14 -- common/autotest_common.sh@960 -- # wait 1454741 00:09:40.723 [2024-04-27 02:29:14.285992] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:09:40.982 02:29:14 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:09:40.982 02:29:14 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:09:40.982 00:09:40.982 real 0m7.661s 00:09:40.982 user 0m8.360s 00:09:40.982 sys 0m4.789s 00:09:40.982 02:29:14 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:09:40.982 02:29:14 -- common/autotest_common.sh@10 -- # set +x 00:09:40.982 ************************************ 00:09:40.982 END TEST nvmf_discovery 00:09:40.982 ************************************ 00:09:40.982 02:29:14 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=rdma 00:09:40.982 02:29:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:09:40.982 02:29:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:40.982 02:29:14 -- common/autotest_common.sh@10 -- # set +x 00:09:41.242 ************************************ 00:09:41.242 START TEST nvmf_referrals 00:09:41.242 ************************************ 00:09:41.242 02:29:14 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=rdma 00:09:41.242 * Looking for test storage... 00:09:41.242 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:09:41.242 02:29:14 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:09:41.242 02:29:14 -- nvmf/common.sh@7 -- # uname -s 00:09:41.242 02:29:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:41.242 02:29:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:41.242 02:29:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:41.242 02:29:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:41.242 02:29:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:41.242 02:29:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:41.242 02:29:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:41.242 02:29:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:41.242 02:29:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:41.242 02:29:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:41.242 02:29:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:09:41.242 02:29:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:09:41.242 02:29:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:41.242 02:29:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:41.242 02:29:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:09:41.242 02:29:14 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:09:41.242 02:29:14 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:09:41.242 02:29:14 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:41.242 02:29:14 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:41.242 02:29:14 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:41.242 02:29:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:41.242 02:29:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:41.242 02:29:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:41.242 02:29:14 -- paths/export.sh@5 -- # export PATH 00:09:41.242 02:29:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:41.242 02:29:14 -- nvmf/common.sh@47 -- # : 0 00:09:41.242 02:29:14 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:09:41.242 02:29:14 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:09:41.242 02:29:14 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:09:41.242 02:29:14 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:41.242 02:29:14 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:41.242 02:29:14 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:09:41.242 02:29:14 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:09:41.242 02:29:14 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:09:41.242 02:29:14 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:09:41.242 02:29:14 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:09:41.242 02:29:14 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:09:41.242 02:29:14 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:09:41.242 02:29:14 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:09:41.242 02:29:14 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:09:41.242 02:29:14 -- target/referrals.sh@37 -- # nvmftestinit 00:09:41.242 02:29:14 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:09:41.242 02:29:14 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:41.242 02:29:14 -- nvmf/common.sh@437 -- # prepare_net_devs 00:09:41.242 02:29:14 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:09:41.242 02:29:14 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:09:41.242 02:29:14 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:41.242 02:29:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:41.242 02:29:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:41.242 02:29:14 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:09:41.242 02:29:14 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:09:41.242 02:29:14 -- nvmf/common.sh@285 -- # xtrace_disable 00:09:41.242 02:29:14 -- common/autotest_common.sh@10 -- # set +x 00:09:46.522 02:29:19 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:46.522 02:29:19 -- nvmf/common.sh@291 -- # pci_devs=() 00:09:46.522 02:29:19 -- nvmf/common.sh@291 -- # local -a pci_devs 00:09:46.522 02:29:19 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:09:46.522 02:29:19 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:09:46.522 02:29:19 -- nvmf/common.sh@293 -- # pci_drivers=() 00:09:46.522 02:29:19 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:09:46.522 02:29:19 -- nvmf/common.sh@295 -- # net_devs=() 00:09:46.522 02:29:19 -- nvmf/common.sh@295 -- # local -ga net_devs 00:09:46.522 02:29:19 -- nvmf/common.sh@296 -- # e810=() 00:09:46.522 02:29:19 -- nvmf/common.sh@296 -- # local -ga e810 00:09:46.522 02:29:19 -- nvmf/common.sh@297 -- # x722=() 00:09:46.522 02:29:19 -- nvmf/common.sh@297 -- # local -ga x722 00:09:46.522 02:29:19 -- nvmf/common.sh@298 -- # mlx=() 00:09:46.522 02:29:19 -- nvmf/common.sh@298 -- # local -ga mlx 00:09:46.522 02:29:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:46.522 02:29:19 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:46.522 02:29:19 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:46.522 02:29:19 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:46.522 02:29:19 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:46.522 02:29:19 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:46.522 02:29:19 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:46.522 02:29:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:46.522 02:29:19 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:46.522 02:29:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:46.522 02:29:19 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:46.522 02:29:19 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:09:46.522 02:29:19 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:09:46.522 02:29:19 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:09:46.522 02:29:19 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:09:46.522 02:29:19 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:09:46.522 02:29:19 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:09:46.522 02:29:19 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:09:46.522 02:29:19 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:46.522 02:29:19 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:09:46.522 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:09:46.522 02:29:19 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:09:46.522 02:29:19 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:09:46.522 02:29:19 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:09:46.522 02:29:19 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:09:46.522 02:29:19 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:09:46.522 02:29:19 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:09:46.522 02:29:19 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:46.522 02:29:19 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:09:46.522 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:09:46.522 02:29:19 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:09:46.522 02:29:19 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:09:46.522 02:29:19 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:09:46.522 02:29:19 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:09:46.522 02:29:19 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:09:46.522 02:29:19 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:09:46.522 02:29:19 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:09:46.522 02:29:19 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:09:46.522 02:29:19 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:46.522 02:29:19 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:46.522 02:29:19 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:46.522 02:29:19 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:46.522 02:29:19 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:09:46.522 Found net devices under 0000:18:00.0: mlx_0_0 00:09:46.522 02:29:19 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:46.522 02:29:19 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:46.522 02:29:19 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:46.522 02:29:19 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:46.522 02:29:19 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:46.522 02:29:19 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:09:46.522 Found net devices under 0000:18:00.1: mlx_0_1 00:09:46.522 02:29:19 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:46.522 02:29:19 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:09:46.522 02:29:19 -- nvmf/common.sh@403 -- # is_hw=yes 00:09:46.522 02:29:19 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:09:46.522 02:29:19 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:09:46.522 02:29:19 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:09:46.522 02:29:19 -- nvmf/common.sh@409 -- # rdma_device_init 00:09:46.522 02:29:19 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:09:46.522 02:29:19 -- nvmf/common.sh@58 -- # uname 00:09:46.522 02:29:19 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:09:46.522 02:29:19 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:09:46.522 02:29:19 -- nvmf/common.sh@63 -- # modprobe ib_core 00:09:46.522 02:29:19 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:09:46.522 02:29:19 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:09:46.522 02:29:19 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:09:46.522 02:29:19 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:09:46.522 02:29:20 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:09:46.522 02:29:20 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:09:46.522 02:29:20 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:09:46.522 02:29:20 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:09:46.522 02:29:20 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:09:46.522 02:29:20 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:09:46.522 02:29:20 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:09:46.522 02:29:20 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:09:46.522 02:29:20 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:09:46.522 02:29:20 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:46.522 02:29:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:46.522 02:29:20 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:09:46.522 02:29:20 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:09:46.523 02:29:20 -- nvmf/common.sh@105 -- # continue 2 00:09:46.523 02:29:20 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:46.523 02:29:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:46.523 02:29:20 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:09:46.523 02:29:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:46.523 02:29:20 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:09:46.523 02:29:20 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:09:46.523 02:29:20 -- nvmf/common.sh@105 -- # continue 2 00:09:46.523 02:29:20 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:09:46.523 02:29:20 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:09:46.523 02:29:20 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:09:46.523 02:29:20 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:46.523 02:29:20 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:09:46.523 02:29:20 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:46.523 02:29:20 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:09:46.523 02:29:20 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:09:46.523 02:29:20 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:09:46.523 60: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:09:46.523 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:09:46.523 altname enp24s0f0np0 00:09:46.523 altname ens785f0np0 00:09:46.523 inet 192.168.100.8/24 scope global mlx_0_0 00:09:46.523 valid_lft forever preferred_lft forever 00:09:46.523 02:29:20 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:09:46.523 02:29:20 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:09:46.523 02:29:20 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:09:46.523 02:29:20 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:09:46.523 02:29:20 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:46.523 02:29:20 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:46.523 02:29:20 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:09:46.523 02:29:20 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:09:46.523 02:29:20 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:09:46.523 61: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:09:46.523 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:09:46.523 altname enp24s0f1np1 00:09:46.523 altname ens785f1np1 00:09:46.523 inet 192.168.100.9/24 scope global mlx_0_1 00:09:46.523 valid_lft forever preferred_lft forever 00:09:46.523 02:29:20 -- nvmf/common.sh@411 -- # return 0 00:09:46.523 02:29:20 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:09:46.523 02:29:20 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:09:46.523 02:29:20 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:09:46.523 02:29:20 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:09:46.523 02:29:20 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:09:46.523 02:29:20 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:09:46.523 02:29:20 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:09:46.523 02:29:20 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:09:46.523 02:29:20 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:09:46.523 02:29:20 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:09:46.523 02:29:20 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:46.523 02:29:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:46.523 02:29:20 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:09:46.523 02:29:20 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:09:46.523 02:29:20 -- nvmf/common.sh@105 -- # continue 2 00:09:46.523 02:29:20 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:46.523 02:29:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:46.523 02:29:20 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:09:46.523 02:29:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:46.523 02:29:20 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:09:46.523 02:29:20 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:09:46.523 02:29:20 -- nvmf/common.sh@105 -- # continue 2 00:09:46.523 02:29:20 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:09:46.523 02:29:20 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:09:46.523 02:29:20 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:09:46.523 02:29:20 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:09:46.523 02:29:20 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:46.523 02:29:20 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:46.523 02:29:20 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:09:46.523 02:29:20 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:09:46.523 02:29:20 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:09:46.523 02:29:20 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:09:46.523 02:29:20 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:46.784 02:29:20 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:46.784 02:29:20 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:09:46.784 192.168.100.9' 00:09:46.784 02:29:20 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:09:46.784 192.168.100.9' 00:09:46.784 02:29:20 -- nvmf/common.sh@446 -- # head -n 1 00:09:46.784 02:29:20 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:09:46.784 02:29:20 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:09:46.784 192.168.100.9' 00:09:46.784 02:29:20 -- nvmf/common.sh@447 -- # tail -n +2 00:09:46.784 02:29:20 -- nvmf/common.sh@447 -- # head -n 1 00:09:46.784 02:29:20 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:09:46.784 02:29:20 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:09:46.784 02:29:20 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:09:46.784 02:29:20 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:09:46.784 02:29:20 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:09:46.784 02:29:20 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:09:46.784 02:29:20 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:09:46.784 02:29:20 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:09:46.784 02:29:20 -- common/autotest_common.sh@710 -- # xtrace_disable 00:09:46.784 02:29:20 -- common/autotest_common.sh@10 -- # set +x 00:09:46.784 02:29:20 -- nvmf/common.sh@470 -- # nvmfpid=1457686 00:09:46.784 02:29:20 -- nvmf/common.sh@471 -- # waitforlisten 1457686 00:09:46.784 02:29:20 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:46.784 02:29:20 -- common/autotest_common.sh@817 -- # '[' -z 1457686 ']' 00:09:46.784 02:29:20 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:46.784 02:29:20 -- common/autotest_common.sh@822 -- # local max_retries=100 00:09:46.784 02:29:20 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:46.784 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:46.784 02:29:20 -- common/autotest_common.sh@826 -- # xtrace_disable 00:09:46.784 02:29:20 -- common/autotest_common.sh@10 -- # set +x 00:09:46.784 [2024-04-27 02:29:20.253386] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:09:46.784 [2024-04-27 02:29:20.253445] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:46.784 EAL: No free 2048 kB hugepages reported on node 1 00:09:46.784 [2024-04-27 02:29:20.327535] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:47.044 [2024-04-27 02:29:20.416574] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:47.044 [2024-04-27 02:29:20.416617] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:47.044 [2024-04-27 02:29:20.416626] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:09:47.044 [2024-04-27 02:29:20.416650] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:09:47.044 [2024-04-27 02:29:20.416657] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:47.044 [2024-04-27 02:29:20.416705] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:47.044 [2024-04-27 02:29:20.416789] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:47.044 [2024-04-27 02:29:20.416871] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:47.044 [2024-04-27 02:29:20.416873] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:09:47.613 02:29:21 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:09:47.613 02:29:21 -- common/autotest_common.sh@850 -- # return 0 00:09:47.613 02:29:21 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:09:47.613 02:29:21 -- common/autotest_common.sh@716 -- # xtrace_disable 00:09:47.613 02:29:21 -- common/autotest_common.sh@10 -- # set +x 00:09:47.613 02:29:21 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:47.613 02:29:21 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:09:47.613 02:29:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:47.613 02:29:21 -- common/autotest_common.sh@10 -- # set +x 00:09:47.613 [2024-04-27 02:29:21.148935] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xf504d0/0xf549c0) succeed. 00:09:47.613 [2024-04-27 02:29:21.159285] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xf51b10/0xf96050) succeed. 00:09:47.872 02:29:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:47.872 02:29:21 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t rdma -a 192.168.100.8 -s 8009 discovery 00:09:47.872 02:29:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:47.872 02:29:21 -- common/autotest_common.sh@10 -- # set +x 00:09:47.872 [2024-04-27 02:29:21.286068] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 8009 *** 00:09:47.872 02:29:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:47.872 02:29:21 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.2 -s 4430 00:09:47.872 02:29:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:47.872 02:29:21 -- common/autotest_common.sh@10 -- # set +x 00:09:47.872 02:29:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:47.872 02:29:21 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.3 -s 4430 00:09:47.872 02:29:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:47.872 02:29:21 -- common/autotest_common.sh@10 -- # set +x 00:09:47.872 02:29:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:47.872 02:29:21 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.4 -s 4430 00:09:47.872 02:29:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:47.872 02:29:21 -- common/autotest_common.sh@10 -- # set +x 00:09:47.872 02:29:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:47.872 02:29:21 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:47.872 02:29:21 -- target/referrals.sh@48 -- # jq length 00:09:47.872 02:29:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:47.872 02:29:21 -- common/autotest_common.sh@10 -- # set +x 00:09:47.872 02:29:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:47.872 02:29:21 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:09:47.872 02:29:21 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:09:47.872 02:29:21 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:09:47.872 02:29:21 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:47.872 02:29:21 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:09:47.872 02:29:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:47.872 02:29:21 -- common/autotest_common.sh@10 -- # set +x 00:09:47.872 02:29:21 -- target/referrals.sh@21 -- # sort 00:09:47.872 02:29:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:47.872 02:29:21 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:09:47.872 02:29:21 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:09:47.872 02:29:21 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:09:47.872 02:29:21 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:47.872 02:29:21 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:47.872 02:29:21 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:09:47.872 02:29:21 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:47.872 02:29:21 -- target/referrals.sh@26 -- # sort 00:09:48.131 02:29:21 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:09:48.131 02:29:21 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:09:48.131 02:29:21 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.2 -s 4430 00:09:48.131 02:29:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:48.131 02:29:21 -- common/autotest_common.sh@10 -- # set +x 00:09:48.131 02:29:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:48.131 02:29:21 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.3 -s 4430 00:09:48.131 02:29:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:48.131 02:29:21 -- common/autotest_common.sh@10 -- # set +x 00:09:48.131 02:29:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:48.131 02:29:21 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.4 -s 4430 00:09:48.131 02:29:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:48.131 02:29:21 -- common/autotest_common.sh@10 -- # set +x 00:09:48.131 02:29:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:48.131 02:29:21 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:48.131 02:29:21 -- target/referrals.sh@56 -- # jq length 00:09:48.131 02:29:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:48.131 02:29:21 -- common/autotest_common.sh@10 -- # set +x 00:09:48.131 02:29:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:48.131 02:29:21 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:09:48.131 02:29:21 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:09:48.131 02:29:21 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:48.131 02:29:21 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:48.131 02:29:21 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:09:48.131 02:29:21 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:48.131 02:29:21 -- target/referrals.sh@26 -- # sort 00:09:48.131 02:29:21 -- target/referrals.sh@26 -- # echo 00:09:48.131 02:29:21 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:09:48.131 02:29:21 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.2 -s 4430 -n discovery 00:09:48.131 02:29:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:48.131 02:29:21 -- common/autotest_common.sh@10 -- # set +x 00:09:48.131 02:29:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:48.131 02:29:21 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:09:48.131 02:29:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:48.131 02:29:21 -- common/autotest_common.sh@10 -- # set +x 00:09:48.131 02:29:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:48.131 02:29:21 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:09:48.131 02:29:21 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:09:48.131 02:29:21 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:48.131 02:29:21 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:09:48.131 02:29:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:48.131 02:29:21 -- common/autotest_common.sh@10 -- # set +x 00:09:48.131 02:29:21 -- target/referrals.sh@21 -- # sort 00:09:48.131 02:29:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:48.390 02:29:21 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:09:48.390 02:29:21 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:09:48.391 02:29:21 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:09:48.391 02:29:21 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:48.391 02:29:21 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:48.391 02:29:21 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:09:48.391 02:29:21 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:48.391 02:29:21 -- target/referrals.sh@26 -- # sort 00:09:48.391 02:29:21 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:09:48.391 02:29:21 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:09:48.391 02:29:21 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:09:48.391 02:29:21 -- target/referrals.sh@67 -- # jq -r .subnqn 00:09:48.391 02:29:21 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:09:48.391 02:29:21 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:09:48.391 02:29:21 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:09:48.391 02:29:21 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:09:48.391 02:29:21 -- target/referrals.sh@68 -- # jq -r .subnqn 00:09:48.391 02:29:21 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:09:48.391 02:29:21 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:09:48.391 02:29:21 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:09:48.391 02:29:21 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:09:48.650 02:29:22 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:09:48.650 02:29:22 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:09:48.650 02:29:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:48.650 02:29:22 -- common/autotest_common.sh@10 -- # set +x 00:09:48.650 02:29:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:48.650 02:29:22 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:09:48.650 02:29:22 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:09:48.650 02:29:22 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:48.650 02:29:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:48.650 02:29:22 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:09:48.650 02:29:22 -- common/autotest_common.sh@10 -- # set +x 00:09:48.650 02:29:22 -- target/referrals.sh@21 -- # sort 00:09:48.650 02:29:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:48.650 02:29:22 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:09:48.650 02:29:22 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:09:48.650 02:29:22 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:09:48.650 02:29:22 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:48.650 02:29:22 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:48.650 02:29:22 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:09:48.650 02:29:22 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:48.650 02:29:22 -- target/referrals.sh@26 -- # sort 00:09:48.909 02:29:22 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:09:48.909 02:29:22 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:09:48.909 02:29:22 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:09:48.909 02:29:22 -- target/referrals.sh@75 -- # jq -r .subnqn 00:09:48.909 02:29:22 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:09:48.909 02:29:22 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:09:48.909 02:29:22 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:09:48.909 02:29:22 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:09:48.909 02:29:22 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:09:48.909 02:29:22 -- target/referrals.sh@76 -- # jq -r .subnqn 00:09:48.909 02:29:22 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:09:48.909 02:29:22 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:09:48.909 02:29:22 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:09:48.909 02:29:22 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:09:48.909 02:29:22 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:09:48.909 02:29:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:48.909 02:29:22 -- common/autotest_common.sh@10 -- # set +x 00:09:48.909 02:29:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:48.910 02:29:22 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:48.910 02:29:22 -- target/referrals.sh@82 -- # jq length 00:09:48.910 02:29:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:48.910 02:29:22 -- common/autotest_common.sh@10 -- # set +x 00:09:48.910 02:29:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:49.168 02:29:22 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:09:49.168 02:29:22 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:09:49.168 02:29:22 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:49.168 02:29:22 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:49.168 02:29:22 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:09:49.168 02:29:22 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:49.168 02:29:22 -- target/referrals.sh@26 -- # sort 00:09:49.168 02:29:22 -- target/referrals.sh@26 -- # echo 00:09:49.168 02:29:22 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:09:49.168 02:29:22 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:09:49.168 02:29:22 -- target/referrals.sh@86 -- # nvmftestfini 00:09:49.168 02:29:22 -- nvmf/common.sh@477 -- # nvmfcleanup 00:09:49.168 02:29:22 -- nvmf/common.sh@117 -- # sync 00:09:49.168 02:29:22 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:09:49.168 02:29:22 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:09:49.168 02:29:22 -- nvmf/common.sh@120 -- # set +e 00:09:49.168 02:29:22 -- nvmf/common.sh@121 -- # for i in {1..20} 00:09:49.168 02:29:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:09:49.168 rmmod nvme_rdma 00:09:49.168 rmmod nvme_fabrics 00:09:49.169 02:29:22 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:09:49.169 02:29:22 -- nvmf/common.sh@124 -- # set -e 00:09:49.169 02:29:22 -- nvmf/common.sh@125 -- # return 0 00:09:49.169 02:29:22 -- nvmf/common.sh@478 -- # '[' -n 1457686 ']' 00:09:49.169 02:29:22 -- nvmf/common.sh@479 -- # killprocess 1457686 00:09:49.169 02:29:22 -- common/autotest_common.sh@936 -- # '[' -z 1457686 ']' 00:09:49.169 02:29:22 -- common/autotest_common.sh@940 -- # kill -0 1457686 00:09:49.169 02:29:22 -- common/autotest_common.sh@941 -- # uname 00:09:49.169 02:29:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:09:49.169 02:29:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1457686 00:09:49.169 02:29:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:09:49.169 02:29:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:09:49.169 02:29:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1457686' 00:09:49.169 killing process with pid 1457686 00:09:49.169 02:29:22 -- common/autotest_common.sh@955 -- # kill 1457686 00:09:49.169 02:29:22 -- common/autotest_common.sh@960 -- # wait 1457686 00:09:49.431 [2024-04-27 02:29:22.846780] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:09:49.690 02:29:23 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:09:49.690 02:29:23 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:09:49.690 00:09:49.690 real 0m8.369s 00:09:49.690 user 0m12.644s 00:09:49.690 sys 0m5.014s 00:09:49.690 02:29:23 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:09:49.690 02:29:23 -- common/autotest_common.sh@10 -- # set +x 00:09:49.690 ************************************ 00:09:49.690 END TEST nvmf_referrals 00:09:49.690 ************************************ 00:09:49.690 02:29:23 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=rdma 00:09:49.690 02:29:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:09:49.690 02:29:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:49.690 02:29:23 -- common/autotest_common.sh@10 -- # set +x 00:09:49.690 ************************************ 00:09:49.690 START TEST nvmf_connect_disconnect 00:09:49.691 ************************************ 00:09:49.691 02:29:23 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=rdma 00:09:49.950 * Looking for test storage... 00:09:49.950 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:09:49.950 02:29:23 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:09:49.950 02:29:23 -- nvmf/common.sh@7 -- # uname -s 00:09:49.950 02:29:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:49.950 02:29:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:49.950 02:29:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:49.950 02:29:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:49.950 02:29:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:49.950 02:29:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:49.950 02:29:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:49.950 02:29:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:49.950 02:29:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:49.950 02:29:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:49.950 02:29:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:09:49.950 02:29:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:09:49.950 02:29:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:49.950 02:29:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:49.950 02:29:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:09:49.950 02:29:23 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:09:49.950 02:29:23 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:09:49.950 02:29:23 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:49.950 02:29:23 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:49.950 02:29:23 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:49.951 02:29:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:49.951 02:29:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:49.951 02:29:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:49.951 02:29:23 -- paths/export.sh@5 -- # export PATH 00:09:49.951 02:29:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:49.951 02:29:23 -- nvmf/common.sh@47 -- # : 0 00:09:49.951 02:29:23 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:09:49.951 02:29:23 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:09:49.951 02:29:23 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:09:49.951 02:29:23 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:49.951 02:29:23 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:49.951 02:29:23 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:09:49.951 02:29:23 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:09:49.951 02:29:23 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:09:49.951 02:29:23 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:09:49.951 02:29:23 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:09:49.951 02:29:23 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:09:49.951 02:29:23 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:09:49.951 02:29:23 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:49.951 02:29:23 -- nvmf/common.sh@437 -- # prepare_net_devs 00:09:49.951 02:29:23 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:09:49.951 02:29:23 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:09:49.951 02:29:23 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:49.951 02:29:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:49.951 02:29:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:49.951 02:29:23 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:09:49.951 02:29:23 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:09:49.951 02:29:23 -- nvmf/common.sh@285 -- # xtrace_disable 00:09:49.951 02:29:23 -- common/autotest_common.sh@10 -- # set +x 00:09:56.527 02:29:28 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:56.527 02:29:28 -- nvmf/common.sh@291 -- # pci_devs=() 00:09:56.527 02:29:28 -- nvmf/common.sh@291 -- # local -a pci_devs 00:09:56.527 02:29:28 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:09:56.527 02:29:28 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:09:56.527 02:29:28 -- nvmf/common.sh@293 -- # pci_drivers=() 00:09:56.527 02:29:28 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:09:56.527 02:29:28 -- nvmf/common.sh@295 -- # net_devs=() 00:09:56.527 02:29:28 -- nvmf/common.sh@295 -- # local -ga net_devs 00:09:56.527 02:29:28 -- nvmf/common.sh@296 -- # e810=() 00:09:56.527 02:29:28 -- nvmf/common.sh@296 -- # local -ga e810 00:09:56.527 02:29:28 -- nvmf/common.sh@297 -- # x722=() 00:09:56.527 02:29:28 -- nvmf/common.sh@297 -- # local -ga x722 00:09:56.527 02:29:28 -- nvmf/common.sh@298 -- # mlx=() 00:09:56.527 02:29:28 -- nvmf/common.sh@298 -- # local -ga mlx 00:09:56.527 02:29:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:56.527 02:29:28 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:56.527 02:29:28 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:56.527 02:29:28 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:56.527 02:29:28 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:56.527 02:29:28 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:56.527 02:29:28 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:56.527 02:29:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:56.527 02:29:28 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:56.527 02:29:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:56.527 02:29:28 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:56.527 02:29:28 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:09:56.527 02:29:28 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:09:56.527 02:29:28 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:09:56.527 02:29:28 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:09:56.527 02:29:28 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:09:56.527 02:29:28 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:09:56.527 02:29:28 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:09:56.527 02:29:28 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:56.527 02:29:28 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:09:56.527 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:09:56.527 02:29:28 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:09:56.527 02:29:28 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:09:56.527 02:29:28 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:09:56.527 02:29:28 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:09:56.527 02:29:28 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:09:56.527 02:29:28 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:09:56.527 02:29:28 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:56.527 02:29:28 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:09:56.527 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:09:56.527 02:29:28 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:09:56.527 02:29:28 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:09:56.527 02:29:28 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:09:56.527 02:29:28 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:09:56.527 02:29:28 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:09:56.527 02:29:28 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:09:56.527 02:29:28 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:09:56.527 02:29:28 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:09:56.527 02:29:28 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:56.527 02:29:28 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:56.527 02:29:28 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:56.527 02:29:28 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:56.527 02:29:28 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:09:56.527 Found net devices under 0000:18:00.0: mlx_0_0 00:09:56.527 02:29:28 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:56.527 02:29:28 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:56.527 02:29:28 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:56.527 02:29:28 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:56.527 02:29:28 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:56.527 02:29:28 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:09:56.527 Found net devices under 0000:18:00.1: mlx_0_1 00:09:56.527 02:29:28 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:56.527 02:29:28 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:09:56.527 02:29:28 -- nvmf/common.sh@403 -- # is_hw=yes 00:09:56.527 02:29:28 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:09:56.527 02:29:28 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:09:56.527 02:29:28 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:09:56.527 02:29:28 -- nvmf/common.sh@409 -- # rdma_device_init 00:09:56.527 02:29:28 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:09:56.527 02:29:28 -- nvmf/common.sh@58 -- # uname 00:09:56.527 02:29:28 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:09:56.527 02:29:28 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:09:56.527 02:29:28 -- nvmf/common.sh@63 -- # modprobe ib_core 00:09:56.527 02:29:28 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:09:56.527 02:29:28 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:09:56.527 02:29:28 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:09:56.527 02:29:28 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:09:56.527 02:29:28 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:09:56.527 02:29:28 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:09:56.527 02:29:28 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:09:56.527 02:29:28 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:09:56.527 02:29:28 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:09:56.527 02:29:28 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:09:56.527 02:29:28 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:09:56.527 02:29:28 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:09:56.527 02:29:28 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:09:56.527 02:29:28 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:56.527 02:29:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:56.527 02:29:28 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:09:56.527 02:29:28 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:09:56.527 02:29:28 -- nvmf/common.sh@105 -- # continue 2 00:09:56.527 02:29:28 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:56.527 02:29:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:56.527 02:29:29 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:09:56.527 02:29:29 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:56.527 02:29:29 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:09:56.527 02:29:29 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:09:56.527 02:29:29 -- nvmf/common.sh@105 -- # continue 2 00:09:56.527 02:29:29 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:09:56.527 02:29:29 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:09:56.527 02:29:29 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:09:56.527 02:29:29 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:09:56.527 02:29:29 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:56.527 02:29:29 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:56.527 02:29:29 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:09:56.527 02:29:29 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:09:56.527 02:29:29 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:09:56.527 60: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:09:56.527 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:09:56.527 altname enp24s0f0np0 00:09:56.527 altname ens785f0np0 00:09:56.527 inet 192.168.100.8/24 scope global mlx_0_0 00:09:56.527 valid_lft forever preferred_lft forever 00:09:56.527 02:29:29 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:09:56.527 02:29:29 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:09:56.527 02:29:29 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:09:56.527 02:29:29 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:56.527 02:29:29 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:09:56.527 02:29:29 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:56.527 02:29:29 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:09:56.527 02:29:29 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:09:56.527 02:29:29 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:09:56.527 61: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:09:56.527 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:09:56.527 altname enp24s0f1np1 00:09:56.527 altname ens785f1np1 00:09:56.527 inet 192.168.100.9/24 scope global mlx_0_1 00:09:56.527 valid_lft forever preferred_lft forever 00:09:56.527 02:29:29 -- nvmf/common.sh@411 -- # return 0 00:09:56.527 02:29:29 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:09:56.527 02:29:29 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:09:56.527 02:29:29 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:09:56.527 02:29:29 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:09:56.527 02:29:29 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:09:56.527 02:29:29 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:09:56.527 02:29:29 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:09:56.527 02:29:29 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:09:56.527 02:29:29 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:09:56.527 02:29:29 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:09:56.527 02:29:29 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:56.527 02:29:29 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:56.527 02:29:29 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:09:56.527 02:29:29 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:09:56.527 02:29:29 -- nvmf/common.sh@105 -- # continue 2 00:09:56.527 02:29:29 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:56.527 02:29:29 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:56.528 02:29:29 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:09:56.528 02:29:29 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:56.528 02:29:29 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:09:56.528 02:29:29 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:09:56.528 02:29:29 -- nvmf/common.sh@105 -- # continue 2 00:09:56.528 02:29:29 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:09:56.528 02:29:29 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:09:56.528 02:29:29 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:09:56.528 02:29:29 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:09:56.528 02:29:29 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:56.528 02:29:29 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:56.528 02:29:29 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:09:56.528 02:29:29 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:09:56.528 02:29:29 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:09:56.528 02:29:29 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:56.528 02:29:29 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:09:56.528 02:29:29 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:56.528 02:29:29 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:09:56.528 192.168.100.9' 00:09:56.528 02:29:29 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:09:56.528 192.168.100.9' 00:09:56.528 02:29:29 -- nvmf/common.sh@446 -- # head -n 1 00:09:56.528 02:29:29 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:09:56.528 02:29:29 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:09:56.528 192.168.100.9' 00:09:56.528 02:29:29 -- nvmf/common.sh@447 -- # tail -n +2 00:09:56.528 02:29:29 -- nvmf/common.sh@447 -- # head -n 1 00:09:56.528 02:29:29 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:09:56.528 02:29:29 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:09:56.528 02:29:29 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:09:56.528 02:29:29 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:09:56.528 02:29:29 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:09:56.528 02:29:29 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:09:56.528 02:29:29 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:09:56.528 02:29:29 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:09:56.528 02:29:29 -- common/autotest_common.sh@710 -- # xtrace_disable 00:09:56.528 02:29:29 -- common/autotest_common.sh@10 -- # set +x 00:09:56.528 02:29:29 -- nvmf/common.sh@470 -- # nvmfpid=1461046 00:09:56.528 02:29:29 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:56.528 02:29:29 -- nvmf/common.sh@471 -- # waitforlisten 1461046 00:09:56.528 02:29:29 -- common/autotest_common.sh@817 -- # '[' -z 1461046 ']' 00:09:56.528 02:29:29 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:56.528 02:29:29 -- common/autotest_common.sh@822 -- # local max_retries=100 00:09:56.528 02:29:29 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:56.528 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:56.528 02:29:29 -- common/autotest_common.sh@826 -- # xtrace_disable 00:09:56.528 02:29:29 -- common/autotest_common.sh@10 -- # set +x 00:09:56.528 [2024-04-27 02:29:29.196676] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:09:56.528 [2024-04-27 02:29:29.196733] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:56.528 EAL: No free 2048 kB hugepages reported on node 1 00:09:56.528 [2024-04-27 02:29:29.265751] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:56.528 [2024-04-27 02:29:29.353221] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:56.528 [2024-04-27 02:29:29.353268] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:56.528 [2024-04-27 02:29:29.353278] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:09:56.528 [2024-04-27 02:29:29.353302] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:09:56.528 [2024-04-27 02:29:29.353310] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:56.528 [2024-04-27 02:29:29.353382] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:56.528 [2024-04-27 02:29:29.353467] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:56.528 [2024-04-27 02:29:29.353550] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:56.528 [2024-04-27 02:29:29.353551] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:09:56.528 02:29:30 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:09:56.528 02:29:30 -- common/autotest_common.sh@850 -- # return 0 00:09:56.528 02:29:30 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:09:56.528 02:29:30 -- common/autotest_common.sh@716 -- # xtrace_disable 00:09:56.528 02:29:30 -- common/autotest_common.sh@10 -- # set +x 00:09:56.528 02:29:30 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:56.528 02:29:30 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -c 0 00:09:56.528 02:29:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:56.528 02:29:30 -- common/autotest_common.sh@10 -- # set +x 00:09:56.528 [2024-04-27 02:29:30.068508] rdma.c:2712:nvmf_rdma_create: *WARNING*: In capsule data size is set to 256, this is minimum size required to support msdbd=16 00:09:56.528 [2024-04-27 02:29:30.090288] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xc424d0/0xc469c0) succeed. 00:09:56.528 [2024-04-27 02:29:30.100833] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xc43b10/0xc88050) succeed. 00:09:56.787 02:29:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:56.787 02:29:30 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:09:56.787 02:29:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:56.787 02:29:30 -- common/autotest_common.sh@10 -- # set +x 00:09:56.787 02:29:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:56.787 02:29:30 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:09:56.787 02:29:30 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:09:56.787 02:29:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:56.787 02:29:30 -- common/autotest_common.sh@10 -- # set +x 00:09:56.787 02:29:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:56.787 02:29:30 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:09:56.787 02:29:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:56.787 02:29:30 -- common/autotest_common.sh@10 -- # set +x 00:09:56.787 02:29:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:56.787 02:29:30 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:09:56.787 02:29:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:56.788 02:29:30 -- common/autotest_common.sh@10 -- # set +x 00:09:56.788 [2024-04-27 02:29:30.248466] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:09:56.788 02:29:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:56.788 02:29:30 -- target/connect_disconnect.sh@26 -- # '[' 0 -eq 1 ']' 00:09:56.788 02:29:30 -- target/connect_disconnect.sh@31 -- # num_iterations=5 00:09:56.788 02:29:30 -- target/connect_disconnect.sh@34 -- # set +x 00:10:00.986 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:05.182 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:09.412 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:12.700 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:16.895 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:16.895 02:29:50 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:10:16.895 02:29:50 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:10:16.895 02:29:50 -- nvmf/common.sh@477 -- # nvmfcleanup 00:10:16.895 02:29:50 -- nvmf/common.sh@117 -- # sync 00:10:16.895 02:29:50 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:10:16.895 02:29:50 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:10:16.895 02:29:50 -- nvmf/common.sh@120 -- # set +e 00:10:16.895 02:29:50 -- nvmf/common.sh@121 -- # for i in {1..20} 00:10:16.895 02:29:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:10:16.895 rmmod nvme_rdma 00:10:16.895 rmmod nvme_fabrics 00:10:16.895 02:29:50 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:10:16.895 02:29:50 -- nvmf/common.sh@124 -- # set -e 00:10:16.895 02:29:50 -- nvmf/common.sh@125 -- # return 0 00:10:16.895 02:29:50 -- nvmf/common.sh@478 -- # '[' -n 1461046 ']' 00:10:16.895 02:29:50 -- nvmf/common.sh@479 -- # killprocess 1461046 00:10:16.895 02:29:50 -- common/autotest_common.sh@936 -- # '[' -z 1461046 ']' 00:10:16.895 02:29:50 -- common/autotest_common.sh@940 -- # kill -0 1461046 00:10:16.895 02:29:50 -- common/autotest_common.sh@941 -- # uname 00:10:16.895 02:29:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:10:16.895 02:29:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1461046 00:10:16.895 02:29:50 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:10:16.896 02:29:50 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:10:16.896 02:29:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1461046' 00:10:16.896 killing process with pid 1461046 00:10:16.896 02:29:50 -- common/autotest_common.sh@955 -- # kill 1461046 00:10:16.896 02:29:50 -- common/autotest_common.sh@960 -- # wait 1461046 00:10:16.896 [2024-04-27 02:29:50.409729] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:10:17.155 02:29:50 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:10:17.155 02:29:50 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:10:17.155 00:10:17.155 real 0m27.433s 00:10:17.155 user 1m26.285s 00:10:17.155 sys 0m5.508s 00:10:17.155 02:29:50 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:10:17.155 02:29:50 -- common/autotest_common.sh@10 -- # set +x 00:10:17.155 ************************************ 00:10:17.155 END TEST nvmf_connect_disconnect 00:10:17.155 ************************************ 00:10:17.155 02:29:50 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=rdma 00:10:17.155 02:29:50 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:10:17.155 02:29:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:10:17.155 02:29:50 -- common/autotest_common.sh@10 -- # set +x 00:10:17.415 ************************************ 00:10:17.415 START TEST nvmf_multitarget 00:10:17.415 ************************************ 00:10:17.415 02:29:50 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=rdma 00:10:17.415 * Looking for test storage... 00:10:17.415 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:10:17.415 02:29:50 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:10:17.415 02:29:50 -- nvmf/common.sh@7 -- # uname -s 00:10:17.415 02:29:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:10:17.415 02:29:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:10:17.415 02:29:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:10:17.415 02:29:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:10:17.415 02:29:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:10:17.415 02:29:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:10:17.415 02:29:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:10:17.415 02:29:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:10:17.415 02:29:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:10:17.415 02:29:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:10:17.415 02:29:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:10:17.415 02:29:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:10:17.415 02:29:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:10:17.415 02:29:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:10:17.415 02:29:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:10:17.415 02:29:50 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:10:17.415 02:29:50 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:10:17.415 02:29:50 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:10:17.415 02:29:50 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:10:17.415 02:29:50 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:10:17.415 02:29:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:17.415 02:29:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:17.415 02:29:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:17.415 02:29:50 -- paths/export.sh@5 -- # export PATH 00:10:17.415 02:29:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:17.415 02:29:50 -- nvmf/common.sh@47 -- # : 0 00:10:17.415 02:29:50 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:10:17.415 02:29:50 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:10:17.415 02:29:50 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:10:17.415 02:29:50 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:10:17.415 02:29:50 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:10:17.415 02:29:50 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:10:17.415 02:29:50 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:10:17.415 02:29:50 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:10:17.415 02:29:50 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:10:17.415 02:29:50 -- target/multitarget.sh@15 -- # nvmftestinit 00:10:17.415 02:29:50 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:10:17.415 02:29:50 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:10:17.415 02:29:50 -- nvmf/common.sh@437 -- # prepare_net_devs 00:10:17.415 02:29:50 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:10:17.415 02:29:50 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:10:17.415 02:29:50 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:17.415 02:29:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:10:17.415 02:29:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:17.415 02:29:51 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:10:17.415 02:29:51 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:10:17.415 02:29:51 -- nvmf/common.sh@285 -- # xtrace_disable 00:10:17.415 02:29:51 -- common/autotest_common.sh@10 -- # set +x 00:10:23.986 02:29:56 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:10:23.986 02:29:56 -- nvmf/common.sh@291 -- # pci_devs=() 00:10:23.986 02:29:56 -- nvmf/common.sh@291 -- # local -a pci_devs 00:10:23.986 02:29:56 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:10:23.986 02:29:56 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:10:23.986 02:29:56 -- nvmf/common.sh@293 -- # pci_drivers=() 00:10:23.986 02:29:56 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:10:23.986 02:29:56 -- nvmf/common.sh@295 -- # net_devs=() 00:10:23.986 02:29:56 -- nvmf/common.sh@295 -- # local -ga net_devs 00:10:23.986 02:29:56 -- nvmf/common.sh@296 -- # e810=() 00:10:23.986 02:29:56 -- nvmf/common.sh@296 -- # local -ga e810 00:10:23.986 02:29:56 -- nvmf/common.sh@297 -- # x722=() 00:10:23.986 02:29:56 -- nvmf/common.sh@297 -- # local -ga x722 00:10:23.986 02:29:56 -- nvmf/common.sh@298 -- # mlx=() 00:10:23.986 02:29:56 -- nvmf/common.sh@298 -- # local -ga mlx 00:10:23.986 02:29:56 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:10:23.986 02:29:56 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:10:23.986 02:29:56 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:10:23.986 02:29:56 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:10:23.986 02:29:56 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:10:23.986 02:29:56 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:10:23.986 02:29:56 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:10:23.986 02:29:56 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:10:23.986 02:29:56 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:10:23.986 02:29:56 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:10:23.986 02:29:56 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:10:23.986 02:29:56 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:10:23.986 02:29:56 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:10:23.986 02:29:56 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:10:23.986 02:29:56 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:10:23.986 02:29:56 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:10:23.986 02:29:56 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:10:23.986 02:29:56 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:10:23.986 02:29:56 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:10:23.986 02:29:56 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:10:23.986 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:10:23.986 02:29:56 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:10:23.986 02:29:56 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:10:23.986 02:29:56 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:10:23.986 02:29:56 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:10:23.986 02:29:56 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:10:23.986 02:29:56 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:10:23.986 02:29:56 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:10:23.986 02:29:56 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:10:23.986 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:10:23.986 02:29:56 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:10:23.986 02:29:56 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:10:23.986 02:29:56 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:10:23.986 02:29:56 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:10:23.986 02:29:56 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:10:23.986 02:29:56 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:10:23.986 02:29:56 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:10:23.986 02:29:56 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:10:23.987 02:29:56 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:10:23.987 02:29:56 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:10:23.987 02:29:56 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:10:23.987 02:29:56 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:10:23.987 02:29:56 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:10:23.987 Found net devices under 0000:18:00.0: mlx_0_0 00:10:23.987 02:29:56 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:10:23.987 02:29:56 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:10:23.987 02:29:56 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:10:23.987 02:29:56 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:10:23.987 02:29:56 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:10:23.987 02:29:56 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:10:23.987 Found net devices under 0000:18:00.1: mlx_0_1 00:10:23.987 02:29:56 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:10:23.987 02:29:56 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:10:23.987 02:29:56 -- nvmf/common.sh@403 -- # is_hw=yes 00:10:23.987 02:29:56 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:10:23.987 02:29:56 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:10:23.987 02:29:56 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:10:23.987 02:29:56 -- nvmf/common.sh@409 -- # rdma_device_init 00:10:23.987 02:29:56 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:10:23.987 02:29:56 -- nvmf/common.sh@58 -- # uname 00:10:23.987 02:29:56 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:10:23.987 02:29:56 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:10:23.987 02:29:56 -- nvmf/common.sh@63 -- # modprobe ib_core 00:10:23.987 02:29:56 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:10:23.987 02:29:56 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:10:23.987 02:29:56 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:10:23.987 02:29:56 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:10:23.987 02:29:56 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:10:23.987 02:29:56 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:10:23.987 02:29:56 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:10:23.987 02:29:56 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:10:23.987 02:29:56 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:10:23.987 02:29:56 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:10:23.987 02:29:56 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:10:23.987 02:29:56 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:10:23.987 02:29:56 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:10:23.987 02:29:56 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:23.987 02:29:56 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:23.987 02:29:56 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:10:23.987 02:29:56 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:10:23.987 02:29:56 -- nvmf/common.sh@105 -- # continue 2 00:10:23.987 02:29:56 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:23.987 02:29:56 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:23.987 02:29:56 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:10:23.987 02:29:56 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:23.987 02:29:56 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:10:23.987 02:29:56 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:10:23.987 02:29:56 -- nvmf/common.sh@105 -- # continue 2 00:10:23.987 02:29:56 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:10:23.987 02:29:56 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:10:23.987 02:29:56 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:10:23.987 02:29:56 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:23.987 02:29:56 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:23.987 02:29:56 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:10:23.987 02:29:56 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:10:23.987 02:29:56 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:10:23.987 02:29:56 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:10:23.987 60: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:10:23.987 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:10:23.987 altname enp24s0f0np0 00:10:23.987 altname ens785f0np0 00:10:23.987 inet 192.168.100.8/24 scope global mlx_0_0 00:10:23.987 valid_lft forever preferred_lft forever 00:10:23.987 02:29:56 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:10:23.987 02:29:56 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:10:23.987 02:29:56 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:10:23.987 02:29:56 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:10:23.987 02:29:56 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:23.987 02:29:56 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:23.987 02:29:56 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:10:23.987 02:29:56 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:10:23.987 02:29:56 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:10:23.987 61: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:10:23.987 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:10:23.987 altname enp24s0f1np1 00:10:23.987 altname ens785f1np1 00:10:23.987 inet 192.168.100.9/24 scope global mlx_0_1 00:10:23.987 valid_lft forever preferred_lft forever 00:10:23.987 02:29:56 -- nvmf/common.sh@411 -- # return 0 00:10:23.987 02:29:56 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:10:23.987 02:29:56 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:10:23.987 02:29:56 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:10:23.987 02:29:56 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:10:23.987 02:29:56 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:10:23.987 02:29:56 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:10:23.987 02:29:56 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:10:23.987 02:29:56 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:10:23.987 02:29:56 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:10:23.987 02:29:56 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:10:23.987 02:29:56 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:23.987 02:29:56 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:23.987 02:29:56 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:10:23.987 02:29:56 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:10:23.987 02:29:56 -- nvmf/common.sh@105 -- # continue 2 00:10:23.987 02:29:56 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:23.987 02:29:56 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:23.987 02:29:56 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:10:23.987 02:29:56 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:23.987 02:29:56 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:10:23.987 02:29:56 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:10:23.987 02:29:56 -- nvmf/common.sh@105 -- # continue 2 00:10:23.987 02:29:56 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:10:23.987 02:29:56 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:10:23.987 02:29:56 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:10:23.987 02:29:56 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:23.987 02:29:56 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:10:23.987 02:29:56 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:23.987 02:29:56 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:10:23.987 02:29:56 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:10:23.987 02:29:56 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:10:23.987 02:29:56 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:10:23.987 02:29:56 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:23.987 02:29:56 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:23.987 02:29:56 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:10:23.987 192.168.100.9' 00:10:23.987 02:29:56 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:10:23.987 192.168.100.9' 00:10:23.987 02:29:56 -- nvmf/common.sh@446 -- # head -n 1 00:10:23.987 02:29:56 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:10:23.987 02:29:56 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:10:23.987 192.168.100.9' 00:10:23.987 02:29:56 -- nvmf/common.sh@447 -- # tail -n +2 00:10:23.987 02:29:56 -- nvmf/common.sh@447 -- # head -n 1 00:10:23.987 02:29:56 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:10:23.987 02:29:56 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:10:23.987 02:29:56 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:10:23.987 02:29:56 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:10:23.987 02:29:56 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:10:23.987 02:29:56 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:10:23.987 02:29:56 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:10:23.987 02:29:56 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:10:23.987 02:29:56 -- common/autotest_common.sh@710 -- # xtrace_disable 00:10:23.987 02:29:56 -- common/autotest_common.sh@10 -- # set +x 00:10:23.987 02:29:56 -- nvmf/common.sh@470 -- # nvmfpid=1466774 00:10:23.987 02:29:56 -- nvmf/common.sh@471 -- # waitforlisten 1466774 00:10:23.987 02:29:56 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:10:23.987 02:29:56 -- common/autotest_common.sh@817 -- # '[' -z 1466774 ']' 00:10:23.987 02:29:56 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:10:23.988 02:29:56 -- common/autotest_common.sh@822 -- # local max_retries=100 00:10:23.988 02:29:56 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:10:23.988 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:10:23.988 02:29:56 -- common/autotest_common.sh@826 -- # xtrace_disable 00:10:23.988 02:29:56 -- common/autotest_common.sh@10 -- # set +x 00:10:23.988 [2024-04-27 02:29:56.787093] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:10:23.988 [2024-04-27 02:29:56.787144] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:10:23.988 EAL: No free 2048 kB hugepages reported on node 1 00:10:23.988 [2024-04-27 02:29:56.857707] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:10:23.988 [2024-04-27 02:29:56.943997] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:10:23.988 [2024-04-27 02:29:56.944038] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:10:23.988 [2024-04-27 02:29:56.944047] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:10:23.988 [2024-04-27 02:29:56.944056] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:10:23.988 [2024-04-27 02:29:56.944063] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:10:23.988 [2024-04-27 02:29:56.944105] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:10:23.988 [2024-04-27 02:29:56.944193] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:10:23.988 [2024-04-27 02:29:56.944276] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:10:23.988 [2024-04-27 02:29:56.944278] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:10:23.988 02:29:57 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:10:23.988 02:29:57 -- common/autotest_common.sh@850 -- # return 0 00:10:23.988 02:29:57 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:10:23.988 02:29:57 -- common/autotest_common.sh@716 -- # xtrace_disable 00:10:23.988 02:29:57 -- common/autotest_common.sh@10 -- # set +x 00:10:24.247 02:29:57 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:10:24.247 02:29:57 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:10:24.247 02:29:57 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:10:24.247 02:29:57 -- target/multitarget.sh@21 -- # jq length 00:10:24.247 02:29:57 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:10:24.247 02:29:57 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:10:24.247 "nvmf_tgt_1" 00:10:24.506 02:29:57 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:10:24.506 "nvmf_tgt_2" 00:10:24.506 02:29:57 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:10:24.506 02:29:57 -- target/multitarget.sh@28 -- # jq length 00:10:24.506 02:29:58 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:10:24.506 02:29:58 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:10:24.764 true 00:10:24.764 02:29:58 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:10:24.764 true 00:10:24.764 02:29:58 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:10:24.764 02:29:58 -- target/multitarget.sh@35 -- # jq length 00:10:25.023 02:29:58 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:10:25.023 02:29:58 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:10:25.023 02:29:58 -- target/multitarget.sh@41 -- # nvmftestfini 00:10:25.023 02:29:58 -- nvmf/common.sh@477 -- # nvmfcleanup 00:10:25.023 02:29:58 -- nvmf/common.sh@117 -- # sync 00:10:25.023 02:29:58 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:10:25.023 02:29:58 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:10:25.023 02:29:58 -- nvmf/common.sh@120 -- # set +e 00:10:25.023 02:29:58 -- nvmf/common.sh@121 -- # for i in {1..20} 00:10:25.023 02:29:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:10:25.023 rmmod nvme_rdma 00:10:25.023 rmmod nvme_fabrics 00:10:25.023 02:29:58 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:10:25.023 02:29:58 -- nvmf/common.sh@124 -- # set -e 00:10:25.023 02:29:58 -- nvmf/common.sh@125 -- # return 0 00:10:25.023 02:29:58 -- nvmf/common.sh@478 -- # '[' -n 1466774 ']' 00:10:25.023 02:29:58 -- nvmf/common.sh@479 -- # killprocess 1466774 00:10:25.023 02:29:58 -- common/autotest_common.sh@936 -- # '[' -z 1466774 ']' 00:10:25.023 02:29:58 -- common/autotest_common.sh@940 -- # kill -0 1466774 00:10:25.023 02:29:58 -- common/autotest_common.sh@941 -- # uname 00:10:25.023 02:29:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:10:25.023 02:29:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1466774 00:10:25.023 02:29:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:10:25.023 02:29:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:10:25.023 02:29:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1466774' 00:10:25.023 killing process with pid 1466774 00:10:25.023 02:29:58 -- common/autotest_common.sh@955 -- # kill 1466774 00:10:25.023 02:29:58 -- common/autotest_common.sh@960 -- # wait 1466774 00:10:25.282 02:29:58 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:10:25.282 02:29:58 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:10:25.282 00:10:25.282 real 0m7.875s 00:10:25.282 user 0m9.577s 00:10:25.282 sys 0m4.874s 00:10:25.282 02:29:58 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:10:25.282 02:29:58 -- common/autotest_common.sh@10 -- # set +x 00:10:25.282 ************************************ 00:10:25.282 END TEST nvmf_multitarget 00:10:25.282 ************************************ 00:10:25.282 02:29:58 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=rdma 00:10:25.282 02:29:58 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:10:25.282 02:29:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:10:25.282 02:29:58 -- common/autotest_common.sh@10 -- # set +x 00:10:25.543 ************************************ 00:10:25.543 START TEST nvmf_rpc 00:10:25.543 ************************************ 00:10:25.543 02:29:58 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=rdma 00:10:25.543 * Looking for test storage... 00:10:25.543 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:10:25.543 02:29:59 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:10:25.543 02:29:59 -- nvmf/common.sh@7 -- # uname -s 00:10:25.543 02:29:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:10:25.543 02:29:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:10:25.543 02:29:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:10:25.543 02:29:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:10:25.543 02:29:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:10:25.543 02:29:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:10:25.543 02:29:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:10:25.543 02:29:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:10:25.543 02:29:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:10:25.543 02:29:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:10:25.543 02:29:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:10:25.543 02:29:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:10:25.543 02:29:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:10:25.543 02:29:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:10:25.543 02:29:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:10:25.543 02:29:59 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:10:25.543 02:29:59 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:10:25.543 02:29:59 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:10:25.543 02:29:59 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:10:25.543 02:29:59 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:10:25.543 02:29:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:25.543 02:29:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:25.543 02:29:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:25.543 02:29:59 -- paths/export.sh@5 -- # export PATH 00:10:25.543 02:29:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:25.543 02:29:59 -- nvmf/common.sh@47 -- # : 0 00:10:25.543 02:29:59 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:10:25.543 02:29:59 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:10:25.543 02:29:59 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:10:25.543 02:29:59 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:10:25.543 02:29:59 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:10:25.543 02:29:59 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:10:25.543 02:29:59 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:10:25.543 02:29:59 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:10:25.543 02:29:59 -- target/rpc.sh@11 -- # loops=5 00:10:25.543 02:29:59 -- target/rpc.sh@23 -- # nvmftestinit 00:10:25.543 02:29:59 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:10:25.543 02:29:59 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:10:25.543 02:29:59 -- nvmf/common.sh@437 -- # prepare_net_devs 00:10:25.543 02:29:59 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:10:25.543 02:29:59 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:10:25.543 02:29:59 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:25.543 02:29:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:10:25.543 02:29:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:25.543 02:29:59 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:10:25.543 02:29:59 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:10:25.543 02:29:59 -- nvmf/common.sh@285 -- # xtrace_disable 00:10:25.543 02:29:59 -- common/autotest_common.sh@10 -- # set +x 00:10:32.115 02:30:04 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:10:32.115 02:30:04 -- nvmf/common.sh@291 -- # pci_devs=() 00:10:32.115 02:30:04 -- nvmf/common.sh@291 -- # local -a pci_devs 00:10:32.115 02:30:04 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:10:32.115 02:30:04 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:10:32.115 02:30:04 -- nvmf/common.sh@293 -- # pci_drivers=() 00:10:32.115 02:30:04 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:10:32.115 02:30:04 -- nvmf/common.sh@295 -- # net_devs=() 00:10:32.115 02:30:04 -- nvmf/common.sh@295 -- # local -ga net_devs 00:10:32.115 02:30:04 -- nvmf/common.sh@296 -- # e810=() 00:10:32.115 02:30:04 -- nvmf/common.sh@296 -- # local -ga e810 00:10:32.115 02:30:04 -- nvmf/common.sh@297 -- # x722=() 00:10:32.115 02:30:04 -- nvmf/common.sh@297 -- # local -ga x722 00:10:32.115 02:30:04 -- nvmf/common.sh@298 -- # mlx=() 00:10:32.115 02:30:04 -- nvmf/common.sh@298 -- # local -ga mlx 00:10:32.115 02:30:04 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:10:32.115 02:30:04 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:10:32.115 02:30:04 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:10:32.115 02:30:04 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:10:32.115 02:30:04 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:10:32.115 02:30:04 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:10:32.115 02:30:04 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:10:32.115 02:30:04 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:10:32.115 02:30:04 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:10:32.115 02:30:04 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:10:32.115 02:30:04 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:10:32.115 02:30:04 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:10:32.115 02:30:04 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:10:32.115 02:30:04 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:10:32.115 02:30:04 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:10:32.115 02:30:04 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:10:32.115 02:30:04 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:10:32.115 02:30:04 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:10:32.115 02:30:04 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:10:32.115 02:30:04 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:10:32.115 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:10:32.115 02:30:04 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:10:32.115 02:30:04 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:10:32.115 02:30:04 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:10:32.115 02:30:04 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:10:32.115 02:30:04 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:10:32.115 02:30:04 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:10:32.115 02:30:04 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:10:32.115 02:30:04 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:10:32.115 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:10:32.115 02:30:04 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:10:32.115 02:30:04 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:10:32.115 02:30:04 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:10:32.115 02:30:04 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:10:32.115 02:30:04 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:10:32.115 02:30:04 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:10:32.115 02:30:04 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:10:32.115 02:30:04 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:10:32.115 02:30:04 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:10:32.115 02:30:04 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:10:32.115 02:30:04 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:10:32.115 02:30:04 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:10:32.115 02:30:04 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:10:32.115 Found net devices under 0000:18:00.0: mlx_0_0 00:10:32.115 02:30:04 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:10:32.115 02:30:04 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:10:32.115 02:30:04 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:10:32.115 02:30:04 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:10:32.115 02:30:04 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:10:32.115 02:30:04 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:10:32.115 Found net devices under 0000:18:00.1: mlx_0_1 00:10:32.115 02:30:04 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:10:32.115 02:30:04 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:10:32.115 02:30:04 -- nvmf/common.sh@403 -- # is_hw=yes 00:10:32.115 02:30:04 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:10:32.115 02:30:04 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:10:32.115 02:30:04 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:10:32.115 02:30:04 -- nvmf/common.sh@409 -- # rdma_device_init 00:10:32.115 02:30:04 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:10:32.115 02:30:04 -- nvmf/common.sh@58 -- # uname 00:10:32.115 02:30:04 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:10:32.115 02:30:04 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:10:32.115 02:30:04 -- nvmf/common.sh@63 -- # modprobe ib_core 00:10:32.115 02:30:04 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:10:32.115 02:30:04 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:10:32.115 02:30:04 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:10:32.115 02:30:04 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:10:32.115 02:30:04 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:10:32.115 02:30:04 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:10:32.115 02:30:04 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:10:32.115 02:30:04 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:10:32.115 02:30:04 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:10:32.115 02:30:04 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:10:32.116 02:30:04 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:10:32.116 02:30:04 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:10:32.116 02:30:04 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:10:32.116 02:30:04 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:32.116 02:30:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:32.116 02:30:04 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:10:32.116 02:30:04 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:10:32.116 02:30:04 -- nvmf/common.sh@105 -- # continue 2 00:10:32.116 02:30:04 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:32.116 02:30:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:32.116 02:30:04 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:10:32.116 02:30:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:32.116 02:30:04 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:10:32.116 02:30:04 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:10:32.116 02:30:04 -- nvmf/common.sh@105 -- # continue 2 00:10:32.116 02:30:04 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:10:32.116 02:30:04 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:10:32.116 02:30:04 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:10:32.116 02:30:04 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:10:32.116 02:30:04 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:32.116 02:30:04 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:32.116 02:30:04 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:10:32.116 02:30:04 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:10:32.116 02:30:04 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:10:32.116 60: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:10:32.116 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:10:32.116 altname enp24s0f0np0 00:10:32.116 altname ens785f0np0 00:10:32.116 inet 192.168.100.8/24 scope global mlx_0_0 00:10:32.116 valid_lft forever preferred_lft forever 00:10:32.116 02:30:04 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:10:32.116 02:30:04 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:10:32.116 02:30:04 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:10:32.116 02:30:04 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:10:32.116 02:30:04 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:32.116 02:30:04 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:32.116 02:30:04 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:10:32.116 02:30:04 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:10:32.116 02:30:04 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:10:32.116 61: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:10:32.116 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:10:32.116 altname enp24s0f1np1 00:10:32.116 altname ens785f1np1 00:10:32.116 inet 192.168.100.9/24 scope global mlx_0_1 00:10:32.116 valid_lft forever preferred_lft forever 00:10:32.116 02:30:04 -- nvmf/common.sh@411 -- # return 0 00:10:32.116 02:30:04 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:10:32.116 02:30:04 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:10:32.116 02:30:04 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:10:32.116 02:30:04 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:10:32.116 02:30:04 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:10:32.116 02:30:04 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:10:32.116 02:30:04 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:10:32.116 02:30:04 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:10:32.116 02:30:04 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:10:32.116 02:30:04 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:10:32.116 02:30:04 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:32.116 02:30:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:32.116 02:30:04 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:10:32.116 02:30:04 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:10:32.116 02:30:04 -- nvmf/common.sh@105 -- # continue 2 00:10:32.116 02:30:04 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:32.116 02:30:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:32.116 02:30:04 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:10:32.116 02:30:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:32.116 02:30:04 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:10:32.116 02:30:04 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:10:32.116 02:30:04 -- nvmf/common.sh@105 -- # continue 2 00:10:32.116 02:30:04 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:10:32.116 02:30:04 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:10:32.116 02:30:04 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:10:32.116 02:30:04 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:10:32.116 02:30:04 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:32.116 02:30:04 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:32.116 02:30:04 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:10:32.116 02:30:04 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:10:32.116 02:30:04 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:10:32.116 02:30:04 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:10:32.116 02:30:04 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:32.116 02:30:04 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:32.116 02:30:04 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:10:32.116 192.168.100.9' 00:10:32.116 02:30:04 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:10:32.116 192.168.100.9' 00:10:32.116 02:30:04 -- nvmf/common.sh@446 -- # head -n 1 00:10:32.116 02:30:04 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:10:32.116 02:30:04 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:10:32.116 192.168.100.9' 00:10:32.116 02:30:04 -- nvmf/common.sh@447 -- # tail -n +2 00:10:32.116 02:30:04 -- nvmf/common.sh@447 -- # head -n 1 00:10:32.116 02:30:04 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:10:32.116 02:30:04 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:10:32.116 02:30:04 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:10:32.116 02:30:04 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:10:32.116 02:30:04 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:10:32.116 02:30:04 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:10:32.116 02:30:04 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:10:32.116 02:30:04 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:10:32.116 02:30:04 -- common/autotest_common.sh@710 -- # xtrace_disable 00:10:32.116 02:30:04 -- common/autotest_common.sh@10 -- # set +x 00:10:32.116 02:30:04 -- nvmf/common.sh@470 -- # nvmfpid=1470270 00:10:32.116 02:30:04 -- nvmf/common.sh@471 -- # waitforlisten 1470270 00:10:32.116 02:30:04 -- common/autotest_common.sh@817 -- # '[' -z 1470270 ']' 00:10:32.116 02:30:04 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:10:32.116 02:30:04 -- common/autotest_common.sh@822 -- # local max_retries=100 00:10:32.116 02:30:04 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:10:32.116 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:10:32.116 02:30:04 -- common/autotest_common.sh@826 -- # xtrace_disable 00:10:32.116 02:30:04 -- common/autotest_common.sh@10 -- # set +x 00:10:32.116 02:30:04 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:10:32.116 [2024-04-27 02:30:05.000814] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:10:32.116 [2024-04-27 02:30:05.000874] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:10:32.116 EAL: No free 2048 kB hugepages reported on node 1 00:10:32.116 [2024-04-27 02:30:05.075204] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:10:32.116 [2024-04-27 02:30:05.164627] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:10:32.116 [2024-04-27 02:30:05.164671] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:10:32.116 [2024-04-27 02:30:05.164684] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:10:32.116 [2024-04-27 02:30:05.164692] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:10:32.116 [2024-04-27 02:30:05.164699] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:10:32.116 [2024-04-27 02:30:05.164784] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:10:32.116 [2024-04-27 02:30:05.164867] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:10:32.116 [2024-04-27 02:30:05.164946] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:10:32.116 [2024-04-27 02:30:05.164947] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:10:32.375 02:30:05 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:10:32.375 02:30:05 -- common/autotest_common.sh@850 -- # return 0 00:10:32.375 02:30:05 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:10:32.375 02:30:05 -- common/autotest_common.sh@716 -- # xtrace_disable 00:10:32.375 02:30:05 -- common/autotest_common.sh@10 -- # set +x 00:10:32.376 02:30:05 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:10:32.376 02:30:05 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:10:32.376 02:30:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:32.376 02:30:05 -- common/autotest_common.sh@10 -- # set +x 00:10:32.376 02:30:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:32.376 02:30:05 -- target/rpc.sh@26 -- # stats='{ 00:10:32.376 "tick_rate": 2300000000, 00:10:32.376 "poll_groups": [ 00:10:32.376 { 00:10:32.376 "name": "nvmf_tgt_poll_group_0", 00:10:32.376 "admin_qpairs": 0, 00:10:32.376 "io_qpairs": 0, 00:10:32.376 "current_admin_qpairs": 0, 00:10:32.376 "current_io_qpairs": 0, 00:10:32.376 "pending_bdev_io": 0, 00:10:32.376 "completed_nvme_io": 0, 00:10:32.376 "transports": [] 00:10:32.376 }, 00:10:32.376 { 00:10:32.376 "name": "nvmf_tgt_poll_group_1", 00:10:32.376 "admin_qpairs": 0, 00:10:32.376 "io_qpairs": 0, 00:10:32.376 "current_admin_qpairs": 0, 00:10:32.376 "current_io_qpairs": 0, 00:10:32.376 "pending_bdev_io": 0, 00:10:32.376 "completed_nvme_io": 0, 00:10:32.376 "transports": [] 00:10:32.376 }, 00:10:32.376 { 00:10:32.376 "name": "nvmf_tgt_poll_group_2", 00:10:32.376 "admin_qpairs": 0, 00:10:32.376 "io_qpairs": 0, 00:10:32.376 "current_admin_qpairs": 0, 00:10:32.376 "current_io_qpairs": 0, 00:10:32.376 "pending_bdev_io": 0, 00:10:32.376 "completed_nvme_io": 0, 00:10:32.376 "transports": [] 00:10:32.376 }, 00:10:32.376 { 00:10:32.376 "name": "nvmf_tgt_poll_group_3", 00:10:32.376 "admin_qpairs": 0, 00:10:32.376 "io_qpairs": 0, 00:10:32.376 "current_admin_qpairs": 0, 00:10:32.376 "current_io_qpairs": 0, 00:10:32.376 "pending_bdev_io": 0, 00:10:32.376 "completed_nvme_io": 0, 00:10:32.376 "transports": [] 00:10:32.376 } 00:10:32.376 ] 00:10:32.376 }' 00:10:32.376 02:30:05 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:10:32.376 02:30:05 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:10:32.376 02:30:05 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:10:32.376 02:30:05 -- target/rpc.sh@15 -- # wc -l 00:10:32.376 02:30:05 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:10:32.376 02:30:05 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:10:32.376 02:30:05 -- target/rpc.sh@29 -- # [[ null == null ]] 00:10:32.376 02:30:05 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:10:32.376 02:30:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:32.376 02:30:05 -- common/autotest_common.sh@10 -- # set +x 00:10:32.635 [2024-04-27 02:30:06.009856] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x587530/0x58ba20) succeed. 00:10:32.635 [2024-04-27 02:30:06.020400] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x588b70/0x5cd0b0) succeed. 00:10:32.635 02:30:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:32.635 02:30:06 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:10:32.635 02:30:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:32.635 02:30:06 -- common/autotest_common.sh@10 -- # set +x 00:10:32.635 02:30:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:32.635 02:30:06 -- target/rpc.sh@33 -- # stats='{ 00:10:32.635 "tick_rate": 2300000000, 00:10:32.635 "poll_groups": [ 00:10:32.635 { 00:10:32.635 "name": "nvmf_tgt_poll_group_0", 00:10:32.635 "admin_qpairs": 0, 00:10:32.635 "io_qpairs": 0, 00:10:32.635 "current_admin_qpairs": 0, 00:10:32.635 "current_io_qpairs": 0, 00:10:32.635 "pending_bdev_io": 0, 00:10:32.635 "completed_nvme_io": 0, 00:10:32.635 "transports": [ 00:10:32.635 { 00:10:32.635 "trtype": "RDMA", 00:10:32.635 "pending_data_buffer": 0, 00:10:32.635 "devices": [ 00:10:32.635 { 00:10:32.635 "name": "mlx5_0", 00:10:32.635 "polls": 15626, 00:10:32.635 "idle_polls": 15626, 00:10:32.635 "completions": 0, 00:10:32.635 "requests": 0, 00:10:32.635 "request_latency": 0, 00:10:32.635 "pending_free_request": 0, 00:10:32.635 "pending_rdma_read": 0, 00:10:32.635 "pending_rdma_write": 0, 00:10:32.635 "pending_rdma_send": 0, 00:10:32.635 "total_send_wrs": 0, 00:10:32.635 "send_doorbell_updates": 0, 00:10:32.635 "total_recv_wrs": 4096, 00:10:32.635 "recv_doorbell_updates": 1 00:10:32.635 }, 00:10:32.635 { 00:10:32.635 "name": "mlx5_1", 00:10:32.635 "polls": 15626, 00:10:32.635 "idle_polls": 15626, 00:10:32.635 "completions": 0, 00:10:32.635 "requests": 0, 00:10:32.635 "request_latency": 0, 00:10:32.635 "pending_free_request": 0, 00:10:32.635 "pending_rdma_read": 0, 00:10:32.635 "pending_rdma_write": 0, 00:10:32.635 "pending_rdma_send": 0, 00:10:32.635 "total_send_wrs": 0, 00:10:32.635 "send_doorbell_updates": 0, 00:10:32.635 "total_recv_wrs": 4096, 00:10:32.635 "recv_doorbell_updates": 1 00:10:32.635 } 00:10:32.635 ] 00:10:32.635 } 00:10:32.635 ] 00:10:32.635 }, 00:10:32.635 { 00:10:32.635 "name": "nvmf_tgt_poll_group_1", 00:10:32.635 "admin_qpairs": 0, 00:10:32.635 "io_qpairs": 0, 00:10:32.635 "current_admin_qpairs": 0, 00:10:32.635 "current_io_qpairs": 0, 00:10:32.635 "pending_bdev_io": 0, 00:10:32.635 "completed_nvme_io": 0, 00:10:32.635 "transports": [ 00:10:32.635 { 00:10:32.635 "trtype": "RDMA", 00:10:32.635 "pending_data_buffer": 0, 00:10:32.635 "devices": [ 00:10:32.635 { 00:10:32.635 "name": "mlx5_0", 00:10:32.635 "polls": 10008, 00:10:32.635 "idle_polls": 10008, 00:10:32.635 "completions": 0, 00:10:32.635 "requests": 0, 00:10:32.635 "request_latency": 0, 00:10:32.635 "pending_free_request": 0, 00:10:32.635 "pending_rdma_read": 0, 00:10:32.635 "pending_rdma_write": 0, 00:10:32.635 "pending_rdma_send": 0, 00:10:32.635 "total_send_wrs": 0, 00:10:32.635 "send_doorbell_updates": 0, 00:10:32.635 "total_recv_wrs": 4096, 00:10:32.635 "recv_doorbell_updates": 1 00:10:32.635 }, 00:10:32.635 { 00:10:32.635 "name": "mlx5_1", 00:10:32.635 "polls": 10008, 00:10:32.635 "idle_polls": 10008, 00:10:32.635 "completions": 0, 00:10:32.635 "requests": 0, 00:10:32.636 "request_latency": 0, 00:10:32.636 "pending_free_request": 0, 00:10:32.636 "pending_rdma_read": 0, 00:10:32.636 "pending_rdma_write": 0, 00:10:32.636 "pending_rdma_send": 0, 00:10:32.636 "total_send_wrs": 0, 00:10:32.636 "send_doorbell_updates": 0, 00:10:32.636 "total_recv_wrs": 4096, 00:10:32.636 "recv_doorbell_updates": 1 00:10:32.636 } 00:10:32.636 ] 00:10:32.636 } 00:10:32.636 ] 00:10:32.636 }, 00:10:32.636 { 00:10:32.636 "name": "nvmf_tgt_poll_group_2", 00:10:32.636 "admin_qpairs": 0, 00:10:32.636 "io_qpairs": 0, 00:10:32.636 "current_admin_qpairs": 0, 00:10:32.636 "current_io_qpairs": 0, 00:10:32.636 "pending_bdev_io": 0, 00:10:32.636 "completed_nvme_io": 0, 00:10:32.636 "transports": [ 00:10:32.636 { 00:10:32.636 "trtype": "RDMA", 00:10:32.636 "pending_data_buffer": 0, 00:10:32.636 "devices": [ 00:10:32.636 { 00:10:32.636 "name": "mlx5_0", 00:10:32.636 "polls": 5500, 00:10:32.636 "idle_polls": 5500, 00:10:32.636 "completions": 0, 00:10:32.636 "requests": 0, 00:10:32.636 "request_latency": 0, 00:10:32.636 "pending_free_request": 0, 00:10:32.636 "pending_rdma_read": 0, 00:10:32.636 "pending_rdma_write": 0, 00:10:32.636 "pending_rdma_send": 0, 00:10:32.636 "total_send_wrs": 0, 00:10:32.636 "send_doorbell_updates": 0, 00:10:32.636 "total_recv_wrs": 4096, 00:10:32.636 "recv_doorbell_updates": 1 00:10:32.636 }, 00:10:32.636 { 00:10:32.636 "name": "mlx5_1", 00:10:32.636 "polls": 5500, 00:10:32.636 "idle_polls": 5500, 00:10:32.636 "completions": 0, 00:10:32.636 "requests": 0, 00:10:32.636 "request_latency": 0, 00:10:32.636 "pending_free_request": 0, 00:10:32.636 "pending_rdma_read": 0, 00:10:32.636 "pending_rdma_write": 0, 00:10:32.636 "pending_rdma_send": 0, 00:10:32.636 "total_send_wrs": 0, 00:10:32.636 "send_doorbell_updates": 0, 00:10:32.636 "total_recv_wrs": 4096, 00:10:32.636 "recv_doorbell_updates": 1 00:10:32.636 } 00:10:32.636 ] 00:10:32.636 } 00:10:32.636 ] 00:10:32.636 }, 00:10:32.636 { 00:10:32.636 "name": "nvmf_tgt_poll_group_3", 00:10:32.636 "admin_qpairs": 0, 00:10:32.636 "io_qpairs": 0, 00:10:32.636 "current_admin_qpairs": 0, 00:10:32.636 "current_io_qpairs": 0, 00:10:32.636 "pending_bdev_io": 0, 00:10:32.636 "completed_nvme_io": 0, 00:10:32.636 "transports": [ 00:10:32.636 { 00:10:32.636 "trtype": "RDMA", 00:10:32.636 "pending_data_buffer": 0, 00:10:32.636 "devices": [ 00:10:32.636 { 00:10:32.636 "name": "mlx5_0", 00:10:32.636 "polls": 899, 00:10:32.636 "idle_polls": 899, 00:10:32.636 "completions": 0, 00:10:32.636 "requests": 0, 00:10:32.636 "request_latency": 0, 00:10:32.636 "pending_free_request": 0, 00:10:32.636 "pending_rdma_read": 0, 00:10:32.636 "pending_rdma_write": 0, 00:10:32.636 "pending_rdma_send": 0, 00:10:32.636 "total_send_wrs": 0, 00:10:32.636 "send_doorbell_updates": 0, 00:10:32.636 "total_recv_wrs": 4096, 00:10:32.636 "recv_doorbell_updates": 1 00:10:32.636 }, 00:10:32.636 { 00:10:32.636 "name": "mlx5_1", 00:10:32.636 "polls": 899, 00:10:32.636 "idle_polls": 899, 00:10:32.636 "completions": 0, 00:10:32.636 "requests": 0, 00:10:32.636 "request_latency": 0, 00:10:32.636 "pending_free_request": 0, 00:10:32.636 "pending_rdma_read": 0, 00:10:32.636 "pending_rdma_write": 0, 00:10:32.636 "pending_rdma_send": 0, 00:10:32.636 "total_send_wrs": 0, 00:10:32.636 "send_doorbell_updates": 0, 00:10:32.636 "total_recv_wrs": 4096, 00:10:32.636 "recv_doorbell_updates": 1 00:10:32.636 } 00:10:32.636 ] 00:10:32.636 } 00:10:32.636 ] 00:10:32.636 } 00:10:32.636 ] 00:10:32.636 }' 00:10:32.636 02:30:06 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:10:32.636 02:30:06 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:10:32.636 02:30:06 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:10:32.636 02:30:06 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:10:32.636 02:30:06 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:10:32.636 02:30:06 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:10:32.636 02:30:06 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:10:32.636 02:30:06 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:10:32.636 02:30:06 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:10:32.896 02:30:06 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:10:32.896 02:30:06 -- target/rpc.sh@38 -- # '[' rdma == rdma ']' 00:10:32.896 02:30:06 -- target/rpc.sh@40 -- # jcount '.poll_groups[0].transports[].trtype' 00:10:32.896 02:30:06 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[0].transports[].trtype' 00:10:32.896 02:30:06 -- target/rpc.sh@15 -- # jq '.poll_groups[0].transports[].trtype' 00:10:32.896 02:30:06 -- target/rpc.sh@15 -- # wc -l 00:10:32.896 02:30:06 -- target/rpc.sh@40 -- # (( 1 == 1 )) 00:10:32.896 02:30:06 -- target/rpc.sh@41 -- # jq -r '.poll_groups[0].transports[0].trtype' 00:10:32.896 02:30:06 -- target/rpc.sh@41 -- # transport_type=RDMA 00:10:32.896 02:30:06 -- target/rpc.sh@42 -- # [[ rdma == \r\d\m\a ]] 00:10:32.896 02:30:06 -- target/rpc.sh@43 -- # jcount '.poll_groups[0].transports[0].devices[].name' 00:10:32.896 02:30:06 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[0].transports[0].devices[].name' 00:10:32.896 02:30:06 -- target/rpc.sh@15 -- # wc -l 00:10:32.896 02:30:06 -- target/rpc.sh@15 -- # jq '.poll_groups[0].transports[0].devices[].name' 00:10:32.896 02:30:06 -- target/rpc.sh@43 -- # (( 2 > 0 )) 00:10:32.896 02:30:06 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:10:32.896 02:30:06 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:10:32.896 02:30:06 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:10:32.896 02:30:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:32.896 02:30:06 -- common/autotest_common.sh@10 -- # set +x 00:10:32.896 Malloc1 00:10:32.896 02:30:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:32.896 02:30:06 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:10:32.896 02:30:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:32.896 02:30:06 -- common/autotest_common.sh@10 -- # set +x 00:10:32.896 02:30:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:32.896 02:30:06 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:10:32.896 02:30:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:32.896 02:30:06 -- common/autotest_common.sh@10 -- # set +x 00:10:32.896 02:30:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:32.896 02:30:06 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:10:32.896 02:30:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:32.896 02:30:06 -- common/autotest_common.sh@10 -- # set +x 00:10:32.896 02:30:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:32.896 02:30:06 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:10:32.896 02:30:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:32.896 02:30:06 -- common/autotest_common.sh@10 -- # set +x 00:10:32.896 [2024-04-27 02:30:06.468497] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:10:32.897 02:30:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:32.897 02:30:06 -- target/rpc.sh@58 -- # NOT nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 -a 192.168.100.8 -s 4420 00:10:32.897 02:30:06 -- common/autotest_common.sh@638 -- # local es=0 00:10:32.897 02:30:06 -- common/autotest_common.sh@640 -- # valid_exec_arg nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 -a 192.168.100.8 -s 4420 00:10:32.897 02:30:06 -- common/autotest_common.sh@626 -- # local arg=nvme 00:10:32.897 02:30:06 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:10:32.897 02:30:06 -- common/autotest_common.sh@630 -- # type -t nvme 00:10:32.897 02:30:06 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:10:32.897 02:30:06 -- common/autotest_common.sh@632 -- # type -P nvme 00:10:32.897 02:30:06 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:10:32.897 02:30:06 -- common/autotest_common.sh@632 -- # arg=/usr/sbin/nvme 00:10:32.897 02:30:06 -- common/autotest_common.sh@632 -- # [[ -x /usr/sbin/nvme ]] 00:10:32.897 02:30:06 -- common/autotest_common.sh@641 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 -a 192.168.100.8 -s 4420 00:10:32.897 [2024-04-27 02:30:06.514228] ctrlr.c: 766:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562' 00:10:33.157 Failed to write to /dev/nvme-fabrics: Input/output error 00:10:33.157 could not add new controller: failed to write to nvme-fabrics device 00:10:33.157 02:30:06 -- common/autotest_common.sh@641 -- # es=1 00:10:33.157 02:30:06 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:10:33.157 02:30:06 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:10:33.157 02:30:06 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:10:33.157 02:30:06 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:10:33.157 02:30:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:33.157 02:30:06 -- common/autotest_common.sh@10 -- # set +x 00:10:33.157 02:30:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:33.157 02:30:06 -- target/rpc.sh@62 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:10:34.094 02:30:07 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:10:34.094 02:30:07 -- common/autotest_common.sh@1184 -- # local i=0 00:10:34.094 02:30:07 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:10:34.094 02:30:07 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:10:34.094 02:30:07 -- common/autotest_common.sh@1191 -- # sleep 2 00:10:36.001 02:30:09 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:10:36.001 02:30:09 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:10:36.001 02:30:09 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:10:36.001 02:30:09 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:10:36.001 02:30:09 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:10:36.001 02:30:09 -- common/autotest_common.sh@1194 -- # return 0 00:10:36.001 02:30:09 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:10:36.970 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:36.970 02:30:10 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:10:36.970 02:30:10 -- common/autotest_common.sh@1205 -- # local i=0 00:10:36.970 02:30:10 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:10:36.970 02:30:10 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:10:36.970 02:30:10 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:10:36.970 02:30:10 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:10:36.970 02:30:10 -- common/autotest_common.sh@1217 -- # return 0 00:10:36.970 02:30:10 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:10:36.970 02:30:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:36.970 02:30:10 -- common/autotest_common.sh@10 -- # set +x 00:10:36.970 02:30:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:36.970 02:30:10 -- target/rpc.sh@69 -- # NOT nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:10:36.970 02:30:10 -- common/autotest_common.sh@638 -- # local es=0 00:10:36.970 02:30:10 -- common/autotest_common.sh@640 -- # valid_exec_arg nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:10:36.970 02:30:10 -- common/autotest_common.sh@626 -- # local arg=nvme 00:10:36.970 02:30:10 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:10:36.970 02:30:10 -- common/autotest_common.sh@630 -- # type -t nvme 00:10:36.970 02:30:10 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:10:36.970 02:30:10 -- common/autotest_common.sh@632 -- # type -P nvme 00:10:36.970 02:30:10 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:10:36.970 02:30:10 -- common/autotest_common.sh@632 -- # arg=/usr/sbin/nvme 00:10:36.970 02:30:10 -- common/autotest_common.sh@632 -- # [[ -x /usr/sbin/nvme ]] 00:10:36.970 02:30:10 -- common/autotest_common.sh@641 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:10:36.970 [2024-04-27 02:30:10.586209] ctrlr.c: 766:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562' 00:10:37.230 Failed to write to /dev/nvme-fabrics: Input/output error 00:10:37.230 could not add new controller: failed to write to nvme-fabrics device 00:10:37.230 02:30:10 -- common/autotest_common.sh@641 -- # es=1 00:10:37.230 02:30:10 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:10:37.230 02:30:10 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:10:37.230 02:30:10 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:10:37.230 02:30:10 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:10:37.230 02:30:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:37.230 02:30:10 -- common/autotest_common.sh@10 -- # set +x 00:10:37.230 02:30:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:37.230 02:30:10 -- target/rpc.sh@73 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:10:38.169 02:30:11 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:10:38.169 02:30:11 -- common/autotest_common.sh@1184 -- # local i=0 00:10:38.169 02:30:11 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:10:38.169 02:30:11 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:10:38.169 02:30:11 -- common/autotest_common.sh@1191 -- # sleep 2 00:10:40.076 02:30:13 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:10:40.076 02:30:13 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:10:40.076 02:30:13 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:10:40.076 02:30:13 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:10:40.076 02:30:13 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:10:40.076 02:30:13 -- common/autotest_common.sh@1194 -- # return 0 00:10:40.076 02:30:13 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:10:41.013 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:41.013 02:30:14 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:10:41.013 02:30:14 -- common/autotest_common.sh@1205 -- # local i=0 00:10:41.013 02:30:14 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:10:41.013 02:30:14 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:10:41.013 02:30:14 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:10:41.013 02:30:14 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:10:41.013 02:30:14 -- common/autotest_common.sh@1217 -- # return 0 00:10:41.013 02:30:14 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:10:41.013 02:30:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:41.013 02:30:14 -- common/autotest_common.sh@10 -- # set +x 00:10:41.013 02:30:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:41.013 02:30:14 -- target/rpc.sh@81 -- # seq 1 5 00:10:41.013 02:30:14 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:10:41.013 02:30:14 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:10:41.013 02:30:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:41.013 02:30:14 -- common/autotest_common.sh@10 -- # set +x 00:10:41.273 02:30:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:41.273 02:30:14 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:10:41.273 02:30:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:41.273 02:30:14 -- common/autotest_common.sh@10 -- # set +x 00:10:41.273 [2024-04-27 02:30:14.647940] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:10:41.273 02:30:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:41.273 02:30:14 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:10:41.273 02:30:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:41.273 02:30:14 -- common/autotest_common.sh@10 -- # set +x 00:10:41.273 02:30:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:41.273 02:30:14 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:10:41.273 02:30:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:41.273 02:30:14 -- common/autotest_common.sh@10 -- # set +x 00:10:41.273 02:30:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:41.273 02:30:14 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:10:42.211 02:30:15 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:10:42.211 02:30:15 -- common/autotest_common.sh@1184 -- # local i=0 00:10:42.211 02:30:15 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:10:42.211 02:30:15 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:10:42.211 02:30:15 -- common/autotest_common.sh@1191 -- # sleep 2 00:10:44.118 02:30:17 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:10:44.118 02:30:17 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:10:44.118 02:30:17 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:10:44.118 02:30:17 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:10:44.118 02:30:17 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:10:44.118 02:30:17 -- common/autotest_common.sh@1194 -- # return 0 00:10:44.118 02:30:17 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:10:45.054 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:45.054 02:30:18 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:10:45.054 02:30:18 -- common/autotest_common.sh@1205 -- # local i=0 00:10:45.054 02:30:18 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:10:45.054 02:30:18 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:10:45.054 02:30:18 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:10:45.054 02:30:18 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:10:45.314 02:30:18 -- common/autotest_common.sh@1217 -- # return 0 00:10:45.314 02:30:18 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:10:45.314 02:30:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:45.314 02:30:18 -- common/autotest_common.sh@10 -- # set +x 00:10:45.314 02:30:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:45.314 02:30:18 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:10:45.314 02:30:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:45.314 02:30:18 -- common/autotest_common.sh@10 -- # set +x 00:10:45.314 02:30:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:45.314 02:30:18 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:10:45.314 02:30:18 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:10:45.314 02:30:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:45.314 02:30:18 -- common/autotest_common.sh@10 -- # set +x 00:10:45.314 02:30:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:45.314 02:30:18 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:10:45.314 02:30:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:45.314 02:30:18 -- common/autotest_common.sh@10 -- # set +x 00:10:45.314 [2024-04-27 02:30:18.706554] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:10:45.314 02:30:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:45.314 02:30:18 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:10:45.314 02:30:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:45.314 02:30:18 -- common/autotest_common.sh@10 -- # set +x 00:10:45.314 02:30:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:45.314 02:30:18 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:10:45.314 02:30:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:45.314 02:30:18 -- common/autotest_common.sh@10 -- # set +x 00:10:45.314 02:30:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:45.314 02:30:18 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:10:46.251 02:30:19 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:10:46.251 02:30:19 -- common/autotest_common.sh@1184 -- # local i=0 00:10:46.251 02:30:19 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:10:46.251 02:30:19 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:10:46.251 02:30:19 -- common/autotest_common.sh@1191 -- # sleep 2 00:10:48.156 02:30:21 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:10:48.156 02:30:21 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:10:48.156 02:30:21 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:10:48.156 02:30:21 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:10:48.156 02:30:21 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:10:48.156 02:30:21 -- common/autotest_common.sh@1194 -- # return 0 00:10:48.156 02:30:21 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:10:49.094 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:49.094 02:30:22 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:10:49.094 02:30:22 -- common/autotest_common.sh@1205 -- # local i=0 00:10:49.094 02:30:22 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:10:49.094 02:30:22 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:10:49.094 02:30:22 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:10:49.094 02:30:22 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:10:49.094 02:30:22 -- common/autotest_common.sh@1217 -- # return 0 00:10:49.094 02:30:22 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:10:49.094 02:30:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:49.094 02:30:22 -- common/autotest_common.sh@10 -- # set +x 00:10:49.353 02:30:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:49.353 02:30:22 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:10:49.353 02:30:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:49.353 02:30:22 -- common/autotest_common.sh@10 -- # set +x 00:10:49.353 02:30:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:49.353 02:30:22 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:10:49.353 02:30:22 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:10:49.353 02:30:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:49.353 02:30:22 -- common/autotest_common.sh@10 -- # set +x 00:10:49.353 02:30:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:49.353 02:30:22 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:10:49.353 02:30:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:49.353 02:30:22 -- common/autotest_common.sh@10 -- # set +x 00:10:49.353 [2024-04-27 02:30:22.745279] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:10:49.353 02:30:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:49.353 02:30:22 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:10:49.353 02:30:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:49.353 02:30:22 -- common/autotest_common.sh@10 -- # set +x 00:10:49.353 02:30:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:49.353 02:30:22 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:10:49.353 02:30:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:49.353 02:30:22 -- common/autotest_common.sh@10 -- # set +x 00:10:49.353 02:30:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:49.353 02:30:22 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:10:50.289 02:30:23 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:10:50.289 02:30:23 -- common/autotest_common.sh@1184 -- # local i=0 00:10:50.289 02:30:23 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:10:50.289 02:30:23 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:10:50.289 02:30:23 -- common/autotest_common.sh@1191 -- # sleep 2 00:10:52.191 02:30:25 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:10:52.191 02:30:25 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:10:52.191 02:30:25 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:10:52.191 02:30:25 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:10:52.191 02:30:25 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:10:52.191 02:30:25 -- common/autotest_common.sh@1194 -- # return 0 00:10:52.191 02:30:25 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:10:53.127 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:53.127 02:30:26 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:10:53.127 02:30:26 -- common/autotest_common.sh@1205 -- # local i=0 00:10:53.127 02:30:26 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:10:53.127 02:30:26 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:10:53.127 02:30:26 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:10:53.127 02:30:26 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:10:53.127 02:30:26 -- common/autotest_common.sh@1217 -- # return 0 00:10:53.127 02:30:26 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:10:53.127 02:30:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:53.127 02:30:26 -- common/autotest_common.sh@10 -- # set +x 00:10:53.127 02:30:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:53.127 02:30:26 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:10:53.127 02:30:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:53.127 02:30:26 -- common/autotest_common.sh@10 -- # set +x 00:10:53.387 02:30:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:53.387 02:30:26 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:10:53.387 02:30:26 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:10:53.387 02:30:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:53.387 02:30:26 -- common/autotest_common.sh@10 -- # set +x 00:10:53.387 02:30:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:53.387 02:30:26 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:10:53.387 02:30:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:53.387 02:30:26 -- common/autotest_common.sh@10 -- # set +x 00:10:53.387 [2024-04-27 02:30:26.766353] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:10:53.387 02:30:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:53.387 02:30:26 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:10:53.387 02:30:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:53.387 02:30:26 -- common/autotest_common.sh@10 -- # set +x 00:10:53.387 02:30:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:53.387 02:30:26 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:10:53.387 02:30:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:53.387 02:30:26 -- common/autotest_common.sh@10 -- # set +x 00:10:53.387 02:30:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:53.387 02:30:26 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:10:54.324 02:30:27 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:10:54.324 02:30:27 -- common/autotest_common.sh@1184 -- # local i=0 00:10:54.324 02:30:27 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:10:54.324 02:30:27 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:10:54.324 02:30:27 -- common/autotest_common.sh@1191 -- # sleep 2 00:10:56.294 02:30:29 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:10:56.294 02:30:29 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:10:56.294 02:30:29 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:10:56.294 02:30:29 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:10:56.294 02:30:29 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:10:56.294 02:30:29 -- common/autotest_common.sh@1194 -- # return 0 00:10:56.294 02:30:29 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:10:57.233 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:57.233 02:30:30 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:10:57.233 02:30:30 -- common/autotest_common.sh@1205 -- # local i=0 00:10:57.233 02:30:30 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:10:57.233 02:30:30 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:10:57.233 02:30:30 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:10:57.233 02:30:30 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:10:57.233 02:30:30 -- common/autotest_common.sh@1217 -- # return 0 00:10:57.233 02:30:30 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:10:57.233 02:30:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:57.233 02:30:30 -- common/autotest_common.sh@10 -- # set +x 00:10:57.233 02:30:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:57.233 02:30:30 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:10:57.233 02:30:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:57.233 02:30:30 -- common/autotest_common.sh@10 -- # set +x 00:10:57.233 02:30:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:57.233 02:30:30 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:10:57.233 02:30:30 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:10:57.233 02:30:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:57.233 02:30:30 -- common/autotest_common.sh@10 -- # set +x 00:10:57.233 02:30:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:57.233 02:30:30 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:10:57.233 02:30:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:57.233 02:30:30 -- common/autotest_common.sh@10 -- # set +x 00:10:57.233 [2024-04-27 02:30:30.776110] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:10:57.233 02:30:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:57.233 02:30:30 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:10:57.233 02:30:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:57.233 02:30:30 -- common/autotest_common.sh@10 -- # set +x 00:10:57.233 02:30:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:57.233 02:30:30 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:10:57.233 02:30:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:57.233 02:30:30 -- common/autotest_common.sh@10 -- # set +x 00:10:57.233 02:30:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:57.233 02:30:30 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:10:58.171 02:30:31 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:10:58.171 02:30:31 -- common/autotest_common.sh@1184 -- # local i=0 00:10:58.171 02:30:31 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:10:58.171 02:30:31 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:10:58.171 02:30:31 -- common/autotest_common.sh@1191 -- # sleep 2 00:11:00.709 02:30:33 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:11:00.709 02:30:33 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:11:00.709 02:30:33 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:11:00.709 02:30:33 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:11:00.709 02:30:33 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:11:00.709 02:30:33 -- common/autotest_common.sh@1194 -- # return 0 00:11:00.709 02:30:33 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:01.277 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:01.277 02:30:34 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:01.277 02:30:34 -- common/autotest_common.sh@1205 -- # local i=0 00:11:01.277 02:30:34 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:11:01.277 02:30:34 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:01.277 02:30:34 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:01.277 02:30:34 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:11:01.277 02:30:34 -- common/autotest_common.sh@1217 -- # return 0 00:11:01.277 02:30:34 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:01.277 02:30:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:01.277 02:30:34 -- common/autotest_common.sh@10 -- # set +x 00:11:01.277 02:30:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:01.277 02:30:34 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:01.277 02:30:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:01.277 02:30:34 -- common/autotest_common.sh@10 -- # set +x 00:11:01.277 02:30:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:01.277 02:30:34 -- target/rpc.sh@99 -- # seq 1 5 00:11:01.277 02:30:34 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:01.277 02:30:34 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:01.277 02:30:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:01.277 02:30:34 -- common/autotest_common.sh@10 -- # set +x 00:11:01.277 02:30:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:01.277 02:30:34 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:11:01.277 02:30:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:01.277 02:30:34 -- common/autotest_common.sh@10 -- # set +x 00:11:01.277 [2024-04-27 02:30:34.801548] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:11:01.277 02:30:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:01.277 02:30:34 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:01.277 02:30:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:01.277 02:30:34 -- common/autotest_common.sh@10 -- # set +x 00:11:01.277 02:30:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:01.277 02:30:34 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:01.277 02:30:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:01.277 02:30:34 -- common/autotest_common.sh@10 -- # set +x 00:11:01.277 02:30:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:01.277 02:30:34 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:01.277 02:30:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:01.277 02:30:34 -- common/autotest_common.sh@10 -- # set +x 00:11:01.277 02:30:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:01.277 02:30:34 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:01.277 02:30:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:01.277 02:30:34 -- common/autotest_common.sh@10 -- # set +x 00:11:01.278 02:30:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:01.278 02:30:34 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:01.278 02:30:34 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:01.278 02:30:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:01.278 02:30:34 -- common/autotest_common.sh@10 -- # set +x 00:11:01.278 02:30:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:01.278 02:30:34 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:11:01.278 02:30:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:01.278 02:30:34 -- common/autotest_common.sh@10 -- # set +x 00:11:01.278 [2024-04-27 02:30:34.849709] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:11:01.278 02:30:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:01.278 02:30:34 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:01.278 02:30:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:01.278 02:30:34 -- common/autotest_common.sh@10 -- # set +x 00:11:01.278 02:30:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:01.278 02:30:34 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:01.278 02:30:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:01.278 02:30:34 -- common/autotest_common.sh@10 -- # set +x 00:11:01.278 02:30:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:01.278 02:30:34 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:01.278 02:30:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:01.278 02:30:34 -- common/autotest_common.sh@10 -- # set +x 00:11:01.278 02:30:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:01.278 02:30:34 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:01.278 02:30:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:01.278 02:30:34 -- common/autotest_common.sh@10 -- # set +x 00:11:01.278 02:30:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:01.278 02:30:34 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:01.278 02:30:34 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:01.278 02:30:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:01.278 02:30:34 -- common/autotest_common.sh@10 -- # set +x 00:11:01.278 02:30:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:01.278 02:30:34 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:11:01.278 02:30:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:01.278 02:30:34 -- common/autotest_common.sh@10 -- # set +x 00:11:01.278 [2024-04-27 02:30:34.897884] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:11:01.551 02:30:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:01.551 02:30:34 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:01.551 02:30:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:01.551 02:30:34 -- common/autotest_common.sh@10 -- # set +x 00:11:01.551 02:30:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:01.551 02:30:34 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:01.551 02:30:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:01.551 02:30:34 -- common/autotest_common.sh@10 -- # set +x 00:11:01.551 02:30:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:01.551 02:30:34 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:01.551 02:30:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:01.551 02:30:34 -- common/autotest_common.sh@10 -- # set +x 00:11:01.551 02:30:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:01.551 02:30:34 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:01.551 02:30:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:01.551 02:30:34 -- common/autotest_common.sh@10 -- # set +x 00:11:01.551 02:30:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:01.551 02:30:34 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:01.551 02:30:34 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:01.551 02:30:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:01.551 02:30:34 -- common/autotest_common.sh@10 -- # set +x 00:11:01.551 02:30:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:01.551 02:30:34 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:11:01.551 02:30:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:01.551 02:30:34 -- common/autotest_common.sh@10 -- # set +x 00:11:01.551 [2024-04-27 02:30:34.950038] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:11:01.551 02:30:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:01.551 02:30:34 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:01.551 02:30:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:01.551 02:30:34 -- common/autotest_common.sh@10 -- # set +x 00:11:01.551 02:30:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:01.551 02:30:34 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:01.551 02:30:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:01.551 02:30:34 -- common/autotest_common.sh@10 -- # set +x 00:11:01.551 02:30:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:01.551 02:30:34 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:01.551 02:30:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:01.551 02:30:34 -- common/autotest_common.sh@10 -- # set +x 00:11:01.551 02:30:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:01.551 02:30:34 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:01.551 02:30:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:01.551 02:30:34 -- common/autotest_common.sh@10 -- # set +x 00:11:01.551 02:30:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:01.551 02:30:34 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:01.551 02:30:34 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:01.551 02:30:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:01.551 02:30:34 -- common/autotest_common.sh@10 -- # set +x 00:11:01.551 02:30:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:01.551 02:30:34 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:11:01.551 02:30:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:01.551 02:30:34 -- common/autotest_common.sh@10 -- # set +x 00:11:01.551 [2024-04-27 02:30:34.998249] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:11:01.551 02:30:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:01.551 02:30:35 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:01.551 02:30:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:01.551 02:30:35 -- common/autotest_common.sh@10 -- # set +x 00:11:01.551 02:30:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:01.551 02:30:35 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:01.551 02:30:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:01.551 02:30:35 -- common/autotest_common.sh@10 -- # set +x 00:11:01.551 02:30:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:01.551 02:30:35 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:01.551 02:30:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:01.551 02:30:35 -- common/autotest_common.sh@10 -- # set +x 00:11:01.551 02:30:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:01.551 02:30:35 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:01.551 02:30:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:01.551 02:30:35 -- common/autotest_common.sh@10 -- # set +x 00:11:01.551 02:30:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:01.551 02:30:35 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:11:01.551 02:30:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:01.551 02:30:35 -- common/autotest_common.sh@10 -- # set +x 00:11:01.551 02:30:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:01.551 02:30:35 -- target/rpc.sh@110 -- # stats='{ 00:11:01.551 "tick_rate": 2300000000, 00:11:01.551 "poll_groups": [ 00:11:01.551 { 00:11:01.551 "name": "nvmf_tgt_poll_group_0", 00:11:01.551 "admin_qpairs": 2, 00:11:01.551 "io_qpairs": 27, 00:11:01.551 "current_admin_qpairs": 0, 00:11:01.551 "current_io_qpairs": 0, 00:11:01.551 "pending_bdev_io": 0, 00:11:01.551 "completed_nvme_io": 126, 00:11:01.551 "transports": [ 00:11:01.551 { 00:11:01.551 "trtype": "RDMA", 00:11:01.551 "pending_data_buffer": 0, 00:11:01.551 "devices": [ 00:11:01.551 { 00:11:01.551 "name": "mlx5_0", 00:11:01.551 "polls": 3508424, 00:11:01.551 "idle_polls": 3508098, 00:11:01.551 "completions": 367, 00:11:01.551 "requests": 183, 00:11:01.551 "request_latency": 35272226, 00:11:01.551 "pending_free_request": 0, 00:11:01.551 "pending_rdma_read": 0, 00:11:01.551 "pending_rdma_write": 0, 00:11:01.551 "pending_rdma_send": 0, 00:11:01.551 "total_send_wrs": 309, 00:11:01.551 "send_doorbell_updates": 158, 00:11:01.551 "total_recv_wrs": 4279, 00:11:01.551 "recv_doorbell_updates": 158 00:11:01.551 }, 00:11:01.551 { 00:11:01.551 "name": "mlx5_1", 00:11:01.551 "polls": 3508424, 00:11:01.551 "idle_polls": 3508424, 00:11:01.551 "completions": 0, 00:11:01.551 "requests": 0, 00:11:01.551 "request_latency": 0, 00:11:01.551 "pending_free_request": 0, 00:11:01.551 "pending_rdma_read": 0, 00:11:01.551 "pending_rdma_write": 0, 00:11:01.551 "pending_rdma_send": 0, 00:11:01.551 "total_send_wrs": 0, 00:11:01.551 "send_doorbell_updates": 0, 00:11:01.551 "total_recv_wrs": 4096, 00:11:01.551 "recv_doorbell_updates": 1 00:11:01.551 } 00:11:01.551 ] 00:11:01.551 } 00:11:01.551 ] 00:11:01.551 }, 00:11:01.551 { 00:11:01.551 "name": "nvmf_tgt_poll_group_1", 00:11:01.551 "admin_qpairs": 2, 00:11:01.551 "io_qpairs": 26, 00:11:01.551 "current_admin_qpairs": 0, 00:11:01.551 "current_io_qpairs": 0, 00:11:01.551 "pending_bdev_io": 0, 00:11:01.551 "completed_nvme_io": 126, 00:11:01.551 "transports": [ 00:11:01.551 { 00:11:01.551 "trtype": "RDMA", 00:11:01.551 "pending_data_buffer": 0, 00:11:01.551 "devices": [ 00:11:01.551 { 00:11:01.551 "name": "mlx5_0", 00:11:01.551 "polls": 3478989, 00:11:01.551 "idle_polls": 3478667, 00:11:01.551 "completions": 362, 00:11:01.551 "requests": 181, 00:11:01.551 "request_latency": 35006142, 00:11:01.551 "pending_free_request": 0, 00:11:01.551 "pending_rdma_read": 0, 00:11:01.551 "pending_rdma_write": 0, 00:11:01.551 "pending_rdma_send": 0, 00:11:01.551 "total_send_wrs": 307, 00:11:01.551 "send_doorbell_updates": 156, 00:11:01.551 "total_recv_wrs": 4277, 00:11:01.551 "recv_doorbell_updates": 157 00:11:01.551 }, 00:11:01.551 { 00:11:01.551 "name": "mlx5_1", 00:11:01.551 "polls": 3478989, 00:11:01.551 "idle_polls": 3478989, 00:11:01.551 "completions": 0, 00:11:01.551 "requests": 0, 00:11:01.551 "request_latency": 0, 00:11:01.551 "pending_free_request": 0, 00:11:01.551 "pending_rdma_read": 0, 00:11:01.551 "pending_rdma_write": 0, 00:11:01.551 "pending_rdma_send": 0, 00:11:01.551 "total_send_wrs": 0, 00:11:01.551 "send_doorbell_updates": 0, 00:11:01.551 "total_recv_wrs": 4096, 00:11:01.551 "recv_doorbell_updates": 1 00:11:01.551 } 00:11:01.551 ] 00:11:01.551 } 00:11:01.551 ] 00:11:01.551 }, 00:11:01.551 { 00:11:01.551 "name": "nvmf_tgt_poll_group_2", 00:11:01.551 "admin_qpairs": 1, 00:11:01.551 "io_qpairs": 26, 00:11:01.551 "current_admin_qpairs": 0, 00:11:01.551 "current_io_qpairs": 0, 00:11:01.551 "pending_bdev_io": 0, 00:11:01.551 "completed_nvme_io": 126, 00:11:01.551 "transports": [ 00:11:01.551 { 00:11:01.552 "trtype": "RDMA", 00:11:01.552 "pending_data_buffer": 0, 00:11:01.552 "devices": [ 00:11:01.552 { 00:11:01.552 "name": "mlx5_0", 00:11:01.552 "polls": 3471485, 00:11:01.552 "idle_polls": 3471217, 00:11:01.552 "completions": 309, 00:11:01.552 "requests": 154, 00:11:01.552 "request_latency": 34192600, 00:11:01.552 "pending_free_request": 0, 00:11:01.552 "pending_rdma_read": 0, 00:11:01.552 "pending_rdma_write": 0, 00:11:01.552 "pending_rdma_send": 0, 00:11:01.552 "total_send_wrs": 267, 00:11:01.552 "send_doorbell_updates": 131, 00:11:01.552 "total_recv_wrs": 4250, 00:11:01.552 "recv_doorbell_updates": 131 00:11:01.552 }, 00:11:01.552 { 00:11:01.552 "name": "mlx5_1", 00:11:01.552 "polls": 3471485, 00:11:01.552 "idle_polls": 3471485, 00:11:01.552 "completions": 0, 00:11:01.552 "requests": 0, 00:11:01.552 "request_latency": 0, 00:11:01.552 "pending_free_request": 0, 00:11:01.552 "pending_rdma_read": 0, 00:11:01.552 "pending_rdma_write": 0, 00:11:01.552 "pending_rdma_send": 0, 00:11:01.552 "total_send_wrs": 0, 00:11:01.552 "send_doorbell_updates": 0, 00:11:01.552 "total_recv_wrs": 4096, 00:11:01.552 "recv_doorbell_updates": 1 00:11:01.552 } 00:11:01.552 ] 00:11:01.552 } 00:11:01.552 ] 00:11:01.552 }, 00:11:01.552 { 00:11:01.552 "name": "nvmf_tgt_poll_group_3", 00:11:01.552 "admin_qpairs": 2, 00:11:01.552 "io_qpairs": 26, 00:11:01.552 "current_admin_qpairs": 0, 00:11:01.552 "current_io_qpairs": 0, 00:11:01.552 "pending_bdev_io": 0, 00:11:01.552 "completed_nvme_io": 77, 00:11:01.552 "transports": [ 00:11:01.552 { 00:11:01.552 "trtype": "RDMA", 00:11:01.552 "pending_data_buffer": 0, 00:11:01.552 "devices": [ 00:11:01.552 { 00:11:01.552 "name": "mlx5_0", 00:11:01.552 "polls": 2761457, 00:11:01.552 "idle_polls": 2761218, 00:11:01.552 "completions": 264, 00:11:01.552 "requests": 132, 00:11:01.552 "request_latency": 22896640, 00:11:01.552 "pending_free_request": 0, 00:11:01.552 "pending_rdma_read": 0, 00:11:01.552 "pending_rdma_write": 0, 00:11:01.552 "pending_rdma_send": 0, 00:11:01.552 "total_send_wrs": 208, 00:11:01.552 "send_doorbell_updates": 119, 00:11:01.552 "total_recv_wrs": 4228, 00:11:01.552 "recv_doorbell_updates": 120 00:11:01.552 }, 00:11:01.552 { 00:11:01.552 "name": "mlx5_1", 00:11:01.552 "polls": 2761457, 00:11:01.552 "idle_polls": 2761457, 00:11:01.552 "completions": 0, 00:11:01.552 "requests": 0, 00:11:01.552 "request_latency": 0, 00:11:01.552 "pending_free_request": 0, 00:11:01.552 "pending_rdma_read": 0, 00:11:01.552 "pending_rdma_write": 0, 00:11:01.552 "pending_rdma_send": 0, 00:11:01.552 "total_send_wrs": 0, 00:11:01.552 "send_doorbell_updates": 0, 00:11:01.552 "total_recv_wrs": 4096, 00:11:01.552 "recv_doorbell_updates": 1 00:11:01.552 } 00:11:01.552 ] 00:11:01.552 } 00:11:01.552 ] 00:11:01.552 } 00:11:01.552 ] 00:11:01.552 }' 00:11:01.552 02:30:35 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:11:01.552 02:30:35 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:11:01.552 02:30:35 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:11:01.552 02:30:35 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:01.552 02:30:35 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:11:01.552 02:30:35 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:11:01.552 02:30:35 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:11:01.552 02:30:35 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:11:01.552 02:30:35 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:01.816 02:30:35 -- target/rpc.sh@113 -- # (( 105 > 0 )) 00:11:01.816 02:30:35 -- target/rpc.sh@115 -- # '[' rdma == rdma ']' 00:11:01.816 02:30:35 -- target/rpc.sh@117 -- # jsum '.poll_groups[].transports[].devices[].completions' 00:11:01.816 02:30:35 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].transports[].devices[].completions' 00:11:01.816 02:30:35 -- target/rpc.sh@20 -- # jq '.poll_groups[].transports[].devices[].completions' 00:11:01.816 02:30:35 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:01.816 02:30:35 -- target/rpc.sh@117 -- # (( 1302 > 0 )) 00:11:01.816 02:30:35 -- target/rpc.sh@118 -- # jsum '.poll_groups[].transports[].devices[].request_latency' 00:11:01.816 02:30:35 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].transports[].devices[].request_latency' 00:11:01.816 02:30:35 -- target/rpc.sh@20 -- # jq '.poll_groups[].transports[].devices[].request_latency' 00:11:01.816 02:30:35 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:01.816 02:30:35 -- target/rpc.sh@118 -- # (( 127367608 > 0 )) 00:11:01.816 02:30:35 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:11:01.816 02:30:35 -- target/rpc.sh@123 -- # nvmftestfini 00:11:01.816 02:30:35 -- nvmf/common.sh@477 -- # nvmfcleanup 00:11:01.816 02:30:35 -- nvmf/common.sh@117 -- # sync 00:11:01.816 02:30:35 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:11:01.816 02:30:35 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:11:01.816 02:30:35 -- nvmf/common.sh@120 -- # set +e 00:11:01.816 02:30:35 -- nvmf/common.sh@121 -- # for i in {1..20} 00:11:01.816 02:30:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:11:01.816 rmmod nvme_rdma 00:11:01.816 rmmod nvme_fabrics 00:11:01.816 02:30:35 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:11:01.816 02:30:35 -- nvmf/common.sh@124 -- # set -e 00:11:01.816 02:30:35 -- nvmf/common.sh@125 -- # return 0 00:11:01.816 02:30:35 -- nvmf/common.sh@478 -- # '[' -n 1470270 ']' 00:11:01.816 02:30:35 -- nvmf/common.sh@479 -- # killprocess 1470270 00:11:01.816 02:30:35 -- common/autotest_common.sh@936 -- # '[' -z 1470270 ']' 00:11:01.816 02:30:35 -- common/autotest_common.sh@940 -- # kill -0 1470270 00:11:01.816 02:30:35 -- common/autotest_common.sh@941 -- # uname 00:11:01.816 02:30:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:01.816 02:30:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1470270 00:11:01.816 02:30:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:01.816 02:30:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:01.816 02:30:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1470270' 00:11:01.816 killing process with pid 1470270 00:11:01.816 02:30:35 -- common/autotest_common.sh@955 -- # kill 1470270 00:11:01.816 02:30:35 -- common/autotest_common.sh@960 -- # wait 1470270 00:11:02.076 [2024-04-27 02:30:35.458985] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:11:02.335 02:30:35 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:11:02.335 02:30:35 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:11:02.335 00:11:02.335 real 0m36.755s 00:11:02.335 user 2m3.573s 00:11:02.335 sys 0m6.155s 00:11:02.335 02:30:35 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:11:02.335 02:30:35 -- common/autotest_common.sh@10 -- # set +x 00:11:02.335 ************************************ 00:11:02.335 END TEST nvmf_rpc 00:11:02.335 ************************************ 00:11:02.335 02:30:35 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=rdma 00:11:02.335 02:30:35 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:02.335 02:30:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:02.335 02:30:35 -- common/autotest_common.sh@10 -- # set +x 00:11:02.335 ************************************ 00:11:02.335 START TEST nvmf_invalid 00:11:02.335 ************************************ 00:11:02.335 02:30:35 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=rdma 00:11:02.595 * Looking for test storage... 00:11:02.595 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:11:02.595 02:30:36 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:11:02.595 02:30:36 -- nvmf/common.sh@7 -- # uname -s 00:11:02.595 02:30:36 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:02.595 02:30:36 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:02.595 02:30:36 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:02.595 02:30:36 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:02.595 02:30:36 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:02.595 02:30:36 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:02.595 02:30:36 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:02.595 02:30:36 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:02.595 02:30:36 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:02.595 02:30:36 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:02.595 02:30:36 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:11:02.595 02:30:36 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:11:02.595 02:30:36 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:02.595 02:30:36 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:02.595 02:30:36 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:02.595 02:30:36 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:11:02.595 02:30:36 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:11:02.595 02:30:36 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:02.595 02:30:36 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:02.595 02:30:36 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:02.596 02:30:36 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:02.596 02:30:36 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:02.596 02:30:36 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:02.596 02:30:36 -- paths/export.sh@5 -- # export PATH 00:11:02.596 02:30:36 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:02.596 02:30:36 -- nvmf/common.sh@47 -- # : 0 00:11:02.596 02:30:36 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:11:02.596 02:30:36 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:11:02.596 02:30:36 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:11:02.596 02:30:36 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:02.596 02:30:36 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:02.596 02:30:36 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:11:02.596 02:30:36 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:11:02.596 02:30:36 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:11:02.596 02:30:36 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:11:02.596 02:30:36 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:11:02.596 02:30:36 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:11:02.596 02:30:36 -- target/invalid.sh@14 -- # target=foobar 00:11:02.596 02:30:36 -- target/invalid.sh@16 -- # RANDOM=0 00:11:02.596 02:30:36 -- target/invalid.sh@34 -- # nvmftestinit 00:11:02.596 02:30:36 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:11:02.596 02:30:36 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:02.596 02:30:36 -- nvmf/common.sh@437 -- # prepare_net_devs 00:11:02.596 02:30:36 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:11:02.596 02:30:36 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:11:02.596 02:30:36 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:02.596 02:30:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:02.596 02:30:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:02.596 02:30:36 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:11:02.596 02:30:36 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:11:02.596 02:30:36 -- nvmf/common.sh@285 -- # xtrace_disable 00:11:02.596 02:30:36 -- common/autotest_common.sh@10 -- # set +x 00:11:07.875 02:30:41 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:07.875 02:30:41 -- nvmf/common.sh@291 -- # pci_devs=() 00:11:07.875 02:30:41 -- nvmf/common.sh@291 -- # local -a pci_devs 00:11:07.875 02:30:41 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:11:07.875 02:30:41 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:11:07.875 02:30:41 -- nvmf/common.sh@293 -- # pci_drivers=() 00:11:07.875 02:30:41 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:11:07.875 02:30:41 -- nvmf/common.sh@295 -- # net_devs=() 00:11:07.875 02:30:41 -- nvmf/common.sh@295 -- # local -ga net_devs 00:11:07.875 02:30:41 -- nvmf/common.sh@296 -- # e810=() 00:11:07.875 02:30:41 -- nvmf/common.sh@296 -- # local -ga e810 00:11:07.875 02:30:41 -- nvmf/common.sh@297 -- # x722=() 00:11:07.875 02:30:41 -- nvmf/common.sh@297 -- # local -ga x722 00:11:07.875 02:30:41 -- nvmf/common.sh@298 -- # mlx=() 00:11:07.875 02:30:41 -- nvmf/common.sh@298 -- # local -ga mlx 00:11:07.875 02:30:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:07.875 02:30:41 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:07.875 02:30:41 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:07.875 02:30:41 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:07.875 02:30:41 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:07.875 02:30:41 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:07.875 02:30:41 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:07.875 02:30:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:07.875 02:30:41 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:07.875 02:30:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:07.875 02:30:41 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:07.875 02:30:41 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:11:07.875 02:30:41 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:11:07.875 02:30:41 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:11:07.875 02:30:41 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:11:07.875 02:30:41 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:11:07.875 02:30:41 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:11:07.875 02:30:41 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:11:07.875 02:30:41 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:11:07.875 02:30:41 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:11:07.875 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:11:07.875 02:30:41 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:11:07.875 02:30:41 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:11:07.875 02:30:41 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:11:07.875 02:30:41 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:11:07.875 02:30:41 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:11:07.875 02:30:41 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:11:07.875 02:30:41 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:11:07.875 02:30:41 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:11:07.875 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:11:07.875 02:30:41 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:11:07.875 02:30:41 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:11:07.875 02:30:41 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:11:07.876 02:30:41 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:11:07.876 02:30:41 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:11:07.876 02:30:41 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:11:07.876 02:30:41 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:11:07.876 02:30:41 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:11:07.876 02:30:41 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:11:07.876 02:30:41 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:07.876 02:30:41 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:11:07.876 02:30:41 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:07.876 02:30:41 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:11:07.876 Found net devices under 0000:18:00.0: mlx_0_0 00:11:07.876 02:30:41 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:11:07.876 02:30:41 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:11:07.876 02:30:41 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:07.876 02:30:41 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:11:07.876 02:30:41 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:07.876 02:30:41 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:11:07.876 Found net devices under 0000:18:00.1: mlx_0_1 00:11:07.876 02:30:41 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:11:07.876 02:30:41 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:11:07.876 02:30:41 -- nvmf/common.sh@403 -- # is_hw=yes 00:11:07.876 02:30:41 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:11:07.876 02:30:41 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:11:07.876 02:30:41 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:11:07.876 02:30:41 -- nvmf/common.sh@409 -- # rdma_device_init 00:11:07.876 02:30:41 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:11:07.876 02:30:41 -- nvmf/common.sh@58 -- # uname 00:11:07.876 02:30:41 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:11:07.876 02:30:41 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:11:07.876 02:30:41 -- nvmf/common.sh@63 -- # modprobe ib_core 00:11:07.876 02:30:41 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:11:07.876 02:30:41 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:11:07.876 02:30:41 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:11:07.876 02:30:41 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:11:07.876 02:30:41 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:11:07.876 02:30:41 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:11:07.876 02:30:41 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:11:07.876 02:30:41 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:11:07.876 02:30:41 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:11:07.876 02:30:41 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:11:07.876 02:30:41 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:11:07.876 02:30:41 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:11:07.876 02:30:41 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:11:07.876 02:30:41 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:07.876 02:30:41 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:07.876 02:30:41 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:11:07.876 02:30:41 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:11:07.876 02:30:41 -- nvmf/common.sh@105 -- # continue 2 00:11:07.876 02:30:41 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:07.876 02:30:41 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:07.876 02:30:41 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:11:07.876 02:30:41 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:07.876 02:30:41 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:11:07.876 02:30:41 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:11:07.876 02:30:41 -- nvmf/common.sh@105 -- # continue 2 00:11:07.876 02:30:41 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:11:07.876 02:30:41 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:11:07.876 02:30:41 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:11:07.876 02:30:41 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:11:07.876 02:30:41 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:07.876 02:30:41 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:07.876 02:30:41 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:11:07.876 02:30:41 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:11:07.876 02:30:41 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:11:07.876 60: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:11:07.876 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:11:07.876 altname enp24s0f0np0 00:11:07.876 altname ens785f0np0 00:11:07.876 inet 192.168.100.8/24 scope global mlx_0_0 00:11:07.876 valid_lft forever preferred_lft forever 00:11:07.876 02:30:41 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:11:07.876 02:30:41 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:11:07.876 02:30:41 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:11:07.876 02:30:41 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:11:07.876 02:30:41 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:07.876 02:30:41 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:07.876 02:30:41 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:11:07.876 02:30:41 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:11:07.876 02:30:41 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:11:07.876 61: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:11:07.876 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:11:07.876 altname enp24s0f1np1 00:11:07.876 altname ens785f1np1 00:11:07.876 inet 192.168.100.9/24 scope global mlx_0_1 00:11:07.876 valid_lft forever preferred_lft forever 00:11:07.876 02:30:41 -- nvmf/common.sh@411 -- # return 0 00:11:07.876 02:30:41 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:11:07.876 02:30:41 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:11:07.876 02:30:41 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:11:07.876 02:30:41 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:11:07.876 02:30:41 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:11:07.876 02:30:41 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:11:07.876 02:30:41 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:11:07.876 02:30:41 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:11:07.876 02:30:41 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:11:07.876 02:30:41 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:11:07.876 02:30:41 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:07.876 02:30:41 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:07.876 02:30:41 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:11:07.876 02:30:41 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:11:07.876 02:30:41 -- nvmf/common.sh@105 -- # continue 2 00:11:07.876 02:30:41 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:07.876 02:30:41 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:07.876 02:30:41 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:11:07.876 02:30:41 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:07.876 02:30:41 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:11:07.876 02:30:41 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:11:07.876 02:30:41 -- nvmf/common.sh@105 -- # continue 2 00:11:07.876 02:30:41 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:11:07.876 02:30:41 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:11:07.876 02:30:41 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:11:07.876 02:30:41 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:07.876 02:30:41 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:11:07.876 02:30:41 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:07.876 02:30:41 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:11:07.876 02:30:41 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:11:07.876 02:30:41 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:11:07.876 02:30:41 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:11:07.876 02:30:41 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:07.876 02:30:41 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:07.876 02:30:41 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:11:07.876 192.168.100.9' 00:11:07.876 02:30:41 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:11:07.876 192.168.100.9' 00:11:07.876 02:30:41 -- nvmf/common.sh@446 -- # head -n 1 00:11:07.876 02:30:41 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:11:07.876 02:30:41 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:11:07.876 192.168.100.9' 00:11:07.876 02:30:41 -- nvmf/common.sh@447 -- # tail -n +2 00:11:07.876 02:30:41 -- nvmf/common.sh@447 -- # head -n 1 00:11:07.876 02:30:41 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:11:07.876 02:30:41 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:11:07.876 02:30:41 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:11:07.876 02:30:41 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:11:07.876 02:30:41 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:11:07.876 02:30:41 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:11:07.876 02:30:41 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:11:07.876 02:30:41 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:11:07.876 02:30:41 -- common/autotest_common.sh@710 -- # xtrace_disable 00:11:07.876 02:30:41 -- common/autotest_common.sh@10 -- # set +x 00:11:07.876 02:30:41 -- nvmf/common.sh@470 -- # nvmfpid=1477352 00:11:07.876 02:30:41 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:07.876 02:30:41 -- nvmf/common.sh@471 -- # waitforlisten 1477352 00:11:07.876 02:30:41 -- common/autotest_common.sh@817 -- # '[' -z 1477352 ']' 00:11:07.876 02:30:41 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:07.876 02:30:41 -- common/autotest_common.sh@822 -- # local max_retries=100 00:11:07.876 02:30:41 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:07.876 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:07.876 02:30:41 -- common/autotest_common.sh@826 -- # xtrace_disable 00:11:07.876 02:30:41 -- common/autotest_common.sh@10 -- # set +x 00:11:07.876 [2024-04-27 02:30:41.489554] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:11:07.876 [2024-04-27 02:30:41.489607] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:08.135 EAL: No free 2048 kB hugepages reported on node 1 00:11:08.135 [2024-04-27 02:30:41.557510] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:08.135 [2024-04-27 02:30:41.644552] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:08.135 [2024-04-27 02:30:41.644597] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:08.135 [2024-04-27 02:30:41.644607] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:11:08.135 [2024-04-27 02:30:41.644615] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:11:08.135 [2024-04-27 02:30:41.644622] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:08.135 [2024-04-27 02:30:41.644725] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:08.135 [2024-04-27 02:30:41.644828] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:08.135 [2024-04-27 02:30:41.644908] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:08.135 [2024-04-27 02:30:41.644910] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:08.703 02:30:42 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:11:08.703 02:30:42 -- common/autotest_common.sh@850 -- # return 0 00:11:08.703 02:30:42 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:11:08.703 02:30:42 -- common/autotest_common.sh@716 -- # xtrace_disable 00:11:08.703 02:30:42 -- common/autotest_common.sh@10 -- # set +x 00:11:08.963 02:30:42 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:08.963 02:30:42 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:11:08.963 02:30:42 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode3004 00:11:08.963 [2024-04-27 02:30:42.513873] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:11:08.963 02:30:42 -- target/invalid.sh@40 -- # out='request: 00:11:08.963 { 00:11:08.963 "nqn": "nqn.2016-06.io.spdk:cnode3004", 00:11:08.963 "tgt_name": "foobar", 00:11:08.963 "method": "nvmf_create_subsystem", 00:11:08.963 "req_id": 1 00:11:08.963 } 00:11:08.963 Got JSON-RPC error response 00:11:08.963 response: 00:11:08.963 { 00:11:08.963 "code": -32603, 00:11:08.963 "message": "Unable to find target foobar" 00:11:08.963 }' 00:11:08.963 02:30:42 -- target/invalid.sh@41 -- # [[ request: 00:11:08.963 { 00:11:08.963 "nqn": "nqn.2016-06.io.spdk:cnode3004", 00:11:08.963 "tgt_name": "foobar", 00:11:08.963 "method": "nvmf_create_subsystem", 00:11:08.963 "req_id": 1 00:11:08.963 } 00:11:08.963 Got JSON-RPC error response 00:11:08.963 response: 00:11:08.963 { 00:11:08.963 "code": -32603, 00:11:08.963 "message": "Unable to find target foobar" 00:11:08.963 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:11:08.963 02:30:42 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:11:08.963 02:30:42 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode9344 00:11:09.224 [2024-04-27 02:30:42.702580] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode9344: invalid serial number 'SPDKISFASTANDAWESOME' 00:11:09.224 02:30:42 -- target/invalid.sh@45 -- # out='request: 00:11:09.224 { 00:11:09.224 "nqn": "nqn.2016-06.io.spdk:cnode9344", 00:11:09.224 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:11:09.224 "method": "nvmf_create_subsystem", 00:11:09.224 "req_id": 1 00:11:09.224 } 00:11:09.224 Got JSON-RPC error response 00:11:09.224 response: 00:11:09.224 { 00:11:09.224 "code": -32602, 00:11:09.224 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:11:09.224 }' 00:11:09.224 02:30:42 -- target/invalid.sh@46 -- # [[ request: 00:11:09.224 { 00:11:09.224 "nqn": "nqn.2016-06.io.spdk:cnode9344", 00:11:09.224 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:11:09.224 "method": "nvmf_create_subsystem", 00:11:09.224 "req_id": 1 00:11:09.224 } 00:11:09.224 Got JSON-RPC error response 00:11:09.224 response: 00:11:09.224 { 00:11:09.224 "code": -32602, 00:11:09.224 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:11:09.224 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:11:09.224 02:30:42 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:11:09.224 02:30:42 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode27779 00:11:09.492 [2024-04-27 02:30:42.895162] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode27779: invalid model number 'SPDK_Controller' 00:11:09.492 02:30:42 -- target/invalid.sh@50 -- # out='request: 00:11:09.492 { 00:11:09.492 "nqn": "nqn.2016-06.io.spdk:cnode27779", 00:11:09.492 "model_number": "SPDK_Controller\u001f", 00:11:09.492 "method": "nvmf_create_subsystem", 00:11:09.492 "req_id": 1 00:11:09.492 } 00:11:09.492 Got JSON-RPC error response 00:11:09.492 response: 00:11:09.492 { 00:11:09.492 "code": -32602, 00:11:09.492 "message": "Invalid MN SPDK_Controller\u001f" 00:11:09.492 }' 00:11:09.492 02:30:42 -- target/invalid.sh@51 -- # [[ request: 00:11:09.492 { 00:11:09.492 "nqn": "nqn.2016-06.io.spdk:cnode27779", 00:11:09.492 "model_number": "SPDK_Controller\u001f", 00:11:09.492 "method": "nvmf_create_subsystem", 00:11:09.492 "req_id": 1 00:11:09.492 } 00:11:09.492 Got JSON-RPC error response 00:11:09.492 response: 00:11:09.492 { 00:11:09.492 "code": -32602, 00:11:09.492 "message": "Invalid MN SPDK_Controller\u001f" 00:11:09.492 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:11:09.492 02:30:42 -- target/invalid.sh@54 -- # gen_random_s 21 00:11:09.492 02:30:42 -- target/invalid.sh@19 -- # local length=21 ll 00:11:09.492 02:30:42 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:11:09.492 02:30:42 -- target/invalid.sh@21 -- # local chars 00:11:09.492 02:30:42 -- target/invalid.sh@22 -- # local string 00:11:09.492 02:30:42 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:11:09.492 02:30:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:09.492 02:30:42 -- target/invalid.sh@25 -- # printf %x 96 00:11:09.492 02:30:42 -- target/invalid.sh@25 -- # echo -e '\x60' 00:11:09.492 02:30:42 -- target/invalid.sh@25 -- # string+='`' 00:11:09.492 02:30:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:09.492 02:30:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:09.492 02:30:42 -- target/invalid.sh@25 -- # printf %x 126 00:11:09.492 02:30:42 -- target/invalid.sh@25 -- # echo -e '\x7e' 00:11:09.492 02:30:42 -- target/invalid.sh@25 -- # string+='~' 00:11:09.492 02:30:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:09.492 02:30:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:09.492 02:30:42 -- target/invalid.sh@25 -- # printf %x 109 00:11:09.492 02:30:42 -- target/invalid.sh@25 -- # echo -e '\x6d' 00:11:09.492 02:30:42 -- target/invalid.sh@25 -- # string+=m 00:11:09.492 02:30:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:09.492 02:30:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:09.492 02:30:42 -- target/invalid.sh@25 -- # printf %x 111 00:11:09.492 02:30:42 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:11:09.492 02:30:42 -- target/invalid.sh@25 -- # string+=o 00:11:09.492 02:30:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:09.492 02:30:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:09.492 02:30:42 -- target/invalid.sh@25 -- # printf %x 116 00:11:09.492 02:30:42 -- target/invalid.sh@25 -- # echo -e '\x74' 00:11:09.492 02:30:42 -- target/invalid.sh@25 -- # string+=t 00:11:09.492 02:30:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:09.492 02:30:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:09.492 02:30:42 -- target/invalid.sh@25 -- # printf %x 68 00:11:09.492 02:30:42 -- target/invalid.sh@25 -- # echo -e '\x44' 00:11:09.492 02:30:42 -- target/invalid.sh@25 -- # string+=D 00:11:09.492 02:30:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:09.492 02:30:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:09.492 02:30:42 -- target/invalid.sh@25 -- # printf %x 46 00:11:09.492 02:30:42 -- target/invalid.sh@25 -- # echo -e '\x2e' 00:11:09.492 02:30:42 -- target/invalid.sh@25 -- # string+=. 00:11:09.492 02:30:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:09.492 02:30:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:09.492 02:30:42 -- target/invalid.sh@25 -- # printf %x 98 00:11:09.492 02:30:42 -- target/invalid.sh@25 -- # echo -e '\x62' 00:11:09.492 02:30:42 -- target/invalid.sh@25 -- # string+=b 00:11:09.492 02:30:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:09.492 02:30:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:09.492 02:30:42 -- target/invalid.sh@25 -- # printf %x 79 00:11:09.492 02:30:42 -- target/invalid.sh@25 -- # echo -e '\x4f' 00:11:09.492 02:30:42 -- target/invalid.sh@25 -- # string+=O 00:11:09.492 02:30:42 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:09.492 02:30:42 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:09.492 02:30:43 -- target/invalid.sh@25 -- # printf %x 50 00:11:09.492 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x32' 00:11:09.492 02:30:43 -- target/invalid.sh@25 -- # string+=2 00:11:09.492 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:09.492 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:09.492 02:30:43 -- target/invalid.sh@25 -- # printf %x 98 00:11:09.492 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x62' 00:11:09.492 02:30:43 -- target/invalid.sh@25 -- # string+=b 00:11:09.492 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:09.492 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:09.492 02:30:43 -- target/invalid.sh@25 -- # printf %x 41 00:11:09.492 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x29' 00:11:09.492 02:30:43 -- target/invalid.sh@25 -- # string+=')' 00:11:09.492 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:09.492 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:09.492 02:30:43 -- target/invalid.sh@25 -- # printf %x 88 00:11:09.492 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x58' 00:11:09.492 02:30:43 -- target/invalid.sh@25 -- # string+=X 00:11:09.492 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:09.492 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:09.492 02:30:43 -- target/invalid.sh@25 -- # printf %x 71 00:11:09.492 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x47' 00:11:09.492 02:30:43 -- target/invalid.sh@25 -- # string+=G 00:11:09.492 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:09.492 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:09.492 02:30:43 -- target/invalid.sh@25 -- # printf %x 64 00:11:09.492 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x40' 00:11:09.492 02:30:43 -- target/invalid.sh@25 -- # string+=@ 00:11:09.492 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:09.492 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:09.492 02:30:43 -- target/invalid.sh@25 -- # printf %x 110 00:11:09.492 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:11:09.492 02:30:43 -- target/invalid.sh@25 -- # string+=n 00:11:09.492 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:09.492 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:09.492 02:30:43 -- target/invalid.sh@25 -- # printf %x 116 00:11:09.492 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x74' 00:11:09.492 02:30:43 -- target/invalid.sh@25 -- # string+=t 00:11:09.492 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:09.492 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:09.492 02:30:43 -- target/invalid.sh@25 -- # printf %x 74 00:11:09.492 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x4a' 00:11:09.492 02:30:43 -- target/invalid.sh@25 -- # string+=J 00:11:09.492 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:09.492 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:09.492 02:30:43 -- target/invalid.sh@25 -- # printf %x 61 00:11:09.492 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x3d' 00:11:09.492 02:30:43 -- target/invalid.sh@25 -- # string+== 00:11:09.492 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:09.492 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:09.492 02:30:43 -- target/invalid.sh@25 -- # printf %x 34 00:11:09.492 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x22' 00:11:09.492 02:30:43 -- target/invalid.sh@25 -- # string+='"' 00:11:09.492 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:09.492 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:09.492 02:30:43 -- target/invalid.sh@25 -- # printf %x 85 00:11:09.492 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x55' 00:11:09.492 02:30:43 -- target/invalid.sh@25 -- # string+=U 00:11:09.492 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:09.492 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:09.492 02:30:43 -- target/invalid.sh@28 -- # [[ ` == \- ]] 00:11:09.492 02:30:43 -- target/invalid.sh@31 -- # echo '`~motD.bO2b)XG@ntJ="U' 00:11:09.492 02:30:43 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s '`~motD.bO2b)XG@ntJ="U' nqn.2016-06.io.spdk:cnode25713 00:11:09.757 [2024-04-27 02:30:43.256345] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode25713: invalid serial number '`~motD.bO2b)XG@ntJ="U' 00:11:09.757 02:30:43 -- target/invalid.sh@54 -- # out='request: 00:11:09.757 { 00:11:09.757 "nqn": "nqn.2016-06.io.spdk:cnode25713", 00:11:09.757 "serial_number": "`~motD.bO2b)XG@ntJ=\"U", 00:11:09.757 "method": "nvmf_create_subsystem", 00:11:09.757 "req_id": 1 00:11:09.757 } 00:11:09.757 Got JSON-RPC error response 00:11:09.757 response: 00:11:09.757 { 00:11:09.757 "code": -32602, 00:11:09.757 "message": "Invalid SN `~motD.bO2b)XG@ntJ=\"U" 00:11:09.757 }' 00:11:09.757 02:30:43 -- target/invalid.sh@55 -- # [[ request: 00:11:09.757 { 00:11:09.757 "nqn": "nqn.2016-06.io.spdk:cnode25713", 00:11:09.757 "serial_number": "`~motD.bO2b)XG@ntJ=\"U", 00:11:09.757 "method": "nvmf_create_subsystem", 00:11:09.757 "req_id": 1 00:11:09.757 } 00:11:09.757 Got JSON-RPC error response 00:11:09.757 response: 00:11:09.757 { 00:11:09.757 "code": -32602, 00:11:09.757 "message": "Invalid SN `~motD.bO2b)XG@ntJ=\"U" 00:11:09.757 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:11:09.757 02:30:43 -- target/invalid.sh@58 -- # gen_random_s 41 00:11:09.757 02:30:43 -- target/invalid.sh@19 -- # local length=41 ll 00:11:09.757 02:30:43 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:11:09.757 02:30:43 -- target/invalid.sh@21 -- # local chars 00:11:09.757 02:30:43 -- target/invalid.sh@22 -- # local string 00:11:09.757 02:30:43 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:11:09.757 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:09.757 02:30:43 -- target/invalid.sh@25 -- # printf %x 117 00:11:09.757 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x75' 00:11:09.757 02:30:43 -- target/invalid.sh@25 -- # string+=u 00:11:09.757 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:09.757 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:09.757 02:30:43 -- target/invalid.sh@25 -- # printf %x 72 00:11:09.757 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x48' 00:11:09.757 02:30:43 -- target/invalid.sh@25 -- # string+=H 00:11:09.757 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:09.757 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:09.757 02:30:43 -- target/invalid.sh@25 -- # printf %x 95 00:11:09.757 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x5f' 00:11:09.757 02:30:43 -- target/invalid.sh@25 -- # string+=_ 00:11:09.757 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:09.757 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:09.757 02:30:43 -- target/invalid.sh@25 -- # printf %x 78 00:11:09.757 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x4e' 00:11:09.757 02:30:43 -- target/invalid.sh@25 -- # string+=N 00:11:09.757 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:09.757 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:09.757 02:30:43 -- target/invalid.sh@25 -- # printf %x 92 00:11:09.757 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x5c' 00:11:09.757 02:30:43 -- target/invalid.sh@25 -- # string+='\' 00:11:09.757 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:09.757 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:09.757 02:30:43 -- target/invalid.sh@25 -- # printf %x 98 00:11:09.757 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x62' 00:11:09.757 02:30:43 -- target/invalid.sh@25 -- # string+=b 00:11:09.757 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:09.758 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:09.758 02:30:43 -- target/invalid.sh@25 -- # printf %x 96 00:11:09.758 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x60' 00:11:09.758 02:30:43 -- target/invalid.sh@25 -- # string+='`' 00:11:09.758 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:09.758 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:09.758 02:30:43 -- target/invalid.sh@25 -- # printf %x 44 00:11:09.758 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x2c' 00:11:09.758 02:30:43 -- target/invalid.sh@25 -- # string+=, 00:11:09.758 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:09.758 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:09.758 02:30:43 -- target/invalid.sh@25 -- # printf %x 94 00:11:09.758 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x5e' 00:11:09.758 02:30:43 -- target/invalid.sh@25 -- # string+='^' 00:11:09.758 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:09.758 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:09.758 02:30:43 -- target/invalid.sh@25 -- # printf %x 90 00:11:09.758 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x5a' 00:11:09.758 02:30:43 -- target/invalid.sh@25 -- # string+=Z 00:11:09.758 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:09.758 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:09.758 02:30:43 -- target/invalid.sh@25 -- # printf %x 109 00:11:09.758 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x6d' 00:11:09.758 02:30:43 -- target/invalid.sh@25 -- # string+=m 00:11:09.758 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:09.758 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # printf %x 125 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x7d' 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # string+='}' 00:11:10.017 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:10.017 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # printf %x 114 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x72' 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # string+=r 00:11:10.017 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:10.017 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # printf %x 59 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x3b' 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # string+=';' 00:11:10.017 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:10.017 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # printf %x 82 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x52' 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # string+=R 00:11:10.017 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:10.017 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # printf %x 104 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x68' 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # string+=h 00:11:10.017 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:10.017 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # printf %x 126 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x7e' 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # string+='~' 00:11:10.017 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:10.017 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # printf %x 60 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x3c' 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # string+='<' 00:11:10.017 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:10.017 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # printf %x 32 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x20' 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # string+=' ' 00:11:10.017 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:10.017 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # printf %x 32 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x20' 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # string+=' ' 00:11:10.017 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:10.017 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # printf %x 107 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x6b' 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # string+=k 00:11:10.017 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:10.017 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # printf %x 99 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x63' 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # string+=c 00:11:10.017 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:10.017 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # printf %x 68 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x44' 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # string+=D 00:11:10.017 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:10.017 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # printf %x 76 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x4c' 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # string+=L 00:11:10.017 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:10.017 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # printf %x 55 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x37' 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # string+=7 00:11:10.017 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:10.017 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # printf %x 102 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x66' 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # string+=f 00:11:10.017 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:10.017 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # printf %x 103 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x67' 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # string+=g 00:11:10.017 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:10.017 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # printf %x 34 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x22' 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # string+='"' 00:11:10.017 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:10.017 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # printf %x 100 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x64' 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # string+=d 00:11:10.017 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:10.017 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:10.017 02:30:43 -- target/invalid.sh@25 -- # printf %x 56 00:11:10.018 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x38' 00:11:10.018 02:30:43 -- target/invalid.sh@25 -- # string+=8 00:11:10.018 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:10.018 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:10.018 02:30:43 -- target/invalid.sh@25 -- # printf %x 125 00:11:10.018 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x7d' 00:11:10.018 02:30:43 -- target/invalid.sh@25 -- # string+='}' 00:11:10.018 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:10.018 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:10.018 02:30:43 -- target/invalid.sh@25 -- # printf %x 93 00:11:10.018 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x5d' 00:11:10.018 02:30:43 -- target/invalid.sh@25 -- # string+=']' 00:11:10.018 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:10.018 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:10.018 02:30:43 -- target/invalid.sh@25 -- # printf %x 85 00:11:10.018 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x55' 00:11:10.018 02:30:43 -- target/invalid.sh@25 -- # string+=U 00:11:10.018 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:10.018 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:10.018 02:30:43 -- target/invalid.sh@25 -- # printf %x 43 00:11:10.018 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x2b' 00:11:10.018 02:30:43 -- target/invalid.sh@25 -- # string+=+ 00:11:10.018 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:10.018 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:10.018 02:30:43 -- target/invalid.sh@25 -- # printf %x 34 00:11:10.018 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x22' 00:11:10.018 02:30:43 -- target/invalid.sh@25 -- # string+='"' 00:11:10.018 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:10.018 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:10.018 02:30:43 -- target/invalid.sh@25 -- # printf %x 100 00:11:10.018 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x64' 00:11:10.018 02:30:43 -- target/invalid.sh@25 -- # string+=d 00:11:10.018 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:10.018 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:10.018 02:30:43 -- target/invalid.sh@25 -- # printf %x 83 00:11:10.018 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x53' 00:11:10.018 02:30:43 -- target/invalid.sh@25 -- # string+=S 00:11:10.018 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:10.018 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:10.018 02:30:43 -- target/invalid.sh@25 -- # printf %x 112 00:11:10.018 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x70' 00:11:10.018 02:30:43 -- target/invalid.sh@25 -- # string+=p 00:11:10.018 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:10.018 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:10.018 02:30:43 -- target/invalid.sh@25 -- # printf %x 60 00:11:10.018 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x3c' 00:11:10.018 02:30:43 -- target/invalid.sh@25 -- # string+='<' 00:11:10.018 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:10.018 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:10.018 02:30:43 -- target/invalid.sh@25 -- # printf %x 76 00:11:10.018 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x4c' 00:11:10.018 02:30:43 -- target/invalid.sh@25 -- # string+=L 00:11:10.018 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:10.018 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:10.018 02:30:43 -- target/invalid.sh@25 -- # printf %x 117 00:11:10.018 02:30:43 -- target/invalid.sh@25 -- # echo -e '\x75' 00:11:10.018 02:30:43 -- target/invalid.sh@25 -- # string+=u 00:11:10.018 02:30:43 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:10.018 02:30:43 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:10.018 02:30:43 -- target/invalid.sh@28 -- # [[ u == \- ]] 00:11:10.018 02:30:43 -- target/invalid.sh@31 -- # echo 'uH_N\b`,^Zm}r;Rh~< kcDL7fg"d8}]U+"dSp /dev/null' 00:11:12.873 02:30:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:12.873 02:30:46 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:11:12.873 02:30:46 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:11:12.873 02:30:46 -- nvmf/common.sh@285 -- # xtrace_disable 00:11:12.873 02:30:46 -- common/autotest_common.sh@10 -- # set +x 00:11:19.512 02:30:52 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:19.512 02:30:52 -- nvmf/common.sh@291 -- # pci_devs=() 00:11:19.512 02:30:52 -- nvmf/common.sh@291 -- # local -a pci_devs 00:11:19.512 02:30:52 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:11:19.512 02:30:52 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:11:19.512 02:30:52 -- nvmf/common.sh@293 -- # pci_drivers=() 00:11:19.512 02:30:52 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:11:19.512 02:30:52 -- nvmf/common.sh@295 -- # net_devs=() 00:11:19.512 02:30:52 -- nvmf/common.sh@295 -- # local -ga net_devs 00:11:19.512 02:30:52 -- nvmf/common.sh@296 -- # e810=() 00:11:19.512 02:30:52 -- nvmf/common.sh@296 -- # local -ga e810 00:11:19.512 02:30:52 -- nvmf/common.sh@297 -- # x722=() 00:11:19.512 02:30:52 -- nvmf/common.sh@297 -- # local -ga x722 00:11:19.512 02:30:52 -- nvmf/common.sh@298 -- # mlx=() 00:11:19.512 02:30:52 -- nvmf/common.sh@298 -- # local -ga mlx 00:11:19.512 02:30:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:19.512 02:30:52 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:19.512 02:30:52 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:19.512 02:30:52 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:19.512 02:30:52 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:19.512 02:30:52 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:19.512 02:30:52 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:19.512 02:30:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:19.512 02:30:52 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:19.512 02:30:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:19.512 02:30:52 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:19.512 02:30:52 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:11:19.512 02:30:52 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:11:19.512 02:30:52 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:11:19.512 02:30:52 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:11:19.512 02:30:52 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:11:19.512 02:30:52 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:11:19.512 02:30:52 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:11:19.512 02:30:52 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:11:19.512 02:30:52 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:11:19.512 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:11:19.512 02:30:52 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:11:19.512 02:30:52 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:11:19.512 02:30:52 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:11:19.512 02:30:52 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:11:19.512 02:30:52 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:11:19.512 02:30:52 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:11:19.512 02:30:52 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:11:19.512 02:30:52 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:11:19.512 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:11:19.512 02:30:52 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:11:19.512 02:30:52 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:11:19.512 02:30:52 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:11:19.512 02:30:52 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:11:19.512 02:30:52 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:11:19.512 02:30:52 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:11:19.512 02:30:52 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:11:19.512 02:30:52 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:11:19.512 02:30:52 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:11:19.512 02:30:52 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:19.512 02:30:52 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:11:19.512 02:30:52 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:19.512 02:30:52 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:11:19.512 Found net devices under 0000:18:00.0: mlx_0_0 00:11:19.512 02:30:52 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:11:19.512 02:30:52 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:11:19.512 02:30:52 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:19.512 02:30:52 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:11:19.512 02:30:52 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:19.512 02:30:52 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:11:19.512 Found net devices under 0000:18:00.1: mlx_0_1 00:11:19.512 02:30:52 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:11:19.512 02:30:52 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:11:19.512 02:30:52 -- nvmf/common.sh@403 -- # is_hw=yes 00:11:19.512 02:30:52 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:11:19.512 02:30:52 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:11:19.512 02:30:52 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:11:19.512 02:30:52 -- nvmf/common.sh@409 -- # rdma_device_init 00:11:19.512 02:30:52 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:11:19.512 02:30:52 -- nvmf/common.sh@58 -- # uname 00:11:19.512 02:30:52 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:11:19.512 02:30:52 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:11:19.512 02:30:52 -- nvmf/common.sh@63 -- # modprobe ib_core 00:11:19.512 02:30:52 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:11:19.512 02:30:52 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:11:19.512 02:30:52 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:11:19.512 02:30:52 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:11:19.512 02:30:52 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:11:19.512 02:30:52 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:11:19.512 02:30:52 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:11:19.512 02:30:52 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:11:19.512 02:30:52 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:11:19.512 02:30:52 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:11:19.512 02:30:52 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:11:19.512 02:30:52 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:11:19.512 02:30:52 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:11:19.512 02:30:52 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:19.512 02:30:52 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:19.512 02:30:52 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:11:19.512 02:30:52 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:11:19.512 02:30:52 -- nvmf/common.sh@105 -- # continue 2 00:11:19.512 02:30:52 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:19.512 02:30:52 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:19.512 02:30:52 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:11:19.512 02:30:52 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:19.512 02:30:52 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:11:19.512 02:30:52 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:11:19.512 02:30:52 -- nvmf/common.sh@105 -- # continue 2 00:11:19.512 02:30:52 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:11:19.512 02:30:52 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:11:19.512 02:30:52 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:11:19.512 02:30:52 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:19.512 02:30:52 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:11:19.512 02:30:52 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:19.512 02:30:52 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:11:19.512 02:30:52 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:11:19.512 02:30:52 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:11:19.512 60: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:11:19.512 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:11:19.512 altname enp24s0f0np0 00:11:19.512 altname ens785f0np0 00:11:19.512 inet 192.168.100.8/24 scope global mlx_0_0 00:11:19.512 valid_lft forever preferred_lft forever 00:11:19.512 02:30:52 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:11:19.512 02:30:52 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:11:19.512 02:30:52 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:11:19.512 02:30:52 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:19.512 02:30:52 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:11:19.512 02:30:52 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:19.512 02:30:52 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:11:19.512 02:30:52 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:11:19.512 02:30:52 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:11:19.512 61: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:11:19.512 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:11:19.512 altname enp24s0f1np1 00:11:19.512 altname ens785f1np1 00:11:19.512 inet 192.168.100.9/24 scope global mlx_0_1 00:11:19.512 valid_lft forever preferred_lft forever 00:11:19.512 02:30:52 -- nvmf/common.sh@411 -- # return 0 00:11:19.513 02:30:52 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:11:19.513 02:30:52 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:11:19.513 02:30:52 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:11:19.513 02:30:52 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:11:19.513 02:30:52 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:11:19.513 02:30:52 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:11:19.513 02:30:52 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:11:19.513 02:30:52 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:11:19.513 02:30:52 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:11:19.513 02:30:52 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:11:19.513 02:30:52 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:19.513 02:30:52 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:19.513 02:30:52 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:11:19.513 02:30:52 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:11:19.513 02:30:52 -- nvmf/common.sh@105 -- # continue 2 00:11:19.513 02:30:52 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:19.513 02:30:52 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:19.513 02:30:52 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:11:19.513 02:30:52 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:19.513 02:30:52 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:11:19.513 02:30:52 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:11:19.513 02:30:52 -- nvmf/common.sh@105 -- # continue 2 00:11:19.513 02:30:52 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:11:19.513 02:30:52 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:11:19.513 02:30:52 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:11:19.513 02:30:52 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:11:19.513 02:30:52 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:19.513 02:30:52 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:19.513 02:30:52 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:11:19.513 02:30:52 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:11:19.513 02:30:52 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:11:19.513 02:30:52 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:19.513 02:30:52 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:11:19.513 02:30:52 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:19.513 02:30:52 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:11:19.513 192.168.100.9' 00:11:19.513 02:30:52 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:11:19.513 192.168.100.9' 00:11:19.513 02:30:52 -- nvmf/common.sh@446 -- # head -n 1 00:11:19.513 02:30:52 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:11:19.513 02:30:52 -- nvmf/common.sh@447 -- # head -n 1 00:11:19.513 02:30:52 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:11:19.513 192.168.100.9' 00:11:19.513 02:30:52 -- nvmf/common.sh@447 -- # tail -n +2 00:11:19.513 02:30:52 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:11:19.513 02:30:52 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:11:19.513 02:30:52 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:11:19.513 02:30:52 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:11:19.513 02:30:52 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:11:19.513 02:30:52 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:11:19.513 02:30:52 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:11:19.513 02:30:52 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:11:19.513 02:30:52 -- common/autotest_common.sh@710 -- # xtrace_disable 00:11:19.513 02:30:52 -- common/autotest_common.sh@10 -- # set +x 00:11:19.513 02:30:52 -- nvmf/common.sh@470 -- # nvmfpid=1480977 00:11:19.513 02:30:52 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:11:19.513 02:30:52 -- nvmf/common.sh@471 -- # waitforlisten 1480977 00:11:19.513 02:30:52 -- common/autotest_common.sh@817 -- # '[' -z 1480977 ']' 00:11:19.513 02:30:52 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:19.513 02:30:52 -- common/autotest_common.sh@822 -- # local max_retries=100 00:11:19.513 02:30:52 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:19.513 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:19.513 02:30:52 -- common/autotest_common.sh@826 -- # xtrace_disable 00:11:19.513 02:30:52 -- common/autotest_common.sh@10 -- # set +x 00:11:19.513 [2024-04-27 02:30:52.425728] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:11:19.513 [2024-04-27 02:30:52.425782] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:19.513 EAL: No free 2048 kB hugepages reported on node 1 00:11:19.513 [2024-04-27 02:30:52.497822] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:11:19.513 [2024-04-27 02:30:52.584716] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:19.513 [2024-04-27 02:30:52.584756] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:19.513 [2024-04-27 02:30:52.584765] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:11:19.513 [2024-04-27 02:30:52.584777] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:11:19.513 [2024-04-27 02:30:52.584784] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:19.513 [2024-04-27 02:30:52.584832] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:19.513 [2024-04-27 02:30:52.584912] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:19.513 [2024-04-27 02:30:52.584914] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:19.771 02:30:53 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:11:19.771 02:30:53 -- common/autotest_common.sh@850 -- # return 0 00:11:19.771 02:30:53 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:11:19.771 02:30:53 -- common/autotest_common.sh@716 -- # xtrace_disable 00:11:19.771 02:30:53 -- common/autotest_common.sh@10 -- # set +x 00:11:19.771 02:30:53 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:19.771 02:30:53 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -a 256 00:11:19.771 02:30:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:19.771 02:30:53 -- common/autotest_common.sh@10 -- # set +x 00:11:19.771 [2024-04-27 02:30:53.325516] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x6c0d30/0x6c5220) succeed. 00:11:19.771 [2024-04-27 02:30:53.335876] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x6c22d0/0x7068b0) succeed. 00:11:20.029 02:30:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:20.030 02:30:53 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:11:20.030 02:30:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:20.030 02:30:53 -- common/autotest_common.sh@10 -- # set +x 00:11:20.030 Malloc0 00:11:20.030 02:30:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:20.030 02:30:53 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:11:20.030 02:30:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:20.030 02:30:53 -- common/autotest_common.sh@10 -- # set +x 00:11:20.030 Delay0 00:11:20.030 02:30:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:20.030 02:30:53 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:11:20.030 02:30:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:20.030 02:30:53 -- common/autotest_common.sh@10 -- # set +x 00:11:20.030 02:30:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:20.030 02:30:53 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:11:20.030 02:30:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:20.030 02:30:53 -- common/autotest_common.sh@10 -- # set +x 00:11:20.030 02:30:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:20.030 02:30:53 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:11:20.030 02:30:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:20.030 02:30:53 -- common/autotest_common.sh@10 -- # set +x 00:11:20.030 [2024-04-27 02:30:53.512780] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:11:20.030 02:30:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:20.030 02:30:53 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:11:20.030 02:30:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:20.030 02:30:53 -- common/autotest_common.sh@10 -- # set +x 00:11:20.030 02:30:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:20.030 02:30:53 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/abort -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:11:20.030 EAL: No free 2048 kB hugepages reported on node 1 00:11:20.030 [2024-04-27 02:30:53.606862] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:11:22.568 Initializing NVMe Controllers 00:11:22.568 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode0 00:11:22.568 controller IO queue size 128 less than required 00:11:22.568 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:11:22.568 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:11:22.568 Initialization complete. Launching workers. 00:11:22.568 NS: RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 48589 00:11:22.568 CTRLR: RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 48650, failed to submit 62 00:11:22.568 success 48590, unsuccess 60, failed 0 00:11:22.568 02:30:55 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:11:22.568 02:30:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:11:22.568 02:30:55 -- common/autotest_common.sh@10 -- # set +x 00:11:22.568 02:30:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:11:22.568 02:30:55 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:11:22.568 02:30:55 -- target/abort.sh@38 -- # nvmftestfini 00:11:22.568 02:30:55 -- nvmf/common.sh@477 -- # nvmfcleanup 00:11:22.568 02:30:55 -- nvmf/common.sh@117 -- # sync 00:11:22.568 02:30:55 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:11:22.568 02:30:55 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:11:22.568 02:30:55 -- nvmf/common.sh@120 -- # set +e 00:11:22.568 02:30:55 -- nvmf/common.sh@121 -- # for i in {1..20} 00:11:22.568 02:30:55 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:11:22.568 rmmod nvme_rdma 00:11:22.568 rmmod nvme_fabrics 00:11:22.568 02:30:55 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:11:22.568 02:30:55 -- nvmf/common.sh@124 -- # set -e 00:11:22.568 02:30:55 -- nvmf/common.sh@125 -- # return 0 00:11:22.568 02:30:55 -- nvmf/common.sh@478 -- # '[' -n 1480977 ']' 00:11:22.568 02:30:55 -- nvmf/common.sh@479 -- # killprocess 1480977 00:11:22.568 02:30:55 -- common/autotest_common.sh@936 -- # '[' -z 1480977 ']' 00:11:22.568 02:30:55 -- common/autotest_common.sh@940 -- # kill -0 1480977 00:11:22.568 02:30:55 -- common/autotest_common.sh@941 -- # uname 00:11:22.568 02:30:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:22.568 02:30:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1480977 00:11:22.568 02:30:55 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:11:22.568 02:30:55 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:11:22.568 02:30:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1480977' 00:11:22.568 killing process with pid 1480977 00:11:22.568 02:30:55 -- common/autotest_common.sh@955 -- # kill 1480977 00:11:22.568 02:30:55 -- common/autotest_common.sh@960 -- # wait 1480977 00:11:22.568 [2024-04-27 02:30:55.897695] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:11:22.568 02:30:56 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:11:22.568 02:30:56 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:11:22.568 00:11:22.568 real 0m9.887s 00:11:22.568 user 0m14.359s 00:11:22.568 sys 0m5.098s 00:11:22.568 02:30:56 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:11:22.568 02:30:56 -- common/autotest_common.sh@10 -- # set +x 00:11:22.568 ************************************ 00:11:22.568 END TEST nvmf_abort 00:11:22.568 ************************************ 00:11:22.568 02:30:56 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=rdma 00:11:22.568 02:30:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:22.568 02:30:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:22.568 02:30:56 -- common/autotest_common.sh@10 -- # set +x 00:11:22.828 ************************************ 00:11:22.828 START TEST nvmf_ns_hotplug_stress 00:11:22.828 ************************************ 00:11:22.828 02:30:56 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=rdma 00:11:22.828 * Looking for test storage... 00:11:22.828 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:11:22.828 02:30:56 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:11:22.828 02:30:56 -- nvmf/common.sh@7 -- # uname -s 00:11:22.828 02:30:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:22.828 02:30:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:22.828 02:30:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:22.828 02:30:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:22.828 02:30:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:22.828 02:30:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:22.828 02:30:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:22.828 02:30:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:22.828 02:30:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:22.828 02:30:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:22.828 02:30:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:11:22.828 02:30:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:11:22.828 02:30:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:22.828 02:30:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:22.828 02:30:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:22.828 02:30:56 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:11:22.828 02:30:56 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:11:22.828 02:30:56 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:22.828 02:30:56 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:22.828 02:30:56 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:22.828 02:30:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:22.828 02:30:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:22.828 02:30:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:22.828 02:30:56 -- paths/export.sh@5 -- # export PATH 00:11:22.828 02:30:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:22.828 02:30:56 -- nvmf/common.sh@47 -- # : 0 00:11:22.828 02:30:56 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:11:22.828 02:30:56 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:11:22.828 02:30:56 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:11:22.828 02:30:56 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:22.828 02:30:56 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:22.828 02:30:56 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:11:22.828 02:30:56 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:11:22.829 02:30:56 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:11:22.829 02:30:56 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:11:22.829 02:30:56 -- target/ns_hotplug_stress.sh@13 -- # nvmftestinit 00:11:22.829 02:30:56 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:11:22.829 02:30:56 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:22.829 02:30:56 -- nvmf/common.sh@437 -- # prepare_net_devs 00:11:22.829 02:30:56 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:11:22.829 02:30:56 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:11:22.829 02:30:56 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:22.829 02:30:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:22.829 02:30:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:22.829 02:30:56 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:11:22.829 02:30:56 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:11:22.829 02:30:56 -- nvmf/common.sh@285 -- # xtrace_disable 00:11:22.829 02:30:56 -- common/autotest_common.sh@10 -- # set +x 00:11:29.400 02:31:02 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:29.400 02:31:02 -- nvmf/common.sh@291 -- # pci_devs=() 00:11:29.400 02:31:02 -- nvmf/common.sh@291 -- # local -a pci_devs 00:11:29.400 02:31:02 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:11:29.400 02:31:02 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:11:29.400 02:31:02 -- nvmf/common.sh@293 -- # pci_drivers=() 00:11:29.400 02:31:02 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:11:29.400 02:31:02 -- nvmf/common.sh@295 -- # net_devs=() 00:11:29.400 02:31:02 -- nvmf/common.sh@295 -- # local -ga net_devs 00:11:29.400 02:31:02 -- nvmf/common.sh@296 -- # e810=() 00:11:29.400 02:31:02 -- nvmf/common.sh@296 -- # local -ga e810 00:11:29.400 02:31:02 -- nvmf/common.sh@297 -- # x722=() 00:11:29.400 02:31:02 -- nvmf/common.sh@297 -- # local -ga x722 00:11:29.400 02:31:02 -- nvmf/common.sh@298 -- # mlx=() 00:11:29.400 02:31:02 -- nvmf/common.sh@298 -- # local -ga mlx 00:11:29.400 02:31:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:29.400 02:31:02 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:29.400 02:31:02 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:29.400 02:31:02 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:29.400 02:31:02 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:29.400 02:31:02 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:29.400 02:31:02 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:29.400 02:31:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:29.400 02:31:02 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:29.400 02:31:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:29.400 02:31:02 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:29.400 02:31:02 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:11:29.400 02:31:02 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:11:29.400 02:31:02 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:11:29.400 02:31:02 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:11:29.400 02:31:02 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:11:29.400 02:31:02 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:11:29.400 02:31:02 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:11:29.400 02:31:02 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:11:29.400 02:31:02 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:11:29.400 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:11:29.400 02:31:02 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:11:29.400 02:31:02 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:11:29.400 02:31:02 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:11:29.400 02:31:02 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:11:29.400 02:31:02 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:11:29.400 02:31:02 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:11:29.400 02:31:02 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:11:29.400 02:31:02 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:11:29.400 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:11:29.400 02:31:02 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:11:29.400 02:31:02 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:11:29.400 02:31:02 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:11:29.400 02:31:02 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:11:29.400 02:31:02 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:11:29.400 02:31:02 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:11:29.400 02:31:02 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:11:29.400 02:31:02 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:11:29.400 02:31:02 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:11:29.400 02:31:02 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:29.400 02:31:02 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:11:29.400 02:31:02 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:29.400 02:31:02 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:11:29.400 Found net devices under 0000:18:00.0: mlx_0_0 00:11:29.400 02:31:02 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:11:29.401 02:31:02 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:11:29.401 02:31:02 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:29.401 02:31:02 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:11:29.401 02:31:02 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:29.401 02:31:02 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:11:29.401 Found net devices under 0000:18:00.1: mlx_0_1 00:11:29.401 02:31:02 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:11:29.401 02:31:02 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:11:29.401 02:31:02 -- nvmf/common.sh@403 -- # is_hw=yes 00:11:29.401 02:31:02 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:11:29.401 02:31:02 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:11:29.401 02:31:02 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:11:29.401 02:31:02 -- nvmf/common.sh@409 -- # rdma_device_init 00:11:29.401 02:31:02 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:11:29.401 02:31:02 -- nvmf/common.sh@58 -- # uname 00:11:29.401 02:31:02 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:11:29.401 02:31:02 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:11:29.401 02:31:02 -- nvmf/common.sh@63 -- # modprobe ib_core 00:11:29.401 02:31:02 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:11:29.401 02:31:02 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:11:29.401 02:31:02 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:11:29.401 02:31:02 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:11:29.401 02:31:02 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:11:29.401 02:31:02 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:11:29.401 02:31:02 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:11:29.401 02:31:02 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:11:29.401 02:31:02 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:11:29.401 02:31:02 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:11:29.401 02:31:02 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:11:29.401 02:31:02 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:11:29.401 02:31:02 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:11:29.401 02:31:02 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:29.401 02:31:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:29.401 02:31:02 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:11:29.401 02:31:02 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:11:29.401 02:31:02 -- nvmf/common.sh@105 -- # continue 2 00:11:29.401 02:31:02 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:29.401 02:31:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:29.401 02:31:02 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:11:29.401 02:31:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:29.401 02:31:02 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:11:29.401 02:31:02 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:11:29.401 02:31:02 -- nvmf/common.sh@105 -- # continue 2 00:11:29.401 02:31:02 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:11:29.401 02:31:02 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:11:29.401 02:31:02 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:11:29.401 02:31:02 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:11:29.401 02:31:02 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:29.401 02:31:02 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:29.401 02:31:02 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:11:29.401 02:31:02 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:11:29.401 02:31:02 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:11:29.401 60: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:11:29.401 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:11:29.401 altname enp24s0f0np0 00:11:29.401 altname ens785f0np0 00:11:29.401 inet 192.168.100.8/24 scope global mlx_0_0 00:11:29.401 valid_lft forever preferred_lft forever 00:11:29.401 02:31:02 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:11:29.401 02:31:02 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:11:29.401 02:31:02 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:11:29.401 02:31:02 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:11:29.401 02:31:02 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:29.401 02:31:02 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:29.401 02:31:02 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:11:29.401 02:31:02 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:11:29.401 02:31:02 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:11:29.401 61: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:11:29.401 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:11:29.401 altname enp24s0f1np1 00:11:29.401 altname ens785f1np1 00:11:29.401 inet 192.168.100.9/24 scope global mlx_0_1 00:11:29.401 valid_lft forever preferred_lft forever 00:11:29.401 02:31:02 -- nvmf/common.sh@411 -- # return 0 00:11:29.401 02:31:02 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:11:29.401 02:31:02 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:11:29.401 02:31:02 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:11:29.401 02:31:02 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:11:29.401 02:31:02 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:11:29.401 02:31:02 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:11:29.401 02:31:02 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:11:29.401 02:31:02 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:11:29.401 02:31:02 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:11:29.401 02:31:02 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:11:29.401 02:31:02 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:29.401 02:31:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:29.401 02:31:02 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:11:29.401 02:31:02 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:11:29.401 02:31:02 -- nvmf/common.sh@105 -- # continue 2 00:11:29.401 02:31:02 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:29.401 02:31:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:29.401 02:31:02 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:11:29.401 02:31:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:29.401 02:31:02 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:11:29.401 02:31:02 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:11:29.401 02:31:02 -- nvmf/common.sh@105 -- # continue 2 00:11:29.401 02:31:02 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:11:29.401 02:31:02 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:11:29.401 02:31:02 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:11:29.401 02:31:02 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:11:29.401 02:31:02 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:29.401 02:31:02 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:29.401 02:31:02 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:11:29.401 02:31:02 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:11:29.401 02:31:02 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:11:29.401 02:31:02 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:11:29.401 02:31:02 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:29.401 02:31:02 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:29.401 02:31:02 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:11:29.401 192.168.100.9' 00:11:29.401 02:31:02 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:11:29.401 192.168.100.9' 00:11:29.401 02:31:02 -- nvmf/common.sh@446 -- # head -n 1 00:11:29.401 02:31:02 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:11:29.401 02:31:02 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:11:29.401 192.168.100.9' 00:11:29.401 02:31:02 -- nvmf/common.sh@447 -- # tail -n +2 00:11:29.401 02:31:02 -- nvmf/common.sh@447 -- # head -n 1 00:11:29.401 02:31:02 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:11:29.401 02:31:02 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:11:29.401 02:31:02 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:11:29.401 02:31:02 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:11:29.401 02:31:02 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:11:29.401 02:31:02 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:11:29.401 02:31:02 -- target/ns_hotplug_stress.sh@14 -- # nvmfappstart -m 0xE 00:11:29.401 02:31:02 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:11:29.401 02:31:02 -- common/autotest_common.sh@710 -- # xtrace_disable 00:11:29.401 02:31:02 -- common/autotest_common.sh@10 -- # set +x 00:11:29.401 02:31:02 -- nvmf/common.sh@470 -- # nvmfpid=1484361 00:11:29.401 02:31:02 -- nvmf/common.sh@471 -- # waitforlisten 1484361 00:11:29.401 02:31:02 -- common/autotest_common.sh@817 -- # '[' -z 1484361 ']' 00:11:29.401 02:31:02 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:29.401 02:31:02 -- common/autotest_common.sh@822 -- # local max_retries=100 00:11:29.401 02:31:02 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:29.401 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:29.401 02:31:02 -- common/autotest_common.sh@826 -- # xtrace_disable 00:11:29.401 02:31:02 -- common/autotest_common.sh@10 -- # set +x 00:11:29.401 02:31:02 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:11:29.401 [2024-04-27 02:31:02.516592] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:11:29.401 [2024-04-27 02:31:02.516648] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:29.401 EAL: No free 2048 kB hugepages reported on node 1 00:11:29.401 [2024-04-27 02:31:02.588302] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:11:29.401 [2024-04-27 02:31:02.676604] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:29.401 [2024-04-27 02:31:02.676646] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:29.401 [2024-04-27 02:31:02.676656] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:11:29.402 [2024-04-27 02:31:02.676665] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:11:29.402 [2024-04-27 02:31:02.676672] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:29.402 [2024-04-27 02:31:02.676774] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:29.402 [2024-04-27 02:31:02.676867] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:29.402 [2024-04-27 02:31:02.676869] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:29.966 02:31:03 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:11:29.966 02:31:03 -- common/autotest_common.sh@850 -- # return 0 00:11:29.966 02:31:03 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:11:29.966 02:31:03 -- common/autotest_common.sh@716 -- # xtrace_disable 00:11:29.966 02:31:03 -- common/autotest_common.sh@10 -- # set +x 00:11:29.966 02:31:03 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:29.966 02:31:03 -- target/ns_hotplug_stress.sh@16 -- # null_size=1000 00:11:29.966 02:31:03 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:11:29.966 [2024-04-27 02:31:03.557598] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x20bed30/0x20c3220) succeed. 00:11:29.966 [2024-04-27 02:31:03.568046] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x20c02d0/0x21048b0) succeed. 00:11:30.225 02:31:03 -- target/ns_hotplug_stress.sh@20 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:11:30.484 02:31:03 -- target/ns_hotplug_stress.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:11:30.484 [2024-04-27 02:31:04.057699] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:11:30.484 02:31:04 -- target/ns_hotplug_stress.sh@22 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:11:30.744 02:31:04 -- target/ns_hotplug_stress.sh@23 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:11:31.003 Malloc0 00:11:31.003 02:31:04 -- target/ns_hotplug_stress.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:11:31.003 Delay0 00:11:31.263 02:31:04 -- target/ns_hotplug_stress.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:31.263 02:31:04 -- target/ns_hotplug_stress.sh@26 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:11:31.522 NULL1 00:11:31.522 02:31:05 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:11:31.781 02:31:05 -- target/ns_hotplug_stress.sh@33 -- # PERF_PID=1484753 00:11:31.781 02:31:05 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:11:31.781 02:31:05 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1484753 00:11:31.781 02:31:05 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:31.781 EAL: No free 2048 kB hugepages reported on node 1 00:11:33.162 Read completed with error (sct=0, sc=11) 00:11:33.162 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:33.162 02:31:06 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:33.162 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:33.162 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:33.162 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:33.162 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:33.162 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:33.162 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:33.162 02:31:06 -- target/ns_hotplug_stress.sh@40 -- # null_size=1001 00:11:33.162 02:31:06 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:11:33.162 true 00:11:33.162 02:31:06 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1484753 00:11:33.162 02:31:06 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:34.099 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:34.099 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:34.099 02:31:07 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:34.099 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:34.099 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:34.099 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:34.099 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:34.099 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:34.358 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:34.358 02:31:07 -- target/ns_hotplug_stress.sh@40 -- # null_size=1002 00:11:34.358 02:31:07 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:11:34.358 true 00:11:34.358 02:31:07 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1484753 00:11:34.358 02:31:07 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:35.294 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:35.294 02:31:08 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:35.294 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:35.294 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:35.294 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:35.294 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:35.294 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:35.294 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:35.553 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:35.553 02:31:08 -- target/ns_hotplug_stress.sh@40 -- # null_size=1003 00:11:35.553 02:31:08 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:11:35.553 true 00:11:35.553 02:31:09 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1484753 00:11:35.553 02:31:09 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:36.489 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:36.489 02:31:09 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:36.489 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:36.489 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:36.489 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:36.489 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:36.489 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:36.748 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:36.748 02:31:10 -- target/ns_hotplug_stress.sh@40 -- # null_size=1004 00:11:36.748 02:31:10 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:11:36.748 true 00:11:36.748 02:31:10 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1484753 00:11:36.748 02:31:10 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:37.685 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:37.685 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:37.685 02:31:11 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:37.685 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:37.685 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:37.685 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:37.685 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:37.685 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:37.943 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:37.943 02:31:11 -- target/ns_hotplug_stress.sh@40 -- # null_size=1005 00:11:37.943 02:31:11 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:11:37.943 true 00:11:37.943 02:31:11 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1484753 00:11:37.943 02:31:11 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:38.880 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:38.880 02:31:12 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:38.880 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:38.880 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:39.138 02:31:12 -- target/ns_hotplug_stress.sh@40 -- # null_size=1006 00:11:39.138 02:31:12 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:11:39.138 true 00:11:39.138 02:31:12 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1484753 00:11:39.138 02:31:12 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:39.397 02:31:12 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:39.654 02:31:13 -- target/ns_hotplug_stress.sh@40 -- # null_size=1007 00:11:39.654 02:31:13 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:11:39.654 true 00:11:39.654 02:31:13 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1484753 00:11:39.654 02:31:13 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:39.912 02:31:13 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:40.170 02:31:13 -- target/ns_hotplug_stress.sh@40 -- # null_size=1008 00:11:40.170 02:31:13 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:11:40.170 true 00:11:40.437 02:31:13 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1484753 00:11:40.437 02:31:13 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:40.437 02:31:13 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:40.707 02:31:14 -- target/ns_hotplug_stress.sh@40 -- # null_size=1009 00:11:40.707 02:31:14 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:11:40.707 true 00:11:40.966 02:31:14 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1484753 00:11:40.966 02:31:14 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:41.903 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:41.903 02:31:15 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:41.903 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:41.903 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:41.903 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:42.163 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:42.163 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:42.163 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:42.163 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:42.163 02:31:15 -- target/ns_hotplug_stress.sh@40 -- # null_size=1010 00:11:42.163 02:31:15 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:11:42.422 true 00:11:42.422 02:31:15 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1484753 00:11:42.422 02:31:15 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:43.358 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:43.358 02:31:16 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:43.358 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:43.358 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:43.358 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:43.358 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:43.358 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:43.358 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:43.358 02:31:16 -- target/ns_hotplug_stress.sh@40 -- # null_size=1011 00:11:43.358 02:31:16 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:11:43.615 true 00:11:43.615 02:31:17 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1484753 00:11:43.615 02:31:17 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:44.551 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:44.551 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:44.551 02:31:17 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:44.551 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:44.551 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:44.551 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:44.551 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:44.551 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:44.551 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:44.551 02:31:18 -- target/ns_hotplug_stress.sh@40 -- # null_size=1012 00:11:44.551 02:31:18 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:11:44.809 true 00:11:44.809 02:31:18 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1484753 00:11:44.809 02:31:18 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:45.745 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:45.745 02:31:19 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:45.745 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:45.745 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:45.745 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:45.745 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:45.745 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:45.745 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:45.745 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:45.745 02:31:19 -- target/ns_hotplug_stress.sh@40 -- # null_size=1013 00:11:45.745 02:31:19 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:11:46.003 true 00:11:46.003 02:31:19 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1484753 00:11:46.003 02:31:19 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:46.941 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:46.941 02:31:20 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:46.941 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:46.941 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:46.941 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:46.941 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:46.941 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:46.941 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:46.941 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:46.941 02:31:20 -- target/ns_hotplug_stress.sh@40 -- # null_size=1014 00:11:46.941 02:31:20 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:11:47.200 true 00:11:47.200 02:31:20 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1484753 00:11:47.200 02:31:20 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:48.138 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:48.138 02:31:21 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:48.138 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:48.138 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:48.138 02:31:21 -- target/ns_hotplug_stress.sh@40 -- # null_size=1015 00:11:48.138 02:31:21 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:11:48.397 true 00:11:48.397 02:31:21 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1484753 00:11:48.397 02:31:21 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:49.333 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:49.333 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:49.333 02:31:22 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:49.333 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:49.333 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:49.333 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:49.333 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:49.333 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:49.333 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:49.333 02:31:22 -- target/ns_hotplug_stress.sh@40 -- # null_size=1016 00:11:49.333 02:31:22 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:11:49.591 true 00:11:49.591 02:31:23 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1484753 00:11:49.591 02:31:23 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:50.525 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:50.525 02:31:23 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:50.525 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:50.525 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:50.525 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:50.525 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:50.525 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:50.525 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:50.525 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:50.525 02:31:24 -- target/ns_hotplug_stress.sh@40 -- # null_size=1017 00:11:50.525 02:31:24 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:11:50.783 true 00:11:50.783 02:31:24 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1484753 00:11:50.783 02:31:24 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:51.718 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:51.718 02:31:25 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:51.718 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:51.718 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:51.718 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:51.718 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:51.718 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:51.718 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:51.718 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:51.718 02:31:25 -- target/ns_hotplug_stress.sh@40 -- # null_size=1018 00:11:51.718 02:31:25 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:11:51.976 true 00:11:51.976 02:31:25 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1484753 00:11:51.976 02:31:25 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:52.914 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:52.914 02:31:26 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:52.914 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:52.914 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:52.914 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:52.914 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:52.914 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:52.914 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:52.914 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:52.914 02:31:26 -- target/ns_hotplug_stress.sh@40 -- # null_size=1019 00:11:52.914 02:31:26 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:11:53.173 true 00:11:53.173 02:31:26 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1484753 00:11:53.173 02:31:26 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:54.111 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:54.111 02:31:27 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:54.111 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:54.111 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:54.111 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:54.111 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:54.111 02:31:27 -- target/ns_hotplug_stress.sh@40 -- # null_size=1020 00:11:54.111 02:31:27 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:11:54.370 true 00:11:54.370 02:31:27 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1484753 00:11:54.370 02:31:27 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:55.309 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:55.309 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:55.309 02:31:28 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:55.309 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:55.309 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:55.309 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:55.309 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:55.309 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:55.309 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:55.309 02:31:28 -- target/ns_hotplug_stress.sh@40 -- # null_size=1021 00:11:55.309 02:31:28 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:11:55.568 true 00:11:55.568 02:31:29 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1484753 00:11:55.568 02:31:29 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:56.505 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:56.505 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:56.505 02:31:29 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:56.505 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:56.505 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:56.505 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:56.505 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:56.505 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:56.505 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:56.505 02:31:30 -- target/ns_hotplug_stress.sh@40 -- # null_size=1022 00:11:56.505 02:31:30 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:11:56.764 true 00:11:56.764 02:31:30 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1484753 00:11:56.764 02:31:30 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:57.730 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:57.730 02:31:31 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:57.730 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:57.730 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:57.730 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:57.730 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:57.730 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:57.730 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:57.730 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:57.730 02:31:31 -- target/ns_hotplug_stress.sh@40 -- # null_size=1023 00:11:57.730 02:31:31 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:11:57.990 true 00:11:57.990 02:31:31 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1484753 00:11:57.990 02:31:31 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:58.927 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:58.927 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:58.927 02:31:32 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:58.927 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:58.927 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:58.927 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:58.927 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:58.927 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:58.927 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:58.927 02:31:32 -- target/ns_hotplug_stress.sh@40 -- # null_size=1024 00:11:58.927 02:31:32 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:11:59.187 true 00:11:59.187 02:31:32 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1484753 00:11:59.187 02:31:32 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:00.158 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:00.158 02:31:33 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:00.158 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:00.158 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:00.158 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:00.158 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:00.158 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:00.158 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:00.158 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:00.158 02:31:33 -- target/ns_hotplug_stress.sh@40 -- # null_size=1025 00:12:00.158 02:31:33 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:12:00.417 true 00:12:00.417 02:31:33 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1484753 00:12:00.417 02:31:33 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:01.354 02:31:34 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:01.354 02:31:34 -- target/ns_hotplug_stress.sh@40 -- # null_size=1026 00:12:01.354 02:31:34 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:12:01.614 true 00:12:01.614 02:31:35 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1484753 00:12:01.614 02:31:35 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:01.873 02:31:35 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:01.873 02:31:35 -- target/ns_hotplug_stress.sh@40 -- # null_size=1027 00:12:01.873 02:31:35 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:12:02.132 true 00:12:02.132 02:31:35 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1484753 00:12:02.132 02:31:35 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:02.391 02:31:35 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:02.391 02:31:35 -- target/ns_hotplug_stress.sh@40 -- # null_size=1028 00:12:02.391 02:31:35 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:12:02.651 true 00:12:02.651 02:31:36 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1484753 00:12:02.651 02:31:36 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:02.910 02:31:36 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:03.169 02:31:36 -- target/ns_hotplug_stress.sh@40 -- # null_size=1029 00:12:03.169 02:31:36 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:12:03.169 true 00:12:03.169 02:31:36 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1484753 00:12:03.169 02:31:36 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:03.428 02:31:36 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:03.688 02:31:37 -- target/ns_hotplug_stress.sh@40 -- # null_size=1030 00:12:03.688 02:31:37 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1030 00:12:03.688 true 00:12:03.688 02:31:37 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1484753 00:12:03.688 02:31:37 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:03.946 02:31:37 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:03.946 Initializing NVMe Controllers 00:12:03.947 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:12:03.947 Controller IO queue size 128, less than required. 00:12:03.947 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:12:03.947 Controller IO queue size 128, less than required. 00:12:03.947 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:12:03.947 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:12:03.947 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:12:03.947 Initialization complete. Launching workers. 00:12:03.947 ======================================================== 00:12:03.947 Latency(us) 00:12:03.947 Device Information : IOPS MiB/s Average min max 00:12:03.947 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 5449.69 2.66 19918.44 823.16 1138080.67 00:12:03.947 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 32852.61 16.04 3896.15 1661.08 293983.17 00:12:03.947 ======================================================== 00:12:03.947 Total : 38302.30 18.70 6175.82 823.16 1138080.67 00:12:03.947 00:12:04.205 02:31:37 -- target/ns_hotplug_stress.sh@40 -- # null_size=1031 00:12:04.205 02:31:37 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1031 00:12:04.205 true 00:12:04.465 02:31:37 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1484753 00:12:04.465 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 35: kill: (1484753) - No such process 00:12:04.465 02:31:37 -- target/ns_hotplug_stress.sh@44 -- # wait 1484753 00:12:04.465 02:31:37 -- target/ns_hotplug_stress.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:12:04.465 02:31:37 -- target/ns_hotplug_stress.sh@48 -- # nvmftestfini 00:12:04.465 02:31:37 -- nvmf/common.sh@477 -- # nvmfcleanup 00:12:04.465 02:31:37 -- nvmf/common.sh@117 -- # sync 00:12:04.465 02:31:37 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:12:04.465 02:31:37 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:12:04.465 02:31:37 -- nvmf/common.sh@120 -- # set +e 00:12:04.465 02:31:37 -- nvmf/common.sh@121 -- # for i in {1..20} 00:12:04.465 02:31:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:12:04.465 rmmod nvme_rdma 00:12:04.465 rmmod nvme_fabrics 00:12:04.465 02:31:37 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:12:04.465 02:31:37 -- nvmf/common.sh@124 -- # set -e 00:12:04.465 02:31:37 -- nvmf/common.sh@125 -- # return 0 00:12:04.465 02:31:37 -- nvmf/common.sh@478 -- # '[' -n 1484361 ']' 00:12:04.465 02:31:37 -- nvmf/common.sh@479 -- # killprocess 1484361 00:12:04.465 02:31:37 -- common/autotest_common.sh@936 -- # '[' -z 1484361 ']' 00:12:04.465 02:31:37 -- common/autotest_common.sh@940 -- # kill -0 1484361 00:12:04.465 02:31:37 -- common/autotest_common.sh@941 -- # uname 00:12:04.465 02:31:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:04.465 02:31:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1484361 00:12:04.465 02:31:37 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:12:04.465 02:31:37 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:12:04.465 02:31:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1484361' 00:12:04.465 killing process with pid 1484361 00:12:04.465 02:31:37 -- common/autotest_common.sh@955 -- # kill 1484361 00:12:04.465 02:31:37 -- common/autotest_common.sh@960 -- # wait 1484361 00:12:04.465 [2024-04-27 02:31:38.013527] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:12:04.724 02:31:38 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:12:04.724 02:31:38 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:12:04.724 00:12:04.724 real 0m41.933s 00:12:04.724 user 2m35.187s 00:12:04.724 sys 0m8.765s 00:12:04.724 02:31:38 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:12:04.724 02:31:38 -- common/autotest_common.sh@10 -- # set +x 00:12:04.724 ************************************ 00:12:04.724 END TEST nvmf_ns_hotplug_stress 00:12:04.724 ************************************ 00:12:04.724 02:31:38 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=rdma 00:12:04.724 02:31:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:04.724 02:31:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:04.724 02:31:38 -- common/autotest_common.sh@10 -- # set +x 00:12:04.984 ************************************ 00:12:04.984 START TEST nvmf_connect_stress 00:12:04.984 ************************************ 00:12:04.984 02:31:38 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=rdma 00:12:04.984 * Looking for test storage... 00:12:04.984 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:12:04.984 02:31:38 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:12:04.984 02:31:38 -- nvmf/common.sh@7 -- # uname -s 00:12:04.984 02:31:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:04.984 02:31:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:04.984 02:31:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:04.984 02:31:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:04.984 02:31:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:04.984 02:31:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:04.984 02:31:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:04.984 02:31:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:04.984 02:31:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:04.984 02:31:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:04.984 02:31:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:12:04.984 02:31:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:12:04.984 02:31:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:04.984 02:31:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:04.984 02:31:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:04.984 02:31:38 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:12:04.984 02:31:38 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:12:04.984 02:31:38 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:04.984 02:31:38 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:04.984 02:31:38 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:04.984 02:31:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:04.984 02:31:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:04.984 02:31:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:04.984 02:31:38 -- paths/export.sh@5 -- # export PATH 00:12:04.984 02:31:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:04.984 02:31:38 -- nvmf/common.sh@47 -- # : 0 00:12:04.984 02:31:38 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:12:04.984 02:31:38 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:12:04.984 02:31:38 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:12:04.984 02:31:38 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:04.984 02:31:38 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:04.984 02:31:38 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:12:04.984 02:31:38 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:12:04.984 02:31:38 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:12:04.984 02:31:38 -- target/connect_stress.sh@12 -- # nvmftestinit 00:12:04.984 02:31:38 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:12:04.984 02:31:38 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:04.984 02:31:38 -- nvmf/common.sh@437 -- # prepare_net_devs 00:12:04.984 02:31:38 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:12:04.984 02:31:38 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:12:04.984 02:31:38 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:04.984 02:31:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:04.984 02:31:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:04.984 02:31:38 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:12:04.984 02:31:38 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:12:04.984 02:31:38 -- nvmf/common.sh@285 -- # xtrace_disable 00:12:04.984 02:31:38 -- common/autotest_common.sh@10 -- # set +x 00:12:11.553 02:31:44 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:11.553 02:31:44 -- nvmf/common.sh@291 -- # pci_devs=() 00:12:11.553 02:31:44 -- nvmf/common.sh@291 -- # local -a pci_devs 00:12:11.553 02:31:44 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:12:11.553 02:31:44 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:12:11.553 02:31:44 -- nvmf/common.sh@293 -- # pci_drivers=() 00:12:11.553 02:31:44 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:12:11.553 02:31:44 -- nvmf/common.sh@295 -- # net_devs=() 00:12:11.553 02:31:44 -- nvmf/common.sh@295 -- # local -ga net_devs 00:12:11.553 02:31:44 -- nvmf/common.sh@296 -- # e810=() 00:12:11.553 02:31:44 -- nvmf/common.sh@296 -- # local -ga e810 00:12:11.553 02:31:44 -- nvmf/common.sh@297 -- # x722=() 00:12:11.553 02:31:44 -- nvmf/common.sh@297 -- # local -ga x722 00:12:11.553 02:31:44 -- nvmf/common.sh@298 -- # mlx=() 00:12:11.553 02:31:44 -- nvmf/common.sh@298 -- # local -ga mlx 00:12:11.553 02:31:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:11.553 02:31:44 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:11.553 02:31:44 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:11.553 02:31:44 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:11.553 02:31:44 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:11.553 02:31:44 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:11.553 02:31:44 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:11.553 02:31:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:11.553 02:31:44 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:11.553 02:31:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:11.553 02:31:44 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:11.553 02:31:44 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:12:11.553 02:31:44 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:12:11.553 02:31:44 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:12:11.553 02:31:44 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:12:11.553 02:31:44 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:12:11.553 02:31:44 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:12:11.553 02:31:44 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:12:11.553 02:31:44 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:11.553 02:31:44 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:12:11.553 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:12:11.553 02:31:44 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:12:11.553 02:31:44 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:12:11.553 02:31:44 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:12:11.553 02:31:44 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:12:11.553 02:31:44 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:12:11.553 02:31:44 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:11.553 02:31:44 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:11.553 02:31:44 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:12:11.553 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:12:11.553 02:31:44 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:12:11.553 02:31:44 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:12:11.553 02:31:44 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:12:11.553 02:31:44 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:12:11.553 02:31:44 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:12:11.553 02:31:44 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:11.553 02:31:44 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:12:11.553 02:31:44 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:12:11.553 02:31:44 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:11.553 02:31:44 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:11.553 02:31:44 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:11.553 02:31:44 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:11.553 02:31:44 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:12:11.553 Found net devices under 0000:18:00.0: mlx_0_0 00:12:11.553 02:31:44 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:11.553 02:31:44 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:11.553 02:31:44 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:11.553 02:31:44 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:11.553 02:31:44 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:11.553 02:31:44 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:12:11.553 Found net devices under 0000:18:00.1: mlx_0_1 00:12:11.553 02:31:44 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:11.553 02:31:44 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:12:11.553 02:31:44 -- nvmf/common.sh@403 -- # is_hw=yes 00:12:11.553 02:31:44 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:12:11.553 02:31:44 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:12:11.553 02:31:44 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:12:11.553 02:31:44 -- nvmf/common.sh@409 -- # rdma_device_init 00:12:11.553 02:31:44 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:12:11.553 02:31:44 -- nvmf/common.sh@58 -- # uname 00:12:11.553 02:31:44 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:12:11.553 02:31:44 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:12:11.553 02:31:44 -- nvmf/common.sh@63 -- # modprobe ib_core 00:12:11.553 02:31:44 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:12:11.553 02:31:44 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:12:11.553 02:31:44 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:12:11.553 02:31:44 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:12:11.553 02:31:44 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:12:11.553 02:31:44 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:12:11.553 02:31:44 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:12:11.553 02:31:44 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:12:11.553 02:31:44 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:11.553 02:31:44 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:11.553 02:31:44 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:11.553 02:31:44 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:11.553 02:31:44 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:11.553 02:31:44 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:11.553 02:31:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:11.553 02:31:44 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:12:11.553 02:31:44 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:12:11.553 02:31:44 -- nvmf/common.sh@105 -- # continue 2 00:12:11.553 02:31:44 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:11.553 02:31:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:11.553 02:31:44 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:12:11.553 02:31:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:11.554 02:31:44 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:12:11.554 02:31:44 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:12:11.554 02:31:44 -- nvmf/common.sh@105 -- # continue 2 00:12:11.554 02:31:44 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:11.554 02:31:44 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:12:11.554 02:31:44 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:12:11.554 02:31:44 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:12:11.554 02:31:44 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:11.554 02:31:44 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:11.554 02:31:44 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:12:11.554 02:31:44 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:12:11.554 02:31:44 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:12:11.554 60: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:12:11.554 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:12:11.554 altname enp24s0f0np0 00:12:11.554 altname ens785f0np0 00:12:11.554 inet 192.168.100.8/24 scope global mlx_0_0 00:12:11.554 valid_lft forever preferred_lft forever 00:12:11.554 02:31:44 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:11.554 02:31:44 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:12:11.554 02:31:44 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:12:11.554 02:31:44 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:12:11.554 02:31:44 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:11.554 02:31:44 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:11.554 02:31:44 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:12:11.554 02:31:44 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:12:11.554 02:31:44 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:12:11.554 61: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:12:11.554 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:12:11.554 altname enp24s0f1np1 00:12:11.554 altname ens785f1np1 00:12:11.554 inet 192.168.100.9/24 scope global mlx_0_1 00:12:11.554 valid_lft forever preferred_lft forever 00:12:11.554 02:31:44 -- nvmf/common.sh@411 -- # return 0 00:12:11.554 02:31:44 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:12:11.554 02:31:44 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:12:11.554 02:31:44 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:12:11.554 02:31:44 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:12:11.554 02:31:44 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:12:11.554 02:31:44 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:11.554 02:31:44 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:11.554 02:31:44 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:11.554 02:31:44 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:11.554 02:31:44 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:11.554 02:31:44 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:11.554 02:31:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:11.554 02:31:44 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:12:11.554 02:31:44 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:12:11.554 02:31:44 -- nvmf/common.sh@105 -- # continue 2 00:12:11.554 02:31:44 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:11.554 02:31:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:11.554 02:31:44 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:12:11.554 02:31:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:11.554 02:31:44 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:12:11.554 02:31:44 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:12:11.554 02:31:44 -- nvmf/common.sh@105 -- # continue 2 00:12:11.554 02:31:44 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:11.554 02:31:44 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:12:11.554 02:31:44 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:12:11.554 02:31:44 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:12:11.554 02:31:44 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:11.554 02:31:44 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:11.554 02:31:44 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:11.554 02:31:44 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:12:11.554 02:31:44 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:12:11.554 02:31:44 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:12:11.554 02:31:44 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:11.554 02:31:44 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:11.554 02:31:44 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:12:11.554 192.168.100.9' 00:12:11.554 02:31:44 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:12:11.554 192.168.100.9' 00:12:11.554 02:31:44 -- nvmf/common.sh@446 -- # head -n 1 00:12:11.554 02:31:44 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:12:11.554 02:31:44 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:12:11.554 192.168.100.9' 00:12:11.554 02:31:44 -- nvmf/common.sh@447 -- # tail -n +2 00:12:11.554 02:31:44 -- nvmf/common.sh@447 -- # head -n 1 00:12:11.554 02:31:44 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:12:11.554 02:31:44 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:12:11.554 02:31:44 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:12:11.554 02:31:44 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:12:11.554 02:31:44 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:12:11.554 02:31:44 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:12:11.554 02:31:44 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:12:11.554 02:31:44 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:12:11.554 02:31:44 -- common/autotest_common.sh@710 -- # xtrace_disable 00:12:11.554 02:31:44 -- common/autotest_common.sh@10 -- # set +x 00:12:11.554 02:31:44 -- nvmf/common.sh@470 -- # nvmfpid=1493344 00:12:11.554 02:31:44 -- nvmf/common.sh@471 -- # waitforlisten 1493344 00:12:11.554 02:31:44 -- common/autotest_common.sh@817 -- # '[' -z 1493344 ']' 00:12:11.554 02:31:44 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:11.554 02:31:44 -- common/autotest_common.sh@822 -- # local max_retries=100 00:12:11.554 02:31:44 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:11.554 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:11.554 02:31:44 -- common/autotest_common.sh@826 -- # xtrace_disable 00:12:11.554 02:31:44 -- common/autotest_common.sh@10 -- # set +x 00:12:11.554 02:31:44 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:11.554 [2024-04-27 02:31:44.978804] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:12:11.554 [2024-04-27 02:31:44.978861] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:11.554 EAL: No free 2048 kB hugepages reported on node 1 00:12:11.554 [2024-04-27 02:31:45.050848] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:11.554 [2024-04-27 02:31:45.139222] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:11.554 [2024-04-27 02:31:45.139265] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:11.554 [2024-04-27 02:31:45.139278] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:12:11.554 [2024-04-27 02:31:45.139287] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:12:11.554 [2024-04-27 02:31:45.139294] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:11.554 [2024-04-27 02:31:45.139394] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:11.554 [2024-04-27 02:31:45.139419] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:11.554 [2024-04-27 02:31:45.139422] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:12.490 02:31:45 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:12:12.490 02:31:45 -- common/autotest_common.sh@850 -- # return 0 00:12:12.490 02:31:45 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:12:12.490 02:31:45 -- common/autotest_common.sh@716 -- # xtrace_disable 00:12:12.490 02:31:45 -- common/autotest_common.sh@10 -- # set +x 00:12:12.490 02:31:45 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:12.490 02:31:45 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:12:12.490 02:31:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:12.490 02:31:45 -- common/autotest_common.sh@10 -- # set +x 00:12:12.490 [2024-04-27 02:31:45.864513] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x216dd30/0x2172220) succeed. 00:12:12.490 [2024-04-27 02:31:45.874695] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x216f2d0/0x21b38b0) succeed. 00:12:12.490 02:31:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:12.490 02:31:45 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:12:12.490 02:31:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:12.490 02:31:45 -- common/autotest_common.sh@10 -- # set +x 00:12:12.490 02:31:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:12.490 02:31:45 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:12:12.490 02:31:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:12.490 02:31:45 -- common/autotest_common.sh@10 -- # set +x 00:12:12.490 [2024-04-27 02:31:45.988127] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:12:12.490 02:31:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:12.490 02:31:45 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:12:12.490 02:31:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:12.490 02:31:45 -- common/autotest_common.sh@10 -- # set +x 00:12:12.490 NULL1 00:12:12.490 02:31:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:12.490 02:31:46 -- target/connect_stress.sh@21 -- # PERF_PID=1493471 00:12:12.490 02:31:46 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:12:12.490 02:31:46 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:12:12.490 02:31:46 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:12:12.490 02:31:46 -- target/connect_stress.sh@27 -- # seq 1 20 00:12:12.490 02:31:46 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:12.490 02:31:46 -- target/connect_stress.sh@28 -- # cat 00:12:12.490 02:31:46 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:12.490 02:31:46 -- target/connect_stress.sh@28 -- # cat 00:12:12.490 02:31:46 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:12.490 02:31:46 -- target/connect_stress.sh@28 -- # cat 00:12:12.490 02:31:46 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:12.490 02:31:46 -- target/connect_stress.sh@28 -- # cat 00:12:12.490 02:31:46 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:12.490 02:31:46 -- target/connect_stress.sh@28 -- # cat 00:12:12.490 02:31:46 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:12.490 02:31:46 -- target/connect_stress.sh@28 -- # cat 00:12:12.490 EAL: No free 2048 kB hugepages reported on node 1 00:12:12.490 02:31:46 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:12.490 02:31:46 -- target/connect_stress.sh@28 -- # cat 00:12:12.490 02:31:46 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:12.490 02:31:46 -- target/connect_stress.sh@28 -- # cat 00:12:12.490 02:31:46 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:12.490 02:31:46 -- target/connect_stress.sh@28 -- # cat 00:12:12.490 02:31:46 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:12.490 02:31:46 -- target/connect_stress.sh@28 -- # cat 00:12:12.490 02:31:46 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:12.490 02:31:46 -- target/connect_stress.sh@28 -- # cat 00:12:12.490 02:31:46 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:12.490 02:31:46 -- target/connect_stress.sh@28 -- # cat 00:12:12.490 02:31:46 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:12.491 02:31:46 -- target/connect_stress.sh@28 -- # cat 00:12:12.491 02:31:46 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:12.491 02:31:46 -- target/connect_stress.sh@28 -- # cat 00:12:12.491 02:31:46 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:12.491 02:31:46 -- target/connect_stress.sh@28 -- # cat 00:12:12.491 02:31:46 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:12.491 02:31:46 -- target/connect_stress.sh@28 -- # cat 00:12:12.491 02:31:46 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:12.491 02:31:46 -- target/connect_stress.sh@28 -- # cat 00:12:12.491 02:31:46 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:12.491 02:31:46 -- target/connect_stress.sh@28 -- # cat 00:12:12.491 02:31:46 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:12.491 02:31:46 -- target/connect_stress.sh@28 -- # cat 00:12:12.491 02:31:46 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:12.491 02:31:46 -- target/connect_stress.sh@28 -- # cat 00:12:12.749 02:31:46 -- target/connect_stress.sh@34 -- # kill -0 1493471 00:12:12.749 02:31:46 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:12.749 02:31:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:12.749 02:31:46 -- common/autotest_common.sh@10 -- # set +x 00:12:13.008 02:31:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:13.008 02:31:46 -- target/connect_stress.sh@34 -- # kill -0 1493471 00:12:13.008 02:31:46 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:13.008 02:31:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:13.008 02:31:46 -- common/autotest_common.sh@10 -- # set +x 00:12:13.266 02:31:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:13.266 02:31:46 -- target/connect_stress.sh@34 -- # kill -0 1493471 00:12:13.266 02:31:46 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:13.266 02:31:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:13.266 02:31:46 -- common/autotest_common.sh@10 -- # set +x 00:12:13.524 02:31:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:13.524 02:31:47 -- target/connect_stress.sh@34 -- # kill -0 1493471 00:12:13.524 02:31:47 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:13.524 02:31:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:13.524 02:31:47 -- common/autotest_common.sh@10 -- # set +x 00:12:14.091 02:31:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:14.091 02:31:47 -- target/connect_stress.sh@34 -- # kill -0 1493471 00:12:14.091 02:31:47 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:14.091 02:31:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:14.091 02:31:47 -- common/autotest_common.sh@10 -- # set +x 00:12:14.349 02:31:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:14.349 02:31:47 -- target/connect_stress.sh@34 -- # kill -0 1493471 00:12:14.349 02:31:47 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:14.349 02:31:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:14.349 02:31:47 -- common/autotest_common.sh@10 -- # set +x 00:12:14.608 02:31:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:14.608 02:31:48 -- target/connect_stress.sh@34 -- # kill -0 1493471 00:12:14.608 02:31:48 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:14.608 02:31:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:14.608 02:31:48 -- common/autotest_common.sh@10 -- # set +x 00:12:14.867 02:31:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:14.867 02:31:48 -- target/connect_stress.sh@34 -- # kill -0 1493471 00:12:14.867 02:31:48 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:14.867 02:31:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:14.867 02:31:48 -- common/autotest_common.sh@10 -- # set +x 00:12:15.126 02:31:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:15.126 02:31:48 -- target/connect_stress.sh@34 -- # kill -0 1493471 00:12:15.126 02:31:48 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:15.126 02:31:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:15.126 02:31:48 -- common/autotest_common.sh@10 -- # set +x 00:12:15.696 02:31:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:15.696 02:31:49 -- target/connect_stress.sh@34 -- # kill -0 1493471 00:12:15.696 02:31:49 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:15.696 02:31:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:15.696 02:31:49 -- common/autotest_common.sh@10 -- # set +x 00:12:15.958 02:31:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:15.958 02:31:49 -- target/connect_stress.sh@34 -- # kill -0 1493471 00:12:15.958 02:31:49 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:15.958 02:31:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:15.958 02:31:49 -- common/autotest_common.sh@10 -- # set +x 00:12:16.218 02:31:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:16.218 02:31:49 -- target/connect_stress.sh@34 -- # kill -0 1493471 00:12:16.218 02:31:49 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:16.218 02:31:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:16.218 02:31:49 -- common/autotest_common.sh@10 -- # set +x 00:12:16.477 02:31:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:16.477 02:31:50 -- target/connect_stress.sh@34 -- # kill -0 1493471 00:12:16.477 02:31:50 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:16.477 02:31:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:16.477 02:31:50 -- common/autotest_common.sh@10 -- # set +x 00:12:16.736 02:31:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:16.736 02:31:50 -- target/connect_stress.sh@34 -- # kill -0 1493471 00:12:16.736 02:31:50 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:16.736 02:31:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:16.736 02:31:50 -- common/autotest_common.sh@10 -- # set +x 00:12:17.306 02:31:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:17.306 02:31:50 -- target/connect_stress.sh@34 -- # kill -0 1493471 00:12:17.306 02:31:50 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:17.306 02:31:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:17.306 02:31:50 -- common/autotest_common.sh@10 -- # set +x 00:12:17.617 02:31:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:17.617 02:31:51 -- target/connect_stress.sh@34 -- # kill -0 1493471 00:12:17.617 02:31:51 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:17.617 02:31:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:17.617 02:31:51 -- common/autotest_common.sh@10 -- # set +x 00:12:17.876 02:31:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:17.876 02:31:51 -- target/connect_stress.sh@34 -- # kill -0 1493471 00:12:17.876 02:31:51 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:17.876 02:31:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:17.876 02:31:51 -- common/autotest_common.sh@10 -- # set +x 00:12:18.136 02:31:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:18.136 02:31:51 -- target/connect_stress.sh@34 -- # kill -0 1493471 00:12:18.136 02:31:51 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:18.136 02:31:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:18.136 02:31:51 -- common/autotest_common.sh@10 -- # set +x 00:12:18.395 02:31:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:18.395 02:31:51 -- target/connect_stress.sh@34 -- # kill -0 1493471 00:12:18.395 02:31:51 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:18.395 02:31:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:18.395 02:31:51 -- common/autotest_common.sh@10 -- # set +x 00:12:18.963 02:31:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:18.963 02:31:52 -- target/connect_stress.sh@34 -- # kill -0 1493471 00:12:18.963 02:31:52 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:18.963 02:31:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:18.963 02:31:52 -- common/autotest_common.sh@10 -- # set +x 00:12:19.222 02:31:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:19.222 02:31:52 -- target/connect_stress.sh@34 -- # kill -0 1493471 00:12:19.222 02:31:52 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:19.222 02:31:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:19.222 02:31:52 -- common/autotest_common.sh@10 -- # set +x 00:12:19.480 02:31:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:19.480 02:31:52 -- target/connect_stress.sh@34 -- # kill -0 1493471 00:12:19.480 02:31:52 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:19.480 02:31:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:19.480 02:31:52 -- common/autotest_common.sh@10 -- # set +x 00:12:19.738 02:31:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:19.738 02:31:53 -- target/connect_stress.sh@34 -- # kill -0 1493471 00:12:19.738 02:31:53 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:19.738 02:31:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:19.738 02:31:53 -- common/autotest_common.sh@10 -- # set +x 00:12:19.997 02:31:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:19.997 02:31:53 -- target/connect_stress.sh@34 -- # kill -0 1493471 00:12:19.997 02:31:53 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:20.255 02:31:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:20.255 02:31:53 -- common/autotest_common.sh@10 -- # set +x 00:12:20.514 02:31:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:20.514 02:31:53 -- target/connect_stress.sh@34 -- # kill -0 1493471 00:12:20.514 02:31:53 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:20.514 02:31:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:20.514 02:31:53 -- common/autotest_common.sh@10 -- # set +x 00:12:20.772 02:31:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:20.772 02:31:54 -- target/connect_stress.sh@34 -- # kill -0 1493471 00:12:20.772 02:31:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:20.772 02:31:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:20.772 02:31:54 -- common/autotest_common.sh@10 -- # set +x 00:12:21.031 02:31:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:21.031 02:31:54 -- target/connect_stress.sh@34 -- # kill -0 1493471 00:12:21.031 02:31:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:21.031 02:31:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:21.031 02:31:54 -- common/autotest_common.sh@10 -- # set +x 00:12:21.599 02:31:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:21.599 02:31:54 -- target/connect_stress.sh@34 -- # kill -0 1493471 00:12:21.599 02:31:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:21.599 02:31:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:21.599 02:31:54 -- common/autotest_common.sh@10 -- # set +x 00:12:21.858 02:31:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:21.858 02:31:55 -- target/connect_stress.sh@34 -- # kill -0 1493471 00:12:21.858 02:31:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:21.858 02:31:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:21.858 02:31:55 -- common/autotest_common.sh@10 -- # set +x 00:12:22.117 02:31:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:22.117 02:31:55 -- target/connect_stress.sh@34 -- # kill -0 1493471 00:12:22.117 02:31:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:22.117 02:31:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:22.117 02:31:55 -- common/autotest_common.sh@10 -- # set +x 00:12:22.376 02:31:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:22.376 02:31:55 -- target/connect_stress.sh@34 -- # kill -0 1493471 00:12:22.376 02:31:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:22.376 02:31:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:22.376 02:31:55 -- common/autotest_common.sh@10 -- # set +x 00:12:22.635 02:31:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:22.635 02:31:56 -- target/connect_stress.sh@34 -- # kill -0 1493471 00:12:22.635 Testing NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:12:22.635 02:31:56 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:22.635 02:31:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:22.635 02:31:56 -- common/autotest_common.sh@10 -- # set +x 00:12:23.204 02:31:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:23.204 02:31:56 -- target/connect_stress.sh@34 -- # kill -0 1493471 00:12:23.204 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (1493471) - No such process 00:12:23.204 02:31:56 -- target/connect_stress.sh@38 -- # wait 1493471 00:12:23.204 02:31:56 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:12:23.204 02:31:56 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:12:23.204 02:31:56 -- target/connect_stress.sh@43 -- # nvmftestfini 00:12:23.204 02:31:56 -- nvmf/common.sh@477 -- # nvmfcleanup 00:12:23.204 02:31:56 -- nvmf/common.sh@117 -- # sync 00:12:23.204 02:31:56 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:12:23.204 02:31:56 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:12:23.204 02:31:56 -- nvmf/common.sh@120 -- # set +e 00:12:23.204 02:31:56 -- nvmf/common.sh@121 -- # for i in {1..20} 00:12:23.204 02:31:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:12:23.204 rmmod nvme_rdma 00:12:23.204 rmmod nvme_fabrics 00:12:23.204 02:31:56 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:12:23.204 02:31:56 -- nvmf/common.sh@124 -- # set -e 00:12:23.204 02:31:56 -- nvmf/common.sh@125 -- # return 0 00:12:23.204 02:31:56 -- nvmf/common.sh@478 -- # '[' -n 1493344 ']' 00:12:23.204 02:31:56 -- nvmf/common.sh@479 -- # killprocess 1493344 00:12:23.204 02:31:56 -- common/autotest_common.sh@936 -- # '[' -z 1493344 ']' 00:12:23.204 02:31:56 -- common/autotest_common.sh@940 -- # kill -0 1493344 00:12:23.204 02:31:56 -- common/autotest_common.sh@941 -- # uname 00:12:23.204 02:31:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:23.204 02:31:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1493344 00:12:23.204 02:31:56 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:12:23.204 02:31:56 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:12:23.204 02:31:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1493344' 00:12:23.204 killing process with pid 1493344 00:12:23.204 02:31:56 -- common/autotest_common.sh@955 -- # kill 1493344 00:12:23.204 02:31:56 -- common/autotest_common.sh@960 -- # wait 1493344 00:12:23.204 [2024-04-27 02:31:56.737010] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:12:23.467 02:31:56 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:12:23.467 02:31:56 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:12:23.467 00:12:23.467 real 0m18.503s 00:12:23.467 user 0m42.581s 00:12:23.467 sys 0m7.567s 00:12:23.467 02:31:56 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:12:23.467 02:31:56 -- common/autotest_common.sh@10 -- # set +x 00:12:23.467 ************************************ 00:12:23.467 END TEST nvmf_connect_stress 00:12:23.467 ************************************ 00:12:23.467 02:31:57 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=rdma 00:12:23.467 02:31:57 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:23.467 02:31:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:23.467 02:31:57 -- common/autotest_common.sh@10 -- # set +x 00:12:23.727 ************************************ 00:12:23.727 START TEST nvmf_fused_ordering 00:12:23.727 ************************************ 00:12:23.727 02:31:57 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=rdma 00:12:23.727 * Looking for test storage... 00:12:23.727 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:12:23.727 02:31:57 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:12:23.727 02:31:57 -- nvmf/common.sh@7 -- # uname -s 00:12:23.727 02:31:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:23.727 02:31:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:23.727 02:31:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:23.727 02:31:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:23.727 02:31:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:23.727 02:31:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:23.727 02:31:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:23.727 02:31:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:23.727 02:31:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:23.727 02:31:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:23.727 02:31:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:12:23.727 02:31:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:12:23.727 02:31:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:23.727 02:31:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:23.727 02:31:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:23.727 02:31:57 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:12:23.727 02:31:57 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:12:23.727 02:31:57 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:23.727 02:31:57 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:23.727 02:31:57 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:23.727 02:31:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:23.727 02:31:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:23.727 02:31:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:23.727 02:31:57 -- paths/export.sh@5 -- # export PATH 00:12:23.727 02:31:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:23.727 02:31:57 -- nvmf/common.sh@47 -- # : 0 00:12:23.727 02:31:57 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:12:23.727 02:31:57 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:12:23.727 02:31:57 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:12:23.727 02:31:57 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:23.727 02:31:57 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:23.727 02:31:57 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:12:23.727 02:31:57 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:12:23.727 02:31:57 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:12:23.727 02:31:57 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:12:23.727 02:31:57 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:12:23.727 02:31:57 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:23.727 02:31:57 -- nvmf/common.sh@437 -- # prepare_net_devs 00:12:23.727 02:31:57 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:12:23.727 02:31:57 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:12:23.727 02:31:57 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:23.727 02:31:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:23.727 02:31:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:23.727 02:31:57 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:12:23.727 02:31:57 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:12:23.727 02:31:57 -- nvmf/common.sh@285 -- # xtrace_disable 00:12:23.727 02:31:57 -- common/autotest_common.sh@10 -- # set +x 00:12:30.298 02:32:02 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:30.298 02:32:02 -- nvmf/common.sh@291 -- # pci_devs=() 00:12:30.298 02:32:02 -- nvmf/common.sh@291 -- # local -a pci_devs 00:12:30.298 02:32:02 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:12:30.298 02:32:02 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:12:30.298 02:32:02 -- nvmf/common.sh@293 -- # pci_drivers=() 00:12:30.298 02:32:02 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:12:30.298 02:32:02 -- nvmf/common.sh@295 -- # net_devs=() 00:12:30.298 02:32:02 -- nvmf/common.sh@295 -- # local -ga net_devs 00:12:30.298 02:32:02 -- nvmf/common.sh@296 -- # e810=() 00:12:30.298 02:32:02 -- nvmf/common.sh@296 -- # local -ga e810 00:12:30.298 02:32:02 -- nvmf/common.sh@297 -- # x722=() 00:12:30.298 02:32:02 -- nvmf/common.sh@297 -- # local -ga x722 00:12:30.298 02:32:02 -- nvmf/common.sh@298 -- # mlx=() 00:12:30.298 02:32:02 -- nvmf/common.sh@298 -- # local -ga mlx 00:12:30.298 02:32:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:30.298 02:32:02 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:30.298 02:32:02 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:30.298 02:32:02 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:30.298 02:32:02 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:30.298 02:32:02 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:30.298 02:32:02 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:30.298 02:32:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:30.298 02:32:02 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:30.298 02:32:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:30.298 02:32:02 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:30.298 02:32:02 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:12:30.298 02:32:02 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:12:30.298 02:32:02 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:12:30.298 02:32:02 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:12:30.298 02:32:02 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:12:30.298 02:32:02 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:12:30.298 02:32:02 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:12:30.298 02:32:02 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:30.298 02:32:02 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:12:30.298 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:12:30.298 02:32:02 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:12:30.298 02:32:02 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:12:30.298 02:32:02 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:12:30.298 02:32:02 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:12:30.298 02:32:02 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:12:30.298 02:32:02 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:30.298 02:32:02 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:30.298 02:32:02 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:12:30.298 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:12:30.298 02:32:02 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:12:30.298 02:32:02 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:12:30.298 02:32:02 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:12:30.298 02:32:02 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:12:30.298 02:32:02 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:12:30.298 02:32:02 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:30.298 02:32:02 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:12:30.298 02:32:02 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:12:30.298 02:32:02 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:30.298 02:32:02 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:30.298 02:32:02 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:30.298 02:32:02 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:30.298 02:32:02 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:12:30.298 Found net devices under 0000:18:00.0: mlx_0_0 00:12:30.298 02:32:02 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:30.298 02:32:02 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:30.298 02:32:02 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:30.298 02:32:02 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:30.298 02:32:02 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:30.298 02:32:02 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:12:30.298 Found net devices under 0000:18:00.1: mlx_0_1 00:12:30.298 02:32:02 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:30.298 02:32:02 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:12:30.298 02:32:02 -- nvmf/common.sh@403 -- # is_hw=yes 00:12:30.298 02:32:02 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:12:30.298 02:32:02 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:12:30.299 02:32:02 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:12:30.299 02:32:02 -- nvmf/common.sh@409 -- # rdma_device_init 00:12:30.299 02:32:02 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:12:30.299 02:32:02 -- nvmf/common.sh@58 -- # uname 00:12:30.299 02:32:02 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:12:30.299 02:32:02 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:12:30.299 02:32:02 -- nvmf/common.sh@63 -- # modprobe ib_core 00:12:30.299 02:32:02 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:12:30.299 02:32:02 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:12:30.299 02:32:02 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:12:30.299 02:32:02 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:12:30.299 02:32:02 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:12:30.299 02:32:02 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:12:30.299 02:32:02 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:12:30.299 02:32:02 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:12:30.299 02:32:02 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:30.299 02:32:02 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:30.299 02:32:02 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:30.299 02:32:02 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:30.299 02:32:02 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:30.299 02:32:02 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:30.299 02:32:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:30.299 02:32:02 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:12:30.299 02:32:02 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:12:30.299 02:32:02 -- nvmf/common.sh@105 -- # continue 2 00:12:30.299 02:32:02 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:30.299 02:32:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:30.299 02:32:02 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:12:30.299 02:32:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:30.299 02:32:02 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:12:30.299 02:32:02 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:12:30.299 02:32:02 -- nvmf/common.sh@105 -- # continue 2 00:12:30.299 02:32:02 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:30.299 02:32:02 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:12:30.299 02:32:02 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:12:30.299 02:32:02 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:12:30.299 02:32:02 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:30.299 02:32:02 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:30.299 02:32:03 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:12:30.299 02:32:03 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:12:30.299 02:32:03 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:12:30.299 60: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:12:30.299 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:12:30.299 altname enp24s0f0np0 00:12:30.299 altname ens785f0np0 00:12:30.299 inet 192.168.100.8/24 scope global mlx_0_0 00:12:30.299 valid_lft forever preferred_lft forever 00:12:30.299 02:32:03 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:30.299 02:32:03 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:12:30.299 02:32:03 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:12:30.299 02:32:03 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:12:30.299 02:32:03 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:30.299 02:32:03 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:30.299 02:32:03 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:12:30.299 02:32:03 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:12:30.299 02:32:03 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:12:30.299 61: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:12:30.299 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:12:30.299 altname enp24s0f1np1 00:12:30.299 altname ens785f1np1 00:12:30.299 inet 192.168.100.9/24 scope global mlx_0_1 00:12:30.299 valid_lft forever preferred_lft forever 00:12:30.299 02:32:03 -- nvmf/common.sh@411 -- # return 0 00:12:30.299 02:32:03 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:12:30.299 02:32:03 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:12:30.299 02:32:03 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:12:30.299 02:32:03 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:12:30.299 02:32:03 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:12:30.299 02:32:03 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:30.299 02:32:03 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:30.299 02:32:03 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:30.299 02:32:03 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:30.299 02:32:03 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:30.299 02:32:03 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:30.299 02:32:03 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:30.299 02:32:03 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:12:30.299 02:32:03 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:12:30.299 02:32:03 -- nvmf/common.sh@105 -- # continue 2 00:12:30.299 02:32:03 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:30.299 02:32:03 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:30.299 02:32:03 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:12:30.299 02:32:03 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:30.299 02:32:03 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:12:30.299 02:32:03 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:12:30.299 02:32:03 -- nvmf/common.sh@105 -- # continue 2 00:12:30.299 02:32:03 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:30.299 02:32:03 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:12:30.299 02:32:03 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:12:30.299 02:32:03 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:12:30.299 02:32:03 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:30.299 02:32:03 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:30.299 02:32:03 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:30.299 02:32:03 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:12:30.299 02:32:03 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:12:30.299 02:32:03 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:12:30.299 02:32:03 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:30.299 02:32:03 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:30.299 02:32:03 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:12:30.299 192.168.100.9' 00:12:30.299 02:32:03 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:12:30.299 192.168.100.9' 00:12:30.299 02:32:03 -- nvmf/common.sh@446 -- # head -n 1 00:12:30.299 02:32:03 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:12:30.299 02:32:03 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:12:30.299 192.168.100.9' 00:12:30.299 02:32:03 -- nvmf/common.sh@447 -- # tail -n +2 00:12:30.299 02:32:03 -- nvmf/common.sh@447 -- # head -n 1 00:12:30.299 02:32:03 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:12:30.299 02:32:03 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:12:30.299 02:32:03 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:12:30.299 02:32:03 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:12:30.299 02:32:03 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:12:30.299 02:32:03 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:12:30.299 02:32:03 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:12:30.299 02:32:03 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:12:30.299 02:32:03 -- common/autotest_common.sh@710 -- # xtrace_disable 00:12:30.299 02:32:03 -- common/autotest_common.sh@10 -- # set +x 00:12:30.299 02:32:03 -- nvmf/common.sh@470 -- # nvmfpid=1497842 00:12:30.299 02:32:03 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:12:30.299 02:32:03 -- nvmf/common.sh@471 -- # waitforlisten 1497842 00:12:30.299 02:32:03 -- common/autotest_common.sh@817 -- # '[' -z 1497842 ']' 00:12:30.299 02:32:03 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:30.299 02:32:03 -- common/autotest_common.sh@822 -- # local max_retries=100 00:12:30.299 02:32:03 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:30.299 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:30.299 02:32:03 -- common/autotest_common.sh@826 -- # xtrace_disable 00:12:30.299 02:32:03 -- common/autotest_common.sh@10 -- # set +x 00:12:30.299 [2024-04-27 02:32:03.187975] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:12:30.299 [2024-04-27 02:32:03.188036] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:30.299 EAL: No free 2048 kB hugepages reported on node 1 00:12:30.299 [2024-04-27 02:32:03.259549] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:12:30.299 [2024-04-27 02:32:03.343193] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:30.299 [2024-04-27 02:32:03.343239] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:30.299 [2024-04-27 02:32:03.343248] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:12:30.299 [2024-04-27 02:32:03.343273] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:12:30.299 [2024-04-27 02:32:03.343280] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:30.299 [2024-04-27 02:32:03.343311] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:30.559 02:32:03 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:12:30.559 02:32:03 -- common/autotest_common.sh@850 -- # return 0 00:12:30.559 02:32:03 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:12:30.559 02:32:03 -- common/autotest_common.sh@716 -- # xtrace_disable 00:12:30.559 02:32:03 -- common/autotest_common.sh@10 -- # set +x 00:12:30.559 02:32:04 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:30.559 02:32:04 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:12:30.559 02:32:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:30.559 02:32:04 -- common/autotest_common.sh@10 -- # set +x 00:12:30.559 [2024-04-27 02:32:04.065417] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x16346e0/0x1638bd0) succeed. 00:12:30.559 [2024-04-27 02:32:04.074504] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1635be0/0x167a260) succeed. 00:12:30.559 02:32:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:30.559 02:32:04 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:12:30.559 02:32:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:30.559 02:32:04 -- common/autotest_common.sh@10 -- # set +x 00:12:30.559 02:32:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:30.559 02:32:04 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:12:30.559 02:32:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:30.559 02:32:04 -- common/autotest_common.sh@10 -- # set +x 00:12:30.559 [2024-04-27 02:32:04.137522] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:12:30.559 02:32:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:30.559 02:32:04 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:12:30.559 02:32:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:30.559 02:32:04 -- common/autotest_common.sh@10 -- # set +x 00:12:30.559 NULL1 00:12:30.559 02:32:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:30.559 02:32:04 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:12:30.559 02:32:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:30.559 02:32:04 -- common/autotest_common.sh@10 -- # set +x 00:12:30.559 02:32:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:30.559 02:32:04 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:12:30.559 02:32:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:30.559 02:32:04 -- common/autotest_common.sh@10 -- # set +x 00:12:30.559 02:32:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:30.559 02:32:04 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:12:30.818 [2024-04-27 02:32:04.182690] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:12:30.818 [2024-04-27 02:32:04.182729] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1497956 ] 00:12:30.818 EAL: No free 2048 kB hugepages reported on node 1 00:12:30.818 Attached to nqn.2016-06.io.spdk:cnode1 00:12:30.818 Namespace ID: 1 size: 1GB 00:12:30.818 fused_ordering(0) 00:12:30.818 fused_ordering(1) 00:12:30.818 fused_ordering(2) 00:12:30.818 fused_ordering(3) 00:12:30.818 fused_ordering(4) 00:12:30.818 fused_ordering(5) 00:12:30.818 fused_ordering(6) 00:12:30.818 fused_ordering(7) 00:12:30.818 fused_ordering(8) 00:12:30.818 fused_ordering(9) 00:12:30.818 fused_ordering(10) 00:12:30.818 fused_ordering(11) 00:12:30.818 fused_ordering(12) 00:12:30.818 fused_ordering(13) 00:12:30.818 fused_ordering(14) 00:12:30.818 fused_ordering(15) 00:12:30.818 fused_ordering(16) 00:12:30.818 fused_ordering(17) 00:12:30.818 fused_ordering(18) 00:12:30.818 fused_ordering(19) 00:12:30.818 fused_ordering(20) 00:12:30.818 fused_ordering(21) 00:12:30.818 fused_ordering(22) 00:12:30.818 fused_ordering(23) 00:12:30.818 fused_ordering(24) 00:12:30.818 fused_ordering(25) 00:12:30.818 fused_ordering(26) 00:12:30.818 fused_ordering(27) 00:12:30.818 fused_ordering(28) 00:12:30.818 fused_ordering(29) 00:12:30.818 fused_ordering(30) 00:12:30.818 fused_ordering(31) 00:12:30.818 fused_ordering(32) 00:12:30.818 fused_ordering(33) 00:12:30.818 fused_ordering(34) 00:12:30.818 fused_ordering(35) 00:12:30.818 fused_ordering(36) 00:12:30.818 fused_ordering(37) 00:12:30.818 fused_ordering(38) 00:12:30.818 fused_ordering(39) 00:12:30.818 fused_ordering(40) 00:12:30.818 fused_ordering(41) 00:12:30.818 fused_ordering(42) 00:12:30.818 fused_ordering(43) 00:12:30.818 fused_ordering(44) 00:12:30.818 fused_ordering(45) 00:12:30.818 fused_ordering(46) 00:12:30.818 fused_ordering(47) 00:12:30.818 fused_ordering(48) 00:12:30.818 fused_ordering(49) 00:12:30.818 fused_ordering(50) 00:12:30.818 fused_ordering(51) 00:12:30.818 fused_ordering(52) 00:12:30.818 fused_ordering(53) 00:12:30.818 fused_ordering(54) 00:12:30.818 fused_ordering(55) 00:12:30.818 fused_ordering(56) 00:12:30.818 fused_ordering(57) 00:12:30.818 fused_ordering(58) 00:12:30.818 fused_ordering(59) 00:12:30.818 fused_ordering(60) 00:12:30.818 fused_ordering(61) 00:12:30.818 fused_ordering(62) 00:12:30.818 fused_ordering(63) 00:12:30.818 fused_ordering(64) 00:12:30.818 fused_ordering(65) 00:12:30.818 fused_ordering(66) 00:12:30.818 fused_ordering(67) 00:12:30.818 fused_ordering(68) 00:12:30.818 fused_ordering(69) 00:12:30.818 fused_ordering(70) 00:12:30.818 fused_ordering(71) 00:12:30.818 fused_ordering(72) 00:12:30.818 fused_ordering(73) 00:12:30.818 fused_ordering(74) 00:12:30.818 fused_ordering(75) 00:12:30.818 fused_ordering(76) 00:12:30.818 fused_ordering(77) 00:12:30.818 fused_ordering(78) 00:12:30.818 fused_ordering(79) 00:12:30.818 fused_ordering(80) 00:12:30.818 fused_ordering(81) 00:12:30.818 fused_ordering(82) 00:12:30.818 fused_ordering(83) 00:12:30.818 fused_ordering(84) 00:12:30.818 fused_ordering(85) 00:12:30.818 fused_ordering(86) 00:12:30.818 fused_ordering(87) 00:12:30.818 fused_ordering(88) 00:12:30.818 fused_ordering(89) 00:12:30.818 fused_ordering(90) 00:12:30.818 fused_ordering(91) 00:12:30.818 fused_ordering(92) 00:12:30.818 fused_ordering(93) 00:12:30.818 fused_ordering(94) 00:12:30.818 fused_ordering(95) 00:12:30.818 fused_ordering(96) 00:12:30.818 fused_ordering(97) 00:12:30.818 fused_ordering(98) 00:12:30.818 fused_ordering(99) 00:12:30.818 fused_ordering(100) 00:12:30.818 fused_ordering(101) 00:12:30.818 fused_ordering(102) 00:12:30.818 fused_ordering(103) 00:12:30.818 fused_ordering(104) 00:12:30.818 fused_ordering(105) 00:12:30.818 fused_ordering(106) 00:12:30.818 fused_ordering(107) 00:12:30.818 fused_ordering(108) 00:12:30.818 fused_ordering(109) 00:12:30.818 fused_ordering(110) 00:12:30.818 fused_ordering(111) 00:12:30.818 fused_ordering(112) 00:12:30.818 fused_ordering(113) 00:12:30.818 fused_ordering(114) 00:12:30.818 fused_ordering(115) 00:12:30.818 fused_ordering(116) 00:12:30.818 fused_ordering(117) 00:12:30.818 fused_ordering(118) 00:12:30.818 fused_ordering(119) 00:12:30.818 fused_ordering(120) 00:12:30.818 fused_ordering(121) 00:12:30.818 fused_ordering(122) 00:12:30.818 fused_ordering(123) 00:12:30.818 fused_ordering(124) 00:12:30.818 fused_ordering(125) 00:12:30.818 fused_ordering(126) 00:12:30.818 fused_ordering(127) 00:12:30.818 fused_ordering(128) 00:12:30.818 fused_ordering(129) 00:12:30.818 fused_ordering(130) 00:12:30.818 fused_ordering(131) 00:12:30.818 fused_ordering(132) 00:12:30.818 fused_ordering(133) 00:12:30.818 fused_ordering(134) 00:12:30.818 fused_ordering(135) 00:12:30.818 fused_ordering(136) 00:12:30.818 fused_ordering(137) 00:12:30.818 fused_ordering(138) 00:12:30.818 fused_ordering(139) 00:12:30.818 fused_ordering(140) 00:12:30.818 fused_ordering(141) 00:12:30.818 fused_ordering(142) 00:12:30.818 fused_ordering(143) 00:12:30.818 fused_ordering(144) 00:12:30.818 fused_ordering(145) 00:12:30.818 fused_ordering(146) 00:12:30.818 fused_ordering(147) 00:12:30.818 fused_ordering(148) 00:12:30.818 fused_ordering(149) 00:12:30.818 fused_ordering(150) 00:12:30.818 fused_ordering(151) 00:12:30.818 fused_ordering(152) 00:12:30.818 fused_ordering(153) 00:12:30.818 fused_ordering(154) 00:12:30.818 fused_ordering(155) 00:12:30.818 fused_ordering(156) 00:12:30.818 fused_ordering(157) 00:12:30.818 fused_ordering(158) 00:12:30.818 fused_ordering(159) 00:12:30.818 fused_ordering(160) 00:12:30.818 fused_ordering(161) 00:12:30.818 fused_ordering(162) 00:12:30.818 fused_ordering(163) 00:12:30.818 fused_ordering(164) 00:12:30.818 fused_ordering(165) 00:12:30.818 fused_ordering(166) 00:12:30.818 fused_ordering(167) 00:12:30.818 fused_ordering(168) 00:12:30.818 fused_ordering(169) 00:12:30.818 fused_ordering(170) 00:12:30.818 fused_ordering(171) 00:12:30.818 fused_ordering(172) 00:12:30.818 fused_ordering(173) 00:12:30.818 fused_ordering(174) 00:12:30.818 fused_ordering(175) 00:12:30.818 fused_ordering(176) 00:12:30.818 fused_ordering(177) 00:12:30.818 fused_ordering(178) 00:12:30.818 fused_ordering(179) 00:12:30.818 fused_ordering(180) 00:12:30.818 fused_ordering(181) 00:12:30.818 fused_ordering(182) 00:12:30.818 fused_ordering(183) 00:12:30.818 fused_ordering(184) 00:12:30.818 fused_ordering(185) 00:12:30.818 fused_ordering(186) 00:12:30.818 fused_ordering(187) 00:12:30.818 fused_ordering(188) 00:12:30.818 fused_ordering(189) 00:12:30.818 fused_ordering(190) 00:12:30.818 fused_ordering(191) 00:12:30.819 fused_ordering(192) 00:12:30.819 fused_ordering(193) 00:12:30.819 fused_ordering(194) 00:12:30.819 fused_ordering(195) 00:12:30.819 fused_ordering(196) 00:12:30.819 fused_ordering(197) 00:12:30.819 fused_ordering(198) 00:12:30.819 fused_ordering(199) 00:12:30.819 fused_ordering(200) 00:12:30.819 fused_ordering(201) 00:12:30.819 fused_ordering(202) 00:12:30.819 fused_ordering(203) 00:12:30.819 fused_ordering(204) 00:12:30.819 fused_ordering(205) 00:12:31.079 fused_ordering(206) 00:12:31.079 fused_ordering(207) 00:12:31.079 fused_ordering(208) 00:12:31.079 fused_ordering(209) 00:12:31.079 fused_ordering(210) 00:12:31.079 fused_ordering(211) 00:12:31.079 fused_ordering(212) 00:12:31.079 fused_ordering(213) 00:12:31.079 fused_ordering(214) 00:12:31.079 fused_ordering(215) 00:12:31.079 fused_ordering(216) 00:12:31.079 fused_ordering(217) 00:12:31.079 fused_ordering(218) 00:12:31.079 fused_ordering(219) 00:12:31.079 fused_ordering(220) 00:12:31.079 fused_ordering(221) 00:12:31.079 fused_ordering(222) 00:12:31.079 fused_ordering(223) 00:12:31.079 fused_ordering(224) 00:12:31.079 fused_ordering(225) 00:12:31.079 fused_ordering(226) 00:12:31.079 fused_ordering(227) 00:12:31.079 fused_ordering(228) 00:12:31.079 fused_ordering(229) 00:12:31.079 fused_ordering(230) 00:12:31.079 fused_ordering(231) 00:12:31.079 fused_ordering(232) 00:12:31.079 fused_ordering(233) 00:12:31.079 fused_ordering(234) 00:12:31.079 fused_ordering(235) 00:12:31.079 fused_ordering(236) 00:12:31.079 fused_ordering(237) 00:12:31.079 fused_ordering(238) 00:12:31.079 fused_ordering(239) 00:12:31.079 fused_ordering(240) 00:12:31.079 fused_ordering(241) 00:12:31.079 fused_ordering(242) 00:12:31.079 fused_ordering(243) 00:12:31.079 fused_ordering(244) 00:12:31.079 fused_ordering(245) 00:12:31.079 fused_ordering(246) 00:12:31.079 fused_ordering(247) 00:12:31.079 fused_ordering(248) 00:12:31.079 fused_ordering(249) 00:12:31.079 fused_ordering(250) 00:12:31.079 fused_ordering(251) 00:12:31.079 fused_ordering(252) 00:12:31.079 fused_ordering(253) 00:12:31.079 fused_ordering(254) 00:12:31.079 fused_ordering(255) 00:12:31.079 fused_ordering(256) 00:12:31.079 fused_ordering(257) 00:12:31.079 fused_ordering(258) 00:12:31.079 fused_ordering(259) 00:12:31.079 fused_ordering(260) 00:12:31.079 fused_ordering(261) 00:12:31.079 fused_ordering(262) 00:12:31.079 fused_ordering(263) 00:12:31.079 fused_ordering(264) 00:12:31.079 fused_ordering(265) 00:12:31.079 fused_ordering(266) 00:12:31.079 fused_ordering(267) 00:12:31.079 fused_ordering(268) 00:12:31.079 fused_ordering(269) 00:12:31.079 fused_ordering(270) 00:12:31.079 fused_ordering(271) 00:12:31.079 fused_ordering(272) 00:12:31.079 fused_ordering(273) 00:12:31.079 fused_ordering(274) 00:12:31.079 fused_ordering(275) 00:12:31.079 fused_ordering(276) 00:12:31.079 fused_ordering(277) 00:12:31.079 fused_ordering(278) 00:12:31.079 fused_ordering(279) 00:12:31.079 fused_ordering(280) 00:12:31.079 fused_ordering(281) 00:12:31.079 fused_ordering(282) 00:12:31.079 fused_ordering(283) 00:12:31.079 fused_ordering(284) 00:12:31.079 fused_ordering(285) 00:12:31.079 fused_ordering(286) 00:12:31.079 fused_ordering(287) 00:12:31.079 fused_ordering(288) 00:12:31.079 fused_ordering(289) 00:12:31.079 fused_ordering(290) 00:12:31.079 fused_ordering(291) 00:12:31.079 fused_ordering(292) 00:12:31.079 fused_ordering(293) 00:12:31.079 fused_ordering(294) 00:12:31.079 fused_ordering(295) 00:12:31.079 fused_ordering(296) 00:12:31.079 fused_ordering(297) 00:12:31.079 fused_ordering(298) 00:12:31.079 fused_ordering(299) 00:12:31.079 fused_ordering(300) 00:12:31.079 fused_ordering(301) 00:12:31.079 fused_ordering(302) 00:12:31.079 fused_ordering(303) 00:12:31.079 fused_ordering(304) 00:12:31.079 fused_ordering(305) 00:12:31.079 fused_ordering(306) 00:12:31.079 fused_ordering(307) 00:12:31.079 fused_ordering(308) 00:12:31.079 fused_ordering(309) 00:12:31.079 fused_ordering(310) 00:12:31.079 fused_ordering(311) 00:12:31.079 fused_ordering(312) 00:12:31.079 fused_ordering(313) 00:12:31.079 fused_ordering(314) 00:12:31.079 fused_ordering(315) 00:12:31.079 fused_ordering(316) 00:12:31.079 fused_ordering(317) 00:12:31.079 fused_ordering(318) 00:12:31.079 fused_ordering(319) 00:12:31.079 fused_ordering(320) 00:12:31.079 fused_ordering(321) 00:12:31.079 fused_ordering(322) 00:12:31.079 fused_ordering(323) 00:12:31.079 fused_ordering(324) 00:12:31.079 fused_ordering(325) 00:12:31.079 fused_ordering(326) 00:12:31.079 fused_ordering(327) 00:12:31.079 fused_ordering(328) 00:12:31.079 fused_ordering(329) 00:12:31.079 fused_ordering(330) 00:12:31.079 fused_ordering(331) 00:12:31.079 fused_ordering(332) 00:12:31.079 fused_ordering(333) 00:12:31.079 fused_ordering(334) 00:12:31.079 fused_ordering(335) 00:12:31.079 fused_ordering(336) 00:12:31.079 fused_ordering(337) 00:12:31.079 fused_ordering(338) 00:12:31.079 fused_ordering(339) 00:12:31.079 fused_ordering(340) 00:12:31.079 fused_ordering(341) 00:12:31.079 fused_ordering(342) 00:12:31.079 fused_ordering(343) 00:12:31.079 fused_ordering(344) 00:12:31.079 fused_ordering(345) 00:12:31.079 fused_ordering(346) 00:12:31.079 fused_ordering(347) 00:12:31.079 fused_ordering(348) 00:12:31.079 fused_ordering(349) 00:12:31.079 fused_ordering(350) 00:12:31.079 fused_ordering(351) 00:12:31.079 fused_ordering(352) 00:12:31.079 fused_ordering(353) 00:12:31.079 fused_ordering(354) 00:12:31.079 fused_ordering(355) 00:12:31.079 fused_ordering(356) 00:12:31.079 fused_ordering(357) 00:12:31.079 fused_ordering(358) 00:12:31.079 fused_ordering(359) 00:12:31.079 fused_ordering(360) 00:12:31.079 fused_ordering(361) 00:12:31.079 fused_ordering(362) 00:12:31.079 fused_ordering(363) 00:12:31.079 fused_ordering(364) 00:12:31.079 fused_ordering(365) 00:12:31.079 fused_ordering(366) 00:12:31.079 fused_ordering(367) 00:12:31.079 fused_ordering(368) 00:12:31.079 fused_ordering(369) 00:12:31.079 fused_ordering(370) 00:12:31.079 fused_ordering(371) 00:12:31.079 fused_ordering(372) 00:12:31.079 fused_ordering(373) 00:12:31.079 fused_ordering(374) 00:12:31.079 fused_ordering(375) 00:12:31.079 fused_ordering(376) 00:12:31.079 fused_ordering(377) 00:12:31.079 fused_ordering(378) 00:12:31.079 fused_ordering(379) 00:12:31.079 fused_ordering(380) 00:12:31.079 fused_ordering(381) 00:12:31.079 fused_ordering(382) 00:12:31.079 fused_ordering(383) 00:12:31.079 fused_ordering(384) 00:12:31.079 fused_ordering(385) 00:12:31.079 fused_ordering(386) 00:12:31.079 fused_ordering(387) 00:12:31.079 fused_ordering(388) 00:12:31.079 fused_ordering(389) 00:12:31.079 fused_ordering(390) 00:12:31.079 fused_ordering(391) 00:12:31.079 fused_ordering(392) 00:12:31.079 fused_ordering(393) 00:12:31.079 fused_ordering(394) 00:12:31.079 fused_ordering(395) 00:12:31.079 fused_ordering(396) 00:12:31.079 fused_ordering(397) 00:12:31.079 fused_ordering(398) 00:12:31.079 fused_ordering(399) 00:12:31.079 fused_ordering(400) 00:12:31.079 fused_ordering(401) 00:12:31.079 fused_ordering(402) 00:12:31.079 fused_ordering(403) 00:12:31.079 fused_ordering(404) 00:12:31.079 fused_ordering(405) 00:12:31.079 fused_ordering(406) 00:12:31.079 fused_ordering(407) 00:12:31.079 fused_ordering(408) 00:12:31.079 fused_ordering(409) 00:12:31.079 fused_ordering(410) 00:12:31.079 fused_ordering(411) 00:12:31.079 fused_ordering(412) 00:12:31.079 fused_ordering(413) 00:12:31.079 fused_ordering(414) 00:12:31.079 fused_ordering(415) 00:12:31.079 fused_ordering(416) 00:12:31.079 fused_ordering(417) 00:12:31.079 fused_ordering(418) 00:12:31.079 fused_ordering(419) 00:12:31.080 fused_ordering(420) 00:12:31.080 fused_ordering(421) 00:12:31.080 fused_ordering(422) 00:12:31.080 fused_ordering(423) 00:12:31.080 fused_ordering(424) 00:12:31.080 fused_ordering(425) 00:12:31.080 fused_ordering(426) 00:12:31.080 fused_ordering(427) 00:12:31.080 fused_ordering(428) 00:12:31.080 fused_ordering(429) 00:12:31.080 fused_ordering(430) 00:12:31.080 fused_ordering(431) 00:12:31.080 fused_ordering(432) 00:12:31.080 fused_ordering(433) 00:12:31.080 fused_ordering(434) 00:12:31.080 fused_ordering(435) 00:12:31.080 fused_ordering(436) 00:12:31.080 fused_ordering(437) 00:12:31.080 fused_ordering(438) 00:12:31.080 fused_ordering(439) 00:12:31.080 fused_ordering(440) 00:12:31.080 fused_ordering(441) 00:12:31.080 fused_ordering(442) 00:12:31.080 fused_ordering(443) 00:12:31.080 fused_ordering(444) 00:12:31.080 fused_ordering(445) 00:12:31.080 fused_ordering(446) 00:12:31.080 fused_ordering(447) 00:12:31.080 fused_ordering(448) 00:12:31.080 fused_ordering(449) 00:12:31.080 fused_ordering(450) 00:12:31.080 fused_ordering(451) 00:12:31.080 fused_ordering(452) 00:12:31.080 fused_ordering(453) 00:12:31.080 fused_ordering(454) 00:12:31.080 fused_ordering(455) 00:12:31.080 fused_ordering(456) 00:12:31.080 fused_ordering(457) 00:12:31.080 fused_ordering(458) 00:12:31.080 fused_ordering(459) 00:12:31.080 fused_ordering(460) 00:12:31.080 fused_ordering(461) 00:12:31.080 fused_ordering(462) 00:12:31.080 fused_ordering(463) 00:12:31.080 fused_ordering(464) 00:12:31.080 fused_ordering(465) 00:12:31.080 fused_ordering(466) 00:12:31.080 fused_ordering(467) 00:12:31.080 fused_ordering(468) 00:12:31.080 fused_ordering(469) 00:12:31.080 fused_ordering(470) 00:12:31.080 fused_ordering(471) 00:12:31.080 fused_ordering(472) 00:12:31.080 fused_ordering(473) 00:12:31.080 fused_ordering(474) 00:12:31.080 fused_ordering(475) 00:12:31.080 fused_ordering(476) 00:12:31.080 fused_ordering(477) 00:12:31.080 fused_ordering(478) 00:12:31.080 fused_ordering(479) 00:12:31.080 fused_ordering(480) 00:12:31.080 fused_ordering(481) 00:12:31.080 fused_ordering(482) 00:12:31.080 fused_ordering(483) 00:12:31.080 fused_ordering(484) 00:12:31.080 fused_ordering(485) 00:12:31.080 fused_ordering(486) 00:12:31.080 fused_ordering(487) 00:12:31.080 fused_ordering(488) 00:12:31.080 fused_ordering(489) 00:12:31.080 fused_ordering(490) 00:12:31.080 fused_ordering(491) 00:12:31.080 fused_ordering(492) 00:12:31.080 fused_ordering(493) 00:12:31.080 fused_ordering(494) 00:12:31.080 fused_ordering(495) 00:12:31.080 fused_ordering(496) 00:12:31.080 fused_ordering(497) 00:12:31.080 fused_ordering(498) 00:12:31.080 fused_ordering(499) 00:12:31.080 fused_ordering(500) 00:12:31.080 fused_ordering(501) 00:12:31.080 fused_ordering(502) 00:12:31.080 fused_ordering(503) 00:12:31.080 fused_ordering(504) 00:12:31.080 fused_ordering(505) 00:12:31.080 fused_ordering(506) 00:12:31.080 fused_ordering(507) 00:12:31.080 fused_ordering(508) 00:12:31.080 fused_ordering(509) 00:12:31.080 fused_ordering(510) 00:12:31.080 fused_ordering(511) 00:12:31.080 fused_ordering(512) 00:12:31.080 fused_ordering(513) 00:12:31.080 fused_ordering(514) 00:12:31.080 fused_ordering(515) 00:12:31.080 fused_ordering(516) 00:12:31.080 fused_ordering(517) 00:12:31.080 fused_ordering(518) 00:12:31.080 fused_ordering(519) 00:12:31.080 fused_ordering(520) 00:12:31.080 fused_ordering(521) 00:12:31.080 fused_ordering(522) 00:12:31.080 fused_ordering(523) 00:12:31.080 fused_ordering(524) 00:12:31.080 fused_ordering(525) 00:12:31.080 fused_ordering(526) 00:12:31.080 fused_ordering(527) 00:12:31.080 fused_ordering(528) 00:12:31.080 fused_ordering(529) 00:12:31.080 fused_ordering(530) 00:12:31.080 fused_ordering(531) 00:12:31.080 fused_ordering(532) 00:12:31.080 fused_ordering(533) 00:12:31.080 fused_ordering(534) 00:12:31.080 fused_ordering(535) 00:12:31.080 fused_ordering(536) 00:12:31.080 fused_ordering(537) 00:12:31.080 fused_ordering(538) 00:12:31.080 fused_ordering(539) 00:12:31.080 fused_ordering(540) 00:12:31.080 fused_ordering(541) 00:12:31.080 fused_ordering(542) 00:12:31.080 fused_ordering(543) 00:12:31.080 fused_ordering(544) 00:12:31.080 fused_ordering(545) 00:12:31.080 fused_ordering(546) 00:12:31.080 fused_ordering(547) 00:12:31.080 fused_ordering(548) 00:12:31.080 fused_ordering(549) 00:12:31.080 fused_ordering(550) 00:12:31.080 fused_ordering(551) 00:12:31.080 fused_ordering(552) 00:12:31.080 fused_ordering(553) 00:12:31.080 fused_ordering(554) 00:12:31.080 fused_ordering(555) 00:12:31.080 fused_ordering(556) 00:12:31.080 fused_ordering(557) 00:12:31.080 fused_ordering(558) 00:12:31.080 fused_ordering(559) 00:12:31.080 fused_ordering(560) 00:12:31.080 fused_ordering(561) 00:12:31.080 fused_ordering(562) 00:12:31.080 fused_ordering(563) 00:12:31.080 fused_ordering(564) 00:12:31.080 fused_ordering(565) 00:12:31.080 fused_ordering(566) 00:12:31.080 fused_ordering(567) 00:12:31.080 fused_ordering(568) 00:12:31.080 fused_ordering(569) 00:12:31.080 fused_ordering(570) 00:12:31.080 fused_ordering(571) 00:12:31.080 fused_ordering(572) 00:12:31.080 fused_ordering(573) 00:12:31.080 fused_ordering(574) 00:12:31.080 fused_ordering(575) 00:12:31.080 fused_ordering(576) 00:12:31.080 fused_ordering(577) 00:12:31.080 fused_ordering(578) 00:12:31.080 fused_ordering(579) 00:12:31.080 fused_ordering(580) 00:12:31.080 fused_ordering(581) 00:12:31.080 fused_ordering(582) 00:12:31.080 fused_ordering(583) 00:12:31.080 fused_ordering(584) 00:12:31.080 fused_ordering(585) 00:12:31.080 fused_ordering(586) 00:12:31.080 fused_ordering(587) 00:12:31.080 fused_ordering(588) 00:12:31.080 fused_ordering(589) 00:12:31.080 fused_ordering(590) 00:12:31.080 fused_ordering(591) 00:12:31.080 fused_ordering(592) 00:12:31.080 fused_ordering(593) 00:12:31.080 fused_ordering(594) 00:12:31.080 fused_ordering(595) 00:12:31.080 fused_ordering(596) 00:12:31.080 fused_ordering(597) 00:12:31.080 fused_ordering(598) 00:12:31.080 fused_ordering(599) 00:12:31.080 fused_ordering(600) 00:12:31.080 fused_ordering(601) 00:12:31.080 fused_ordering(602) 00:12:31.080 fused_ordering(603) 00:12:31.080 fused_ordering(604) 00:12:31.080 fused_ordering(605) 00:12:31.080 fused_ordering(606) 00:12:31.080 fused_ordering(607) 00:12:31.080 fused_ordering(608) 00:12:31.080 fused_ordering(609) 00:12:31.080 fused_ordering(610) 00:12:31.080 fused_ordering(611) 00:12:31.080 fused_ordering(612) 00:12:31.080 fused_ordering(613) 00:12:31.080 fused_ordering(614) 00:12:31.080 fused_ordering(615) 00:12:31.080 fused_ordering(616) 00:12:31.080 fused_ordering(617) 00:12:31.080 fused_ordering(618) 00:12:31.080 fused_ordering(619) 00:12:31.080 fused_ordering(620) 00:12:31.080 fused_ordering(621) 00:12:31.080 fused_ordering(622) 00:12:31.080 fused_ordering(623) 00:12:31.080 fused_ordering(624) 00:12:31.080 fused_ordering(625) 00:12:31.080 fused_ordering(626) 00:12:31.080 fused_ordering(627) 00:12:31.080 fused_ordering(628) 00:12:31.080 fused_ordering(629) 00:12:31.080 fused_ordering(630) 00:12:31.080 fused_ordering(631) 00:12:31.080 fused_ordering(632) 00:12:31.080 fused_ordering(633) 00:12:31.080 fused_ordering(634) 00:12:31.080 fused_ordering(635) 00:12:31.080 fused_ordering(636) 00:12:31.080 fused_ordering(637) 00:12:31.080 fused_ordering(638) 00:12:31.080 fused_ordering(639) 00:12:31.080 fused_ordering(640) 00:12:31.080 fused_ordering(641) 00:12:31.080 fused_ordering(642) 00:12:31.080 fused_ordering(643) 00:12:31.080 fused_ordering(644) 00:12:31.080 fused_ordering(645) 00:12:31.080 fused_ordering(646) 00:12:31.080 fused_ordering(647) 00:12:31.080 fused_ordering(648) 00:12:31.080 fused_ordering(649) 00:12:31.080 fused_ordering(650) 00:12:31.080 fused_ordering(651) 00:12:31.080 fused_ordering(652) 00:12:31.080 fused_ordering(653) 00:12:31.080 fused_ordering(654) 00:12:31.080 fused_ordering(655) 00:12:31.080 fused_ordering(656) 00:12:31.080 fused_ordering(657) 00:12:31.080 fused_ordering(658) 00:12:31.080 fused_ordering(659) 00:12:31.080 fused_ordering(660) 00:12:31.080 fused_ordering(661) 00:12:31.080 fused_ordering(662) 00:12:31.080 fused_ordering(663) 00:12:31.080 fused_ordering(664) 00:12:31.080 fused_ordering(665) 00:12:31.080 fused_ordering(666) 00:12:31.080 fused_ordering(667) 00:12:31.080 fused_ordering(668) 00:12:31.080 fused_ordering(669) 00:12:31.080 fused_ordering(670) 00:12:31.080 fused_ordering(671) 00:12:31.080 fused_ordering(672) 00:12:31.080 fused_ordering(673) 00:12:31.080 fused_ordering(674) 00:12:31.080 fused_ordering(675) 00:12:31.080 fused_ordering(676) 00:12:31.080 fused_ordering(677) 00:12:31.080 fused_ordering(678) 00:12:31.080 fused_ordering(679) 00:12:31.080 fused_ordering(680) 00:12:31.080 fused_ordering(681) 00:12:31.080 fused_ordering(682) 00:12:31.080 fused_ordering(683) 00:12:31.080 fused_ordering(684) 00:12:31.080 fused_ordering(685) 00:12:31.080 fused_ordering(686) 00:12:31.080 fused_ordering(687) 00:12:31.080 fused_ordering(688) 00:12:31.080 fused_ordering(689) 00:12:31.080 fused_ordering(690) 00:12:31.080 fused_ordering(691) 00:12:31.080 fused_ordering(692) 00:12:31.081 fused_ordering(693) 00:12:31.081 fused_ordering(694) 00:12:31.081 fused_ordering(695) 00:12:31.081 fused_ordering(696) 00:12:31.081 fused_ordering(697) 00:12:31.081 fused_ordering(698) 00:12:31.081 fused_ordering(699) 00:12:31.081 fused_ordering(700) 00:12:31.081 fused_ordering(701) 00:12:31.081 fused_ordering(702) 00:12:31.081 fused_ordering(703) 00:12:31.081 fused_ordering(704) 00:12:31.081 fused_ordering(705) 00:12:31.081 fused_ordering(706) 00:12:31.081 fused_ordering(707) 00:12:31.081 fused_ordering(708) 00:12:31.081 fused_ordering(709) 00:12:31.081 fused_ordering(710) 00:12:31.081 fused_ordering(711) 00:12:31.081 fused_ordering(712) 00:12:31.081 fused_ordering(713) 00:12:31.081 fused_ordering(714) 00:12:31.081 fused_ordering(715) 00:12:31.081 fused_ordering(716) 00:12:31.081 fused_ordering(717) 00:12:31.081 fused_ordering(718) 00:12:31.081 fused_ordering(719) 00:12:31.081 fused_ordering(720) 00:12:31.081 fused_ordering(721) 00:12:31.081 fused_ordering(722) 00:12:31.081 fused_ordering(723) 00:12:31.081 fused_ordering(724) 00:12:31.081 fused_ordering(725) 00:12:31.081 fused_ordering(726) 00:12:31.081 fused_ordering(727) 00:12:31.081 fused_ordering(728) 00:12:31.081 fused_ordering(729) 00:12:31.081 fused_ordering(730) 00:12:31.081 fused_ordering(731) 00:12:31.081 fused_ordering(732) 00:12:31.081 fused_ordering(733) 00:12:31.081 fused_ordering(734) 00:12:31.081 fused_ordering(735) 00:12:31.081 fused_ordering(736) 00:12:31.081 fused_ordering(737) 00:12:31.081 fused_ordering(738) 00:12:31.081 fused_ordering(739) 00:12:31.081 fused_ordering(740) 00:12:31.081 fused_ordering(741) 00:12:31.081 fused_ordering(742) 00:12:31.081 fused_ordering(743) 00:12:31.081 fused_ordering(744) 00:12:31.081 fused_ordering(745) 00:12:31.081 fused_ordering(746) 00:12:31.081 fused_ordering(747) 00:12:31.081 fused_ordering(748) 00:12:31.081 fused_ordering(749) 00:12:31.081 fused_ordering(750) 00:12:31.081 fused_ordering(751) 00:12:31.081 fused_ordering(752) 00:12:31.081 fused_ordering(753) 00:12:31.081 fused_ordering(754) 00:12:31.081 fused_ordering(755) 00:12:31.081 fused_ordering(756) 00:12:31.081 fused_ordering(757) 00:12:31.081 fused_ordering(758) 00:12:31.081 fused_ordering(759) 00:12:31.081 fused_ordering(760) 00:12:31.081 fused_ordering(761) 00:12:31.081 fused_ordering(762) 00:12:31.081 fused_ordering(763) 00:12:31.081 fused_ordering(764) 00:12:31.081 fused_ordering(765) 00:12:31.081 fused_ordering(766) 00:12:31.081 fused_ordering(767) 00:12:31.081 fused_ordering(768) 00:12:31.081 fused_ordering(769) 00:12:31.081 fused_ordering(770) 00:12:31.081 fused_ordering(771) 00:12:31.081 fused_ordering(772) 00:12:31.081 fused_ordering(773) 00:12:31.081 fused_ordering(774) 00:12:31.081 fused_ordering(775) 00:12:31.081 fused_ordering(776) 00:12:31.081 fused_ordering(777) 00:12:31.081 fused_ordering(778) 00:12:31.081 fused_ordering(779) 00:12:31.081 fused_ordering(780) 00:12:31.081 fused_ordering(781) 00:12:31.081 fused_ordering(782) 00:12:31.081 fused_ordering(783) 00:12:31.081 fused_ordering(784) 00:12:31.081 fused_ordering(785) 00:12:31.081 fused_ordering(786) 00:12:31.081 fused_ordering(787) 00:12:31.081 fused_ordering(788) 00:12:31.081 fused_ordering(789) 00:12:31.081 fused_ordering(790) 00:12:31.081 fused_ordering(791) 00:12:31.081 fused_ordering(792) 00:12:31.081 fused_ordering(793) 00:12:31.081 fused_ordering(794) 00:12:31.081 fused_ordering(795) 00:12:31.081 fused_ordering(796) 00:12:31.081 fused_ordering(797) 00:12:31.081 fused_ordering(798) 00:12:31.081 fused_ordering(799) 00:12:31.081 fused_ordering(800) 00:12:31.081 fused_ordering(801) 00:12:31.081 fused_ordering(802) 00:12:31.081 fused_ordering(803) 00:12:31.081 fused_ordering(804) 00:12:31.081 fused_ordering(805) 00:12:31.081 fused_ordering(806) 00:12:31.081 fused_ordering(807) 00:12:31.081 fused_ordering(808) 00:12:31.081 fused_ordering(809) 00:12:31.081 fused_ordering(810) 00:12:31.081 fused_ordering(811) 00:12:31.081 fused_ordering(812) 00:12:31.081 fused_ordering(813) 00:12:31.081 fused_ordering(814) 00:12:31.081 fused_ordering(815) 00:12:31.081 fused_ordering(816) 00:12:31.081 fused_ordering(817) 00:12:31.081 fused_ordering(818) 00:12:31.081 fused_ordering(819) 00:12:31.081 fused_ordering(820) 00:12:31.340 fused_ordering(821) 00:12:31.340 fused_ordering(822) 00:12:31.340 fused_ordering(823) 00:12:31.340 fused_ordering(824) 00:12:31.340 fused_ordering(825) 00:12:31.340 fused_ordering(826) 00:12:31.340 fused_ordering(827) 00:12:31.340 fused_ordering(828) 00:12:31.340 fused_ordering(829) 00:12:31.340 fused_ordering(830) 00:12:31.340 fused_ordering(831) 00:12:31.340 fused_ordering(832) 00:12:31.340 fused_ordering(833) 00:12:31.340 fused_ordering(834) 00:12:31.340 fused_ordering(835) 00:12:31.340 fused_ordering(836) 00:12:31.340 fused_ordering(837) 00:12:31.340 fused_ordering(838) 00:12:31.340 fused_ordering(839) 00:12:31.340 fused_ordering(840) 00:12:31.340 fused_ordering(841) 00:12:31.340 fused_ordering(842) 00:12:31.340 fused_ordering(843) 00:12:31.340 fused_ordering(844) 00:12:31.340 fused_ordering(845) 00:12:31.340 fused_ordering(846) 00:12:31.340 fused_ordering(847) 00:12:31.340 fused_ordering(848) 00:12:31.340 fused_ordering(849) 00:12:31.340 fused_ordering(850) 00:12:31.340 fused_ordering(851) 00:12:31.341 fused_ordering(852) 00:12:31.341 fused_ordering(853) 00:12:31.341 fused_ordering(854) 00:12:31.341 fused_ordering(855) 00:12:31.341 fused_ordering(856) 00:12:31.341 fused_ordering(857) 00:12:31.341 fused_ordering(858) 00:12:31.341 fused_ordering(859) 00:12:31.341 fused_ordering(860) 00:12:31.341 fused_ordering(861) 00:12:31.341 fused_ordering(862) 00:12:31.341 fused_ordering(863) 00:12:31.341 fused_ordering(864) 00:12:31.341 fused_ordering(865) 00:12:31.341 fused_ordering(866) 00:12:31.341 fused_ordering(867) 00:12:31.341 fused_ordering(868) 00:12:31.341 fused_ordering(869) 00:12:31.341 fused_ordering(870) 00:12:31.341 fused_ordering(871) 00:12:31.341 fused_ordering(872) 00:12:31.341 fused_ordering(873) 00:12:31.341 fused_ordering(874) 00:12:31.341 fused_ordering(875) 00:12:31.341 fused_ordering(876) 00:12:31.341 fused_ordering(877) 00:12:31.341 fused_ordering(878) 00:12:31.341 fused_ordering(879) 00:12:31.341 fused_ordering(880) 00:12:31.341 fused_ordering(881) 00:12:31.341 fused_ordering(882) 00:12:31.341 fused_ordering(883) 00:12:31.341 fused_ordering(884) 00:12:31.341 fused_ordering(885) 00:12:31.341 fused_ordering(886) 00:12:31.341 fused_ordering(887) 00:12:31.341 fused_ordering(888) 00:12:31.341 fused_ordering(889) 00:12:31.341 fused_ordering(890) 00:12:31.341 fused_ordering(891) 00:12:31.341 fused_ordering(892) 00:12:31.341 fused_ordering(893) 00:12:31.341 fused_ordering(894) 00:12:31.341 fused_ordering(895) 00:12:31.341 fused_ordering(896) 00:12:31.341 fused_ordering(897) 00:12:31.341 fused_ordering(898) 00:12:31.341 fused_ordering(899) 00:12:31.341 fused_ordering(900) 00:12:31.341 fused_ordering(901) 00:12:31.341 fused_ordering(902) 00:12:31.341 fused_ordering(903) 00:12:31.341 fused_ordering(904) 00:12:31.341 fused_ordering(905) 00:12:31.341 fused_ordering(906) 00:12:31.341 fused_ordering(907) 00:12:31.341 fused_ordering(908) 00:12:31.341 fused_ordering(909) 00:12:31.341 fused_ordering(910) 00:12:31.341 fused_ordering(911) 00:12:31.341 fused_ordering(912) 00:12:31.341 fused_ordering(913) 00:12:31.341 fused_ordering(914) 00:12:31.341 fused_ordering(915) 00:12:31.341 fused_ordering(916) 00:12:31.341 fused_ordering(917) 00:12:31.341 fused_ordering(918) 00:12:31.341 fused_ordering(919) 00:12:31.341 fused_ordering(920) 00:12:31.341 fused_ordering(921) 00:12:31.341 fused_ordering(922) 00:12:31.341 fused_ordering(923) 00:12:31.341 fused_ordering(924) 00:12:31.341 fused_ordering(925) 00:12:31.341 fused_ordering(926) 00:12:31.341 fused_ordering(927) 00:12:31.341 fused_ordering(928) 00:12:31.341 fused_ordering(929) 00:12:31.341 fused_ordering(930) 00:12:31.341 fused_ordering(931) 00:12:31.341 fused_ordering(932) 00:12:31.341 fused_ordering(933) 00:12:31.341 fused_ordering(934) 00:12:31.341 fused_ordering(935) 00:12:31.341 fused_ordering(936) 00:12:31.341 fused_ordering(937) 00:12:31.341 fused_ordering(938) 00:12:31.341 fused_ordering(939) 00:12:31.341 fused_ordering(940) 00:12:31.341 fused_ordering(941) 00:12:31.341 fused_ordering(942) 00:12:31.341 fused_ordering(943) 00:12:31.341 fused_ordering(944) 00:12:31.341 fused_ordering(945) 00:12:31.341 fused_ordering(946) 00:12:31.341 fused_ordering(947) 00:12:31.341 fused_ordering(948) 00:12:31.341 fused_ordering(949) 00:12:31.341 fused_ordering(950) 00:12:31.341 fused_ordering(951) 00:12:31.341 fused_ordering(952) 00:12:31.341 fused_ordering(953) 00:12:31.341 fused_ordering(954) 00:12:31.341 fused_ordering(955) 00:12:31.341 fused_ordering(956) 00:12:31.341 fused_ordering(957) 00:12:31.341 fused_ordering(958) 00:12:31.341 fused_ordering(959) 00:12:31.341 fused_ordering(960) 00:12:31.341 fused_ordering(961) 00:12:31.341 fused_ordering(962) 00:12:31.341 fused_ordering(963) 00:12:31.341 fused_ordering(964) 00:12:31.341 fused_ordering(965) 00:12:31.341 fused_ordering(966) 00:12:31.341 fused_ordering(967) 00:12:31.341 fused_ordering(968) 00:12:31.341 fused_ordering(969) 00:12:31.341 fused_ordering(970) 00:12:31.341 fused_ordering(971) 00:12:31.341 fused_ordering(972) 00:12:31.341 fused_ordering(973) 00:12:31.341 fused_ordering(974) 00:12:31.341 fused_ordering(975) 00:12:31.341 fused_ordering(976) 00:12:31.341 fused_ordering(977) 00:12:31.341 fused_ordering(978) 00:12:31.341 fused_ordering(979) 00:12:31.341 fused_ordering(980) 00:12:31.341 fused_ordering(981) 00:12:31.341 fused_ordering(982) 00:12:31.341 fused_ordering(983) 00:12:31.341 fused_ordering(984) 00:12:31.341 fused_ordering(985) 00:12:31.341 fused_ordering(986) 00:12:31.341 fused_ordering(987) 00:12:31.341 fused_ordering(988) 00:12:31.341 fused_ordering(989) 00:12:31.341 fused_ordering(990) 00:12:31.341 fused_ordering(991) 00:12:31.341 fused_ordering(992) 00:12:31.341 fused_ordering(993) 00:12:31.341 fused_ordering(994) 00:12:31.341 fused_ordering(995) 00:12:31.341 fused_ordering(996) 00:12:31.341 fused_ordering(997) 00:12:31.341 fused_ordering(998) 00:12:31.341 fused_ordering(999) 00:12:31.341 fused_ordering(1000) 00:12:31.341 fused_ordering(1001) 00:12:31.341 fused_ordering(1002) 00:12:31.341 fused_ordering(1003) 00:12:31.341 fused_ordering(1004) 00:12:31.341 fused_ordering(1005) 00:12:31.341 fused_ordering(1006) 00:12:31.341 fused_ordering(1007) 00:12:31.341 fused_ordering(1008) 00:12:31.341 fused_ordering(1009) 00:12:31.341 fused_ordering(1010) 00:12:31.341 fused_ordering(1011) 00:12:31.341 fused_ordering(1012) 00:12:31.341 fused_ordering(1013) 00:12:31.341 fused_ordering(1014) 00:12:31.341 fused_ordering(1015) 00:12:31.341 fused_ordering(1016) 00:12:31.341 fused_ordering(1017) 00:12:31.341 fused_ordering(1018) 00:12:31.341 fused_ordering(1019) 00:12:31.341 fused_ordering(1020) 00:12:31.341 fused_ordering(1021) 00:12:31.341 fused_ordering(1022) 00:12:31.341 fused_ordering(1023) 00:12:31.341 02:32:04 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:12:31.341 02:32:04 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:12:31.341 02:32:04 -- nvmf/common.sh@477 -- # nvmfcleanup 00:12:31.341 02:32:04 -- nvmf/common.sh@117 -- # sync 00:12:31.341 02:32:04 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:12:31.341 02:32:04 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:12:31.341 02:32:04 -- nvmf/common.sh@120 -- # set +e 00:12:31.342 02:32:04 -- nvmf/common.sh@121 -- # for i in {1..20} 00:12:31.342 02:32:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:12:31.342 rmmod nvme_rdma 00:12:31.342 rmmod nvme_fabrics 00:12:31.342 02:32:04 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:12:31.342 02:32:04 -- nvmf/common.sh@124 -- # set -e 00:12:31.342 02:32:04 -- nvmf/common.sh@125 -- # return 0 00:12:31.342 02:32:04 -- nvmf/common.sh@478 -- # '[' -n 1497842 ']' 00:12:31.342 02:32:04 -- nvmf/common.sh@479 -- # killprocess 1497842 00:12:31.342 02:32:04 -- common/autotest_common.sh@936 -- # '[' -z 1497842 ']' 00:12:31.342 02:32:04 -- common/autotest_common.sh@940 -- # kill -0 1497842 00:12:31.342 02:32:04 -- common/autotest_common.sh@941 -- # uname 00:12:31.342 02:32:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:31.342 02:32:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1497842 00:12:31.342 02:32:04 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:12:31.342 02:32:04 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:12:31.342 02:32:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1497842' 00:12:31.342 killing process with pid 1497842 00:12:31.342 02:32:04 -- common/autotest_common.sh@955 -- # kill 1497842 00:12:31.342 02:32:04 -- common/autotest_common.sh@960 -- # wait 1497842 00:12:31.601 [2024-04-27 02:32:04.987677] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:12:31.601 02:32:05 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:12:31.601 02:32:05 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:12:31.601 00:12:31.601 real 0m8.069s 00:12:31.601 user 0m4.417s 00:12:31.601 sys 0m4.933s 00:12:31.601 02:32:05 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:12:31.601 02:32:05 -- common/autotest_common.sh@10 -- # set +x 00:12:31.601 ************************************ 00:12:31.601 END TEST nvmf_fused_ordering 00:12:31.601 ************************************ 00:12:31.861 02:32:05 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=rdma 00:12:31.861 02:32:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:31.861 02:32:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:31.861 02:32:05 -- common/autotest_common.sh@10 -- # set +x 00:12:31.861 ************************************ 00:12:31.861 START TEST nvmf_delete_subsystem 00:12:31.861 ************************************ 00:12:31.861 02:32:05 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=rdma 00:12:32.121 * Looking for test storage... 00:12:32.121 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:12:32.121 02:32:05 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:12:32.121 02:32:05 -- nvmf/common.sh@7 -- # uname -s 00:12:32.121 02:32:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:32.121 02:32:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:32.121 02:32:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:32.121 02:32:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:32.122 02:32:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:32.122 02:32:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:32.122 02:32:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:32.122 02:32:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:32.122 02:32:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:32.122 02:32:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:32.122 02:32:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:12:32.122 02:32:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:12:32.122 02:32:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:32.122 02:32:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:32.122 02:32:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:32.122 02:32:05 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:12:32.122 02:32:05 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:12:32.122 02:32:05 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:32.122 02:32:05 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:32.122 02:32:05 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:32.122 02:32:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:32.122 02:32:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:32.122 02:32:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:32.122 02:32:05 -- paths/export.sh@5 -- # export PATH 00:12:32.122 02:32:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:32.122 02:32:05 -- nvmf/common.sh@47 -- # : 0 00:12:32.122 02:32:05 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:12:32.122 02:32:05 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:12:32.122 02:32:05 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:12:32.122 02:32:05 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:32.122 02:32:05 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:32.122 02:32:05 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:12:32.122 02:32:05 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:12:32.122 02:32:05 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:12:32.122 02:32:05 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:12:32.122 02:32:05 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:12:32.122 02:32:05 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:32.122 02:32:05 -- nvmf/common.sh@437 -- # prepare_net_devs 00:12:32.122 02:32:05 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:12:32.122 02:32:05 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:12:32.122 02:32:05 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:32.122 02:32:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:32.122 02:32:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:32.122 02:32:05 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:12:32.122 02:32:05 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:12:32.122 02:32:05 -- nvmf/common.sh@285 -- # xtrace_disable 00:12:32.122 02:32:05 -- common/autotest_common.sh@10 -- # set +x 00:12:38.688 02:32:11 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:38.688 02:32:11 -- nvmf/common.sh@291 -- # pci_devs=() 00:12:38.688 02:32:11 -- nvmf/common.sh@291 -- # local -a pci_devs 00:12:38.688 02:32:11 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:12:38.688 02:32:11 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:12:38.688 02:32:11 -- nvmf/common.sh@293 -- # pci_drivers=() 00:12:38.688 02:32:11 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:12:38.688 02:32:11 -- nvmf/common.sh@295 -- # net_devs=() 00:12:38.688 02:32:11 -- nvmf/common.sh@295 -- # local -ga net_devs 00:12:38.688 02:32:11 -- nvmf/common.sh@296 -- # e810=() 00:12:38.688 02:32:11 -- nvmf/common.sh@296 -- # local -ga e810 00:12:38.688 02:32:11 -- nvmf/common.sh@297 -- # x722=() 00:12:38.688 02:32:11 -- nvmf/common.sh@297 -- # local -ga x722 00:12:38.688 02:32:11 -- nvmf/common.sh@298 -- # mlx=() 00:12:38.688 02:32:11 -- nvmf/common.sh@298 -- # local -ga mlx 00:12:38.688 02:32:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:38.688 02:32:11 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:38.688 02:32:11 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:38.688 02:32:11 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:38.688 02:32:11 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:38.688 02:32:11 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:38.688 02:32:11 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:38.688 02:32:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:38.688 02:32:11 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:38.688 02:32:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:38.688 02:32:11 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:38.688 02:32:11 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:12:38.688 02:32:11 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:12:38.688 02:32:11 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:12:38.688 02:32:11 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:12:38.688 02:32:11 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:12:38.688 02:32:11 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:12:38.688 02:32:11 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:12:38.688 02:32:11 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:38.688 02:32:11 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:12:38.688 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:12:38.688 02:32:11 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:12:38.688 02:32:11 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:12:38.688 02:32:11 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:12:38.688 02:32:11 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:12:38.688 02:32:11 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:12:38.688 02:32:11 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:38.688 02:32:11 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:38.688 02:32:11 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:12:38.688 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:12:38.688 02:32:11 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:12:38.688 02:32:11 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:12:38.688 02:32:11 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:12:38.688 02:32:11 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:12:38.688 02:32:11 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:12:38.688 02:32:11 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:38.688 02:32:11 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:12:38.688 02:32:11 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:12:38.688 02:32:11 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:38.688 02:32:11 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:38.688 02:32:11 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:38.688 02:32:11 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:38.688 02:32:11 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:12:38.688 Found net devices under 0000:18:00.0: mlx_0_0 00:12:38.688 02:32:11 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:38.688 02:32:11 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:38.688 02:32:11 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:38.688 02:32:11 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:38.688 02:32:11 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:38.688 02:32:11 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:12:38.688 Found net devices under 0000:18:00.1: mlx_0_1 00:12:38.688 02:32:11 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:38.688 02:32:11 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:12:38.688 02:32:11 -- nvmf/common.sh@403 -- # is_hw=yes 00:12:38.688 02:32:11 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:12:38.688 02:32:11 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:12:38.688 02:32:11 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:12:38.688 02:32:11 -- nvmf/common.sh@409 -- # rdma_device_init 00:12:38.688 02:32:11 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:12:38.688 02:32:11 -- nvmf/common.sh@58 -- # uname 00:12:38.688 02:32:11 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:12:38.688 02:32:11 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:12:38.688 02:32:11 -- nvmf/common.sh@63 -- # modprobe ib_core 00:12:38.688 02:32:11 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:12:38.688 02:32:11 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:12:38.688 02:32:11 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:12:38.688 02:32:11 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:12:38.688 02:32:11 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:12:38.688 02:32:11 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:12:38.688 02:32:11 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:12:38.688 02:32:11 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:12:38.688 02:32:11 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:38.688 02:32:11 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:38.688 02:32:11 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:38.688 02:32:11 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:38.688 02:32:11 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:38.688 02:32:11 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:38.688 02:32:11 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:38.688 02:32:11 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:12:38.688 02:32:11 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:12:38.688 02:32:11 -- nvmf/common.sh@105 -- # continue 2 00:12:38.688 02:32:11 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:38.688 02:32:11 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:38.688 02:32:11 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:12:38.688 02:32:11 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:38.688 02:32:11 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:12:38.688 02:32:11 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:12:38.688 02:32:11 -- nvmf/common.sh@105 -- # continue 2 00:12:38.688 02:32:11 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:38.688 02:32:11 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:12:38.688 02:32:11 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:12:38.688 02:32:11 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:12:38.688 02:32:11 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:38.688 02:32:11 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:38.688 02:32:11 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:12:38.688 02:32:11 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:12:38.688 02:32:11 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:12:38.688 60: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:12:38.688 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:12:38.688 altname enp24s0f0np0 00:12:38.688 altname ens785f0np0 00:12:38.688 inet 192.168.100.8/24 scope global mlx_0_0 00:12:38.688 valid_lft forever preferred_lft forever 00:12:38.688 02:32:11 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:38.688 02:32:11 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:12:38.688 02:32:11 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:12:38.688 02:32:11 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:12:38.688 02:32:11 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:38.688 02:32:11 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:38.688 02:32:11 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:12:38.688 02:32:11 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:12:38.688 02:32:11 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:12:38.688 61: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:12:38.688 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:12:38.688 altname enp24s0f1np1 00:12:38.688 altname ens785f1np1 00:12:38.688 inet 192.168.100.9/24 scope global mlx_0_1 00:12:38.688 valid_lft forever preferred_lft forever 00:12:38.688 02:32:11 -- nvmf/common.sh@411 -- # return 0 00:12:38.688 02:32:11 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:12:38.688 02:32:11 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:12:38.688 02:32:11 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:12:38.688 02:32:11 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:12:38.689 02:32:11 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:12:38.689 02:32:11 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:38.689 02:32:11 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:38.689 02:32:11 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:38.689 02:32:11 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:38.689 02:32:11 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:38.689 02:32:11 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:38.689 02:32:11 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:38.689 02:32:11 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:12:38.689 02:32:11 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:12:38.689 02:32:11 -- nvmf/common.sh@105 -- # continue 2 00:12:38.689 02:32:11 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:38.689 02:32:11 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:38.689 02:32:11 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:12:38.689 02:32:11 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:38.689 02:32:11 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:12:38.689 02:32:11 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:12:38.689 02:32:11 -- nvmf/common.sh@105 -- # continue 2 00:12:38.689 02:32:11 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:38.689 02:32:11 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:12:38.689 02:32:11 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:12:38.689 02:32:11 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:12:38.689 02:32:11 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:38.689 02:32:11 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:38.689 02:32:11 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:38.689 02:32:11 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:12:38.689 02:32:11 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:12:38.689 02:32:11 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:12:38.689 02:32:11 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:38.689 02:32:11 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:38.689 02:32:11 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:12:38.689 192.168.100.9' 00:12:38.689 02:32:11 -- nvmf/common.sh@446 -- # head -n 1 00:12:38.689 02:32:11 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:12:38.689 192.168.100.9' 00:12:38.689 02:32:11 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:12:38.689 02:32:11 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:12:38.689 192.168.100.9' 00:12:38.689 02:32:11 -- nvmf/common.sh@447 -- # tail -n +2 00:12:38.689 02:32:11 -- nvmf/common.sh@447 -- # head -n 1 00:12:38.689 02:32:11 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:12:38.689 02:32:11 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:12:38.689 02:32:11 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:12:38.689 02:32:11 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:12:38.689 02:32:11 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:12:38.689 02:32:11 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:12:38.689 02:32:11 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:12:38.689 02:32:11 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:12:38.689 02:32:11 -- common/autotest_common.sh@710 -- # xtrace_disable 00:12:38.689 02:32:11 -- common/autotest_common.sh@10 -- # set +x 00:12:38.689 02:32:11 -- nvmf/common.sh@470 -- # nvmfpid=1500951 00:12:38.689 02:32:11 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:12:38.689 02:32:11 -- nvmf/common.sh@471 -- # waitforlisten 1500951 00:12:38.689 02:32:11 -- common/autotest_common.sh@817 -- # '[' -z 1500951 ']' 00:12:38.689 02:32:11 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:38.689 02:32:11 -- common/autotest_common.sh@822 -- # local max_retries=100 00:12:38.689 02:32:11 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:38.689 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:38.689 02:32:11 -- common/autotest_common.sh@826 -- # xtrace_disable 00:12:38.689 02:32:11 -- common/autotest_common.sh@10 -- # set +x 00:12:38.689 [2024-04-27 02:32:11.708328] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:12:38.689 [2024-04-27 02:32:11.708394] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:38.689 EAL: No free 2048 kB hugepages reported on node 1 00:12:38.689 [2024-04-27 02:32:11.782119] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:12:38.689 [2024-04-27 02:32:11.867700] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:38.689 [2024-04-27 02:32:11.867749] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:38.689 [2024-04-27 02:32:11.867774] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:12:38.689 [2024-04-27 02:32:11.867783] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:12:38.689 [2024-04-27 02:32:11.867790] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:38.689 [2024-04-27 02:32:11.867848] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:38.689 [2024-04-27 02:32:11.867850] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:38.948 02:32:12 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:12:38.948 02:32:12 -- common/autotest_common.sh@850 -- # return 0 00:12:38.948 02:32:12 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:12:38.948 02:32:12 -- common/autotest_common.sh@716 -- # xtrace_disable 00:12:38.948 02:32:12 -- common/autotest_common.sh@10 -- # set +x 00:12:38.948 02:32:12 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:38.948 02:32:12 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:12:38.948 02:32:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:38.948 02:32:12 -- common/autotest_common.sh@10 -- # set +x 00:12:39.207 [2024-04-27 02:32:12.586196] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x530f40/0x535430) succeed. 00:12:39.207 [2024-04-27 02:32:12.595743] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x532440/0x576ac0) succeed. 00:12:39.207 02:32:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:39.207 02:32:12 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:12:39.207 02:32:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:39.207 02:32:12 -- common/autotest_common.sh@10 -- # set +x 00:12:39.207 02:32:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:39.207 02:32:12 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:12:39.207 02:32:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:39.207 02:32:12 -- common/autotest_common.sh@10 -- # set +x 00:12:39.207 [2024-04-27 02:32:12.686111] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:12:39.207 02:32:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:39.207 02:32:12 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:12:39.207 02:32:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:39.207 02:32:12 -- common/autotest_common.sh@10 -- # set +x 00:12:39.207 NULL1 00:12:39.207 02:32:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:39.207 02:32:12 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:39.207 02:32:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:39.207 02:32:12 -- common/autotest_common.sh@10 -- # set +x 00:12:39.207 Delay0 00:12:39.207 02:32:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:39.207 02:32:12 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:39.207 02:32:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:39.207 02:32:12 -- common/autotest_common.sh@10 -- # set +x 00:12:39.207 02:32:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:39.207 02:32:12 -- target/delete_subsystem.sh@28 -- # perf_pid=1501151 00:12:39.207 02:32:12 -- target/delete_subsystem.sh@30 -- # sleep 2 00:12:39.207 02:32:12 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:12:39.207 EAL: No free 2048 kB hugepages reported on node 1 00:12:39.207 [2024-04-27 02:32:12.792931] subsystem.c:1435:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on RDMA/192.168.100.8/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:12:41.194 02:32:14 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:41.194 02:32:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:41.194 02:32:14 -- common/autotest_common.sh@10 -- # set +x 00:12:42.574 NVMe io qpair process completion error 00:12:42.574 NVMe io qpair process completion error 00:12:42.574 NVMe io qpair process completion error 00:12:42.574 NVMe io qpair process completion error 00:12:42.574 NVMe io qpair process completion error 00:12:42.574 NVMe io qpair process completion error 00:12:42.574 02:32:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:42.574 02:32:15 -- target/delete_subsystem.sh@34 -- # delay=0 00:12:42.574 02:32:15 -- target/delete_subsystem.sh@35 -- # kill -0 1501151 00:12:42.574 02:32:15 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:12:42.833 02:32:16 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:12:42.833 02:32:16 -- target/delete_subsystem.sh@35 -- # kill -0 1501151 00:12:42.833 02:32:16 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:12:43.402 Read completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Write completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Write completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Read completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Read completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Read completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Write completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Write completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Read completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Read completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Read completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Write completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Read completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Read completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Write completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Write completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Read completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Write completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Read completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Write completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Write completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Read completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Write completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Read completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Read completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Read completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Read completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Read completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Write completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Read completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Read completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Write completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Read completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Write completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Read completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Read completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Read completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Read completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Read completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Read completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Write completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Read completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Write completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Write completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Read completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Read completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Read completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Read completed with error (sct=0, sc=8) 00:12:43.402 starting I/O failed: -6 00:12:43.402 Read completed with error (sct=0, sc=8) 00:12:43.402 Read completed with error (sct=0, sc=8) 00:12:43.402 Read completed with error (sct=0, sc=8) 00:12:43.402 Write completed with error (sct=0, sc=8) 00:12:43.402 Read completed with error (sct=0, sc=8) 00:12:43.402 Write completed with error (sct=0, sc=8) 00:12:43.402 Write completed with error (sct=0, sc=8) 00:12:43.402 Write completed with error (sct=0, sc=8) 00:12:43.402 Read completed with error (sct=0, sc=8) 00:12:43.402 Read completed with error (sct=0, sc=8) 00:12:43.402 Write completed with error (sct=0, sc=8) 00:12:43.402 Read completed with error (sct=0, sc=8) 00:12:43.402 Read completed with error (sct=0, sc=8) 00:12:43.402 Read completed with error (sct=0, sc=8) 00:12:43.403 Write completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Write completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Write completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Write completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Write completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Write completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Write completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Write completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Write completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Write completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Write completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Write completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Write completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Write completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Write completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Write completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Write completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Write completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Write completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Write completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Write completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Write completed with error (sct=0, sc=8) 00:12:43.403 starting I/O failed: -6 00:12:43.403 Write completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Write completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Write completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Write completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Write completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Write completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Write completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Write completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Write completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Read completed with error (sct=0, sc=8) 00:12:43.403 Write completed with error (sct=0, sc=8) 00:12:43.404 Write completed with error (sct=0, sc=8) 00:12:43.404 Write completed with error (sct=0, sc=8) 00:12:43.404 Write completed with error (sct=0, sc=8) 00:12:43.404 Read completed with error (sct=0, sc=8) 00:12:43.404 Read completed with error (sct=0, sc=8) 00:12:43.404 Read completed with error (sct=0, sc=8) 00:12:43.404 Read completed with error (sct=0, sc=8) 00:12:43.404 Read completed with error (sct=0, sc=8) 00:12:43.404 Read completed with error (sct=0, sc=8) 00:12:43.404 Read completed with error (sct=0, sc=8) 00:12:43.404 Write completed with error (sct=0, sc=8) 00:12:43.404 Write completed with error (sct=0, sc=8) 00:12:43.404 Write completed with error (sct=0, sc=8) 00:12:43.404 Write completed with error (sct=0, sc=8) 00:12:43.404 Read completed with error (sct=0, sc=8) 00:12:43.404 Read completed with error (sct=0, sc=8) 00:12:43.404 Read completed with error (sct=0, sc=8) 00:12:43.404 Write completed with error (sct=0, sc=8) 00:12:43.404 Write completed with error (sct=0, sc=8) 00:12:43.404 Write completed with error (sct=0, sc=8) 00:12:43.404 Read completed with error (sct=0, sc=8) 00:12:43.404 Read completed with error (sct=0, sc=8) 00:12:43.404 Read completed with error (sct=0, sc=8) 00:12:43.404 Write completed with error (sct=0, sc=8) 00:12:43.404 Write completed with error (sct=0, sc=8) 00:12:43.404 Read completed with error (sct=0, sc=8) 00:12:43.404 Write completed with error (sct=0, sc=8) 00:12:43.404 Write completed with error (sct=0, sc=8) 00:12:43.404 Write completed with error (sct=0, sc=8) 00:12:43.404 Read completed with error (sct=0, sc=8) 00:12:43.404 Write completed with error (sct=0, sc=8) 00:12:43.404 Read completed with error (sct=0, sc=8) 00:12:43.404 Write completed with error (sct=0, sc=8) 00:12:43.404 Read completed with error (sct=0, sc=8) 00:12:43.404 Write completed with error (sct=0, sc=8) 00:12:43.404 Read completed with error (sct=0, sc=8) 00:12:43.404 Read completed with error (sct=0, sc=8) 00:12:43.404 Read completed with error (sct=0, sc=8) 00:12:43.404 Write completed with error (sct=0, sc=8) 00:12:43.404 Write completed with error (sct=0, sc=8) 00:12:43.404 Read completed with error (sct=0, sc=8) 00:12:43.404 Write completed with error (sct=0, sc=8) 00:12:43.404 Read completed with error (sct=0, sc=8) 00:12:43.404 Read completed with error (sct=0, sc=8) 00:12:43.404 Write completed with error (sct=0, sc=8) 00:12:43.404 Read completed with error (sct=0, sc=8) 00:12:43.404 Write completed with error (sct=0, sc=8) 00:12:43.404 Read completed with error (sct=0, sc=8) 00:12:43.404 Read completed with error (sct=0, sc=8) 00:12:43.404 Read completed with error (sct=0, sc=8) 00:12:43.404 Read completed with error (sct=0, sc=8) 00:12:43.404 Read completed with error (sct=0, sc=8) 00:12:43.404 Read completed with error (sct=0, sc=8) 00:12:43.404 Read completed with error (sct=0, sc=8) 00:12:43.404 Write completed with error (sct=0, sc=8) 00:12:43.404 Read completed with error (sct=0, sc=8) 00:12:43.404 Read completed with error (sct=0, sc=8) 00:12:43.404 Read completed with error (sct=0, sc=8) 00:12:43.404 Write completed with error (sct=0, sc=8) 00:12:43.404 Read completed with error (sct=0, sc=8) 00:12:43.404 Read completed with error (sct=0, sc=8) 00:12:43.404 Read completed with error (sct=0, sc=8) 00:12:43.404 Write completed with error (sct=0, sc=8) 00:12:43.404 Read completed with error (sct=0, sc=8) 00:12:43.404 Read completed with error (sct=0, sc=8) 00:12:43.404 Read completed with error (sct=0, sc=8) 00:12:43.404 Read completed with error (sct=0, sc=8) 00:12:43.404 Read completed with error (sct=0, sc=8) 00:12:43.404 Read completed with error (sct=0, sc=8) 00:12:43.404 Write completed with error (sct=0, sc=8) 00:12:43.404 Write completed with error (sct=0, sc=8) 00:12:43.404 [2024-04-27 02:32:16.877240] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:12:43.404 [2024-04-27 02:32:16.891647] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:12:43.404 [2024-04-27 02:32:16.891667] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:12:43.404 /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:12:43.404 02:32:16 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:12:43.404 02:32:16 -- target/delete_subsystem.sh@35 -- # kill -0 1501151 00:12:43.404 02:32:16 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:12:43.404 Initializing NVMe Controllers 00:12:43.404 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:12:43.404 Controller IO queue size 128, less than required. 00:12:43.404 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:12:43.404 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:12:43.404 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:12:43.404 Initialization complete. Launching workers. 00:12:43.404 ======================================================== 00:12:43.404 Latency(us) 00:12:43.404 Device Information : IOPS MiB/s Average min max 00:12:43.404 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 80.47 0.04 1593947.36 1000079.62 2977166.38 00:12:43.404 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 80.47 0.04 1595387.61 1000319.04 2978257.09 00:12:43.404 ======================================================== 00:12:43.404 Total : 160.95 0.08 1594667.49 1000079.62 2978257.09 00:12:43.404 00:12:43.973 02:32:17 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:12:43.973 02:32:17 -- target/delete_subsystem.sh@35 -- # kill -0 1501151 00:12:43.973 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (1501151) - No such process 00:12:43.973 02:32:17 -- target/delete_subsystem.sh@45 -- # NOT wait 1501151 00:12:43.973 02:32:17 -- common/autotest_common.sh@638 -- # local es=0 00:12:43.973 02:32:17 -- common/autotest_common.sh@640 -- # valid_exec_arg wait 1501151 00:12:43.973 02:32:17 -- common/autotest_common.sh@626 -- # local arg=wait 00:12:43.973 02:32:17 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:12:43.973 02:32:17 -- common/autotest_common.sh@630 -- # type -t wait 00:12:43.973 02:32:17 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:12:43.973 02:32:17 -- common/autotest_common.sh@641 -- # wait 1501151 00:12:43.973 02:32:17 -- common/autotest_common.sh@641 -- # es=1 00:12:43.973 02:32:17 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:12:43.973 02:32:17 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:12:43.973 02:32:17 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:12:43.973 02:32:17 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:12:43.973 02:32:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:43.973 02:32:17 -- common/autotest_common.sh@10 -- # set +x 00:12:43.973 02:32:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:43.973 02:32:17 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:12:43.973 02:32:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:43.973 02:32:17 -- common/autotest_common.sh@10 -- # set +x 00:12:43.973 [2024-04-27 02:32:17.421473] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:12:43.973 02:32:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:43.973 02:32:17 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:43.973 02:32:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:43.973 02:32:17 -- common/autotest_common.sh@10 -- # set +x 00:12:43.973 02:32:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:43.973 02:32:17 -- target/delete_subsystem.sh@54 -- # perf_pid=1501711 00:12:43.973 02:32:17 -- target/delete_subsystem.sh@56 -- # delay=0 00:12:43.973 02:32:17 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:12:43.973 02:32:17 -- target/delete_subsystem.sh@57 -- # kill -0 1501711 00:12:43.973 02:32:17 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:12:43.973 EAL: No free 2048 kB hugepages reported on node 1 00:12:43.973 [2024-04-27 02:32:17.516814] subsystem.c:1435:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on RDMA/192.168.100.8/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:12:44.542 02:32:17 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:12:44.542 02:32:17 -- target/delete_subsystem.sh@57 -- # kill -0 1501711 00:12:44.542 02:32:17 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:12:45.111 02:32:18 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:12:45.111 02:32:18 -- target/delete_subsystem.sh@57 -- # kill -0 1501711 00:12:45.111 02:32:18 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:12:45.370 02:32:18 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:12:45.370 02:32:18 -- target/delete_subsystem.sh@57 -- # kill -0 1501711 00:12:45.370 02:32:18 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:12:45.938 02:32:19 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:12:45.938 02:32:19 -- target/delete_subsystem.sh@57 -- # kill -0 1501711 00:12:45.938 02:32:19 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:12:46.506 02:32:19 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:12:46.506 02:32:19 -- target/delete_subsystem.sh@57 -- # kill -0 1501711 00:12:46.506 02:32:19 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:12:47.073 02:32:20 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:12:47.073 02:32:20 -- target/delete_subsystem.sh@57 -- # kill -0 1501711 00:12:47.073 02:32:20 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:12:47.641 02:32:20 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:12:47.641 02:32:20 -- target/delete_subsystem.sh@57 -- # kill -0 1501711 00:12:47.641 02:32:20 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:12:47.900 02:32:21 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:12:47.900 02:32:21 -- target/delete_subsystem.sh@57 -- # kill -0 1501711 00:12:47.900 02:32:21 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:12:48.468 02:32:21 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:12:48.468 02:32:21 -- target/delete_subsystem.sh@57 -- # kill -0 1501711 00:12:48.468 02:32:21 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:12:49.036 02:32:22 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:12:49.036 02:32:22 -- target/delete_subsystem.sh@57 -- # kill -0 1501711 00:12:49.036 02:32:22 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:12:49.604 02:32:22 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:12:49.604 02:32:22 -- target/delete_subsystem.sh@57 -- # kill -0 1501711 00:12:49.604 02:32:22 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:12:50.171 02:32:23 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:12:50.171 02:32:23 -- target/delete_subsystem.sh@57 -- # kill -0 1501711 00:12:50.171 02:32:23 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:12:50.429 02:32:24 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:12:50.429 02:32:24 -- target/delete_subsystem.sh@57 -- # kill -0 1501711 00:12:50.430 02:32:24 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:12:50.998 02:32:24 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:12:50.998 02:32:24 -- target/delete_subsystem.sh@57 -- # kill -0 1501711 00:12:50.999 02:32:24 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:12:51.258 Initializing NVMe Controllers 00:12:51.258 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:12:51.258 Controller IO queue size 128, less than required. 00:12:51.258 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:12:51.258 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:12:51.258 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:12:51.258 Initialization complete. Launching workers. 00:12:51.258 ======================================================== 00:12:51.258 Latency(us) 00:12:51.258 Device Information : IOPS MiB/s Average min max 00:12:51.258 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1001622.03 1000062.05 1004426.49 00:12:51.258 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1002890.57 1000123.35 1007756.35 00:12:51.258 ======================================================== 00:12:51.258 Total : 256.00 0.12 1002256.30 1000062.05 1007756.35 00:12:51.258 00:12:51.517 02:32:25 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:12:51.517 02:32:25 -- target/delete_subsystem.sh@57 -- # kill -0 1501711 00:12:51.517 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (1501711) - No such process 00:12:51.517 02:32:25 -- target/delete_subsystem.sh@67 -- # wait 1501711 00:12:51.517 02:32:25 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:12:51.517 02:32:25 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:12:51.517 02:32:25 -- nvmf/common.sh@477 -- # nvmfcleanup 00:12:51.517 02:32:25 -- nvmf/common.sh@117 -- # sync 00:12:51.517 02:32:25 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:12:51.517 02:32:25 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:12:51.517 02:32:25 -- nvmf/common.sh@120 -- # set +e 00:12:51.517 02:32:25 -- nvmf/common.sh@121 -- # for i in {1..20} 00:12:51.518 02:32:25 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:12:51.518 rmmod nvme_rdma 00:12:51.518 rmmod nvme_fabrics 00:12:51.518 02:32:25 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:12:51.518 02:32:25 -- nvmf/common.sh@124 -- # set -e 00:12:51.518 02:32:25 -- nvmf/common.sh@125 -- # return 0 00:12:51.518 02:32:25 -- nvmf/common.sh@478 -- # '[' -n 1500951 ']' 00:12:51.518 02:32:25 -- nvmf/common.sh@479 -- # killprocess 1500951 00:12:51.518 02:32:25 -- common/autotest_common.sh@936 -- # '[' -z 1500951 ']' 00:12:51.518 02:32:25 -- common/autotest_common.sh@940 -- # kill -0 1500951 00:12:51.518 02:32:25 -- common/autotest_common.sh@941 -- # uname 00:12:51.518 02:32:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:51.518 02:32:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1500951 00:12:51.518 02:32:25 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:51.518 02:32:25 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:51.518 02:32:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1500951' 00:12:51.518 killing process with pid 1500951 00:12:51.518 02:32:25 -- common/autotest_common.sh@955 -- # kill 1500951 00:12:51.518 02:32:25 -- common/autotest_common.sh@960 -- # wait 1500951 00:12:51.777 [2024-04-27 02:32:25.184495] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:12:51.777 02:32:25 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:12:51.777 02:32:25 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:12:51.777 00:12:51.777 real 0m19.959s 00:12:51.777 user 0m49.963s 00:12:51.777 sys 0m5.922s 00:12:51.777 02:32:25 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:12:51.778 02:32:25 -- common/autotest_common.sh@10 -- # set +x 00:12:51.778 ************************************ 00:12:51.778 END TEST nvmf_delete_subsystem 00:12:51.778 ************************************ 00:12:52.037 02:32:25 -- nvmf/nvmf.sh@36 -- # run_test nvmf_ns_masking test/nvmf/target/ns_masking.sh --transport=rdma 00:12:52.037 02:32:25 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:52.037 02:32:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:52.037 02:32:25 -- common/autotest_common.sh@10 -- # set +x 00:12:52.037 ************************************ 00:12:52.037 START TEST nvmf_ns_masking 00:12:52.037 ************************************ 00:12:52.037 02:32:25 -- common/autotest_common.sh@1111 -- # test/nvmf/target/ns_masking.sh --transport=rdma 00:12:52.297 * Looking for test storage... 00:12:52.297 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:12:52.297 02:32:25 -- target/ns_masking.sh@8 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:12:52.297 02:32:25 -- nvmf/common.sh@7 -- # uname -s 00:12:52.297 02:32:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:52.297 02:32:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:52.297 02:32:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:52.297 02:32:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:52.297 02:32:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:52.297 02:32:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:52.297 02:32:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:52.297 02:32:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:52.297 02:32:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:52.297 02:32:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:52.297 02:32:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:12:52.297 02:32:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:12:52.297 02:32:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:52.297 02:32:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:52.297 02:32:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:52.297 02:32:25 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:12:52.297 02:32:25 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:12:52.297 02:32:25 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:52.297 02:32:25 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:52.297 02:32:25 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:52.297 02:32:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:52.297 02:32:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:52.297 02:32:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:52.297 02:32:25 -- paths/export.sh@5 -- # export PATH 00:12:52.297 02:32:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:52.297 02:32:25 -- nvmf/common.sh@47 -- # : 0 00:12:52.297 02:32:25 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:12:52.297 02:32:25 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:12:52.297 02:32:25 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:12:52.297 02:32:25 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:52.297 02:32:25 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:52.297 02:32:25 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:12:52.297 02:32:25 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:12:52.297 02:32:25 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:12:52.297 02:32:25 -- target/ns_masking.sh@10 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:12:52.297 02:32:25 -- target/ns_masking.sh@11 -- # loops=5 00:12:52.297 02:32:25 -- target/ns_masking.sh@13 -- # SUBSYSNQN=nqn.2016-06.io.spdk:cnode1 00:12:52.297 02:32:25 -- target/ns_masking.sh@14 -- # HOSTNQN=nqn.2016-06.io.spdk:host1 00:12:52.297 02:32:25 -- target/ns_masking.sh@15 -- # uuidgen 00:12:52.297 02:32:25 -- target/ns_masking.sh@15 -- # HOSTID=075299f8-0c84-450b-8c0d-392ad30dbf7b 00:12:52.297 02:32:25 -- target/ns_masking.sh@44 -- # nvmftestinit 00:12:52.297 02:32:25 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:12:52.297 02:32:25 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:52.297 02:32:25 -- nvmf/common.sh@437 -- # prepare_net_devs 00:12:52.297 02:32:25 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:12:52.297 02:32:25 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:12:52.297 02:32:25 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:52.297 02:32:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:52.297 02:32:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:52.297 02:32:25 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:12:52.297 02:32:25 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:12:52.297 02:32:25 -- nvmf/common.sh@285 -- # xtrace_disable 00:12:52.297 02:32:25 -- common/autotest_common.sh@10 -- # set +x 00:12:58.864 02:32:31 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:58.864 02:32:31 -- nvmf/common.sh@291 -- # pci_devs=() 00:12:58.864 02:32:31 -- nvmf/common.sh@291 -- # local -a pci_devs 00:12:58.864 02:32:31 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:12:58.864 02:32:31 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:12:58.864 02:32:31 -- nvmf/common.sh@293 -- # pci_drivers=() 00:12:58.864 02:32:31 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:12:58.864 02:32:31 -- nvmf/common.sh@295 -- # net_devs=() 00:12:58.864 02:32:31 -- nvmf/common.sh@295 -- # local -ga net_devs 00:12:58.864 02:32:31 -- nvmf/common.sh@296 -- # e810=() 00:12:58.864 02:32:31 -- nvmf/common.sh@296 -- # local -ga e810 00:12:58.864 02:32:31 -- nvmf/common.sh@297 -- # x722=() 00:12:58.864 02:32:31 -- nvmf/common.sh@297 -- # local -ga x722 00:12:58.864 02:32:31 -- nvmf/common.sh@298 -- # mlx=() 00:12:58.864 02:32:31 -- nvmf/common.sh@298 -- # local -ga mlx 00:12:58.864 02:32:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:58.864 02:32:31 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:58.864 02:32:31 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:58.864 02:32:31 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:58.864 02:32:31 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:58.864 02:32:31 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:58.864 02:32:31 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:58.864 02:32:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:58.864 02:32:31 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:58.864 02:32:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:58.864 02:32:31 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:58.864 02:32:31 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:12:58.864 02:32:31 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:12:58.864 02:32:31 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:12:58.864 02:32:31 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:12:58.864 02:32:31 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:12:58.864 02:32:31 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:12:58.864 02:32:31 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:12:58.864 02:32:31 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:58.864 02:32:31 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:12:58.864 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:12:58.864 02:32:31 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:12:58.864 02:32:31 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:12:58.864 02:32:31 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:12:58.864 02:32:31 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:12:58.864 02:32:31 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:12:58.864 02:32:31 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:58.864 02:32:31 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:58.864 02:32:31 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:12:58.864 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:12:58.864 02:32:31 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:12:58.864 02:32:31 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:12:58.864 02:32:31 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:12:58.864 02:32:31 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:12:58.864 02:32:31 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:12:58.864 02:32:31 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:58.864 02:32:31 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:12:58.864 02:32:31 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:12:58.864 02:32:31 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:58.864 02:32:31 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:58.864 02:32:31 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:58.864 02:32:31 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:58.864 02:32:31 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:12:58.864 Found net devices under 0000:18:00.0: mlx_0_0 00:12:58.864 02:32:31 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:58.864 02:32:31 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:58.864 02:32:31 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:58.864 02:32:31 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:58.864 02:32:31 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:58.864 02:32:31 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:12:58.864 Found net devices under 0000:18:00.1: mlx_0_1 00:12:58.864 02:32:31 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:58.864 02:32:31 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:12:58.864 02:32:31 -- nvmf/common.sh@403 -- # is_hw=yes 00:12:58.864 02:32:31 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:12:58.864 02:32:31 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:12:58.864 02:32:31 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:12:58.864 02:32:31 -- nvmf/common.sh@409 -- # rdma_device_init 00:12:58.865 02:32:31 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:12:58.865 02:32:31 -- nvmf/common.sh@58 -- # uname 00:12:58.865 02:32:31 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:12:58.865 02:32:31 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:12:58.865 02:32:31 -- nvmf/common.sh@63 -- # modprobe ib_core 00:12:58.865 02:32:31 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:12:58.865 02:32:31 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:12:58.865 02:32:31 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:12:58.865 02:32:31 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:12:58.865 02:32:31 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:12:58.865 02:32:31 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:12:58.865 02:32:31 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:12:58.865 02:32:31 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:12:58.865 02:32:31 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:58.865 02:32:31 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:58.865 02:32:31 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:58.865 02:32:31 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:58.865 02:32:31 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:58.865 02:32:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:58.865 02:32:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:58.865 02:32:31 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:12:58.865 02:32:31 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:12:58.865 02:32:31 -- nvmf/common.sh@105 -- # continue 2 00:12:58.865 02:32:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:58.865 02:32:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:58.865 02:32:31 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:12:58.865 02:32:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:58.865 02:32:31 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:12:58.865 02:32:31 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:12:58.865 02:32:31 -- nvmf/common.sh@105 -- # continue 2 00:12:58.865 02:32:31 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:58.865 02:32:31 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:12:58.865 02:32:31 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:12:58.865 02:32:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:12:58.865 02:32:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:58.865 02:32:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:58.865 02:32:31 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:12:58.865 02:32:31 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:12:58.865 02:32:31 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:12:58.865 60: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:12:58.865 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:12:58.865 altname enp24s0f0np0 00:12:58.865 altname ens785f0np0 00:12:58.865 inet 192.168.100.8/24 scope global mlx_0_0 00:12:58.865 valid_lft forever preferred_lft forever 00:12:58.865 02:32:31 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:58.865 02:32:31 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:12:58.865 02:32:31 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:12:58.865 02:32:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:12:58.865 02:32:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:58.865 02:32:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:58.865 02:32:31 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:12:58.865 02:32:31 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:12:58.865 02:32:31 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:12:58.865 61: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:12:58.865 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:12:58.865 altname enp24s0f1np1 00:12:58.865 altname ens785f1np1 00:12:58.865 inet 192.168.100.9/24 scope global mlx_0_1 00:12:58.865 valid_lft forever preferred_lft forever 00:12:58.865 02:32:31 -- nvmf/common.sh@411 -- # return 0 00:12:58.865 02:32:31 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:12:58.865 02:32:31 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:12:58.865 02:32:31 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:12:58.865 02:32:31 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:12:58.865 02:32:31 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:12:58.865 02:32:31 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:58.865 02:32:31 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:58.865 02:32:31 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:58.865 02:32:31 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:58.865 02:32:31 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:58.865 02:32:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:58.865 02:32:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:58.865 02:32:31 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:12:58.865 02:32:31 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:12:58.865 02:32:31 -- nvmf/common.sh@105 -- # continue 2 00:12:58.865 02:32:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:58.865 02:32:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:58.865 02:32:31 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:12:58.865 02:32:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:58.865 02:32:31 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:12:58.865 02:32:31 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:12:58.865 02:32:31 -- nvmf/common.sh@105 -- # continue 2 00:12:58.865 02:32:31 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:58.865 02:32:31 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:12:58.865 02:32:31 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:12:58.865 02:32:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:12:58.865 02:32:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:58.865 02:32:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:58.865 02:32:31 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:58.865 02:32:31 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:12:58.865 02:32:31 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:12:58.865 02:32:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:12:58.865 02:32:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:58.865 02:32:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:58.865 02:32:31 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:12:58.865 192.168.100.9' 00:12:58.865 02:32:31 -- nvmf/common.sh@446 -- # head -n 1 00:12:58.865 02:32:31 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:12:58.865 192.168.100.9' 00:12:58.865 02:32:31 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:12:58.865 02:32:31 -- nvmf/common.sh@447 -- # head -n 1 00:12:58.865 02:32:31 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:12:58.865 192.168.100.9' 00:12:58.865 02:32:31 -- nvmf/common.sh@447 -- # tail -n +2 00:12:58.865 02:32:31 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:12:58.865 02:32:31 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:12:58.865 02:32:31 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:12:58.865 02:32:31 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:12:58.865 02:32:31 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:12:58.865 02:32:31 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:12:58.865 02:32:31 -- target/ns_masking.sh@45 -- # nvmfappstart -m 0xF 00:12:58.865 02:32:31 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:12:58.865 02:32:31 -- common/autotest_common.sh@710 -- # xtrace_disable 00:12:58.865 02:32:31 -- common/autotest_common.sh@10 -- # set +x 00:12:58.865 02:32:31 -- nvmf/common.sh@470 -- # nvmfpid=1505587 00:12:58.865 02:32:31 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:58.865 02:32:31 -- nvmf/common.sh@471 -- # waitforlisten 1505587 00:12:58.865 02:32:31 -- common/autotest_common.sh@817 -- # '[' -z 1505587 ']' 00:12:58.865 02:32:31 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:58.865 02:32:31 -- common/autotest_common.sh@822 -- # local max_retries=100 00:12:58.865 02:32:31 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:58.865 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:58.865 02:32:31 -- common/autotest_common.sh@826 -- # xtrace_disable 00:12:58.865 02:32:31 -- common/autotest_common.sh@10 -- # set +x 00:12:58.865 [2024-04-27 02:32:31.730080] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:12:58.865 [2024-04-27 02:32:31.730135] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:58.865 EAL: No free 2048 kB hugepages reported on node 1 00:12:58.865 [2024-04-27 02:32:31.803466] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:58.865 [2024-04-27 02:32:31.894358] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:58.865 [2024-04-27 02:32:31.894400] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:58.865 [2024-04-27 02:32:31.894410] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:12:58.865 [2024-04-27 02:32:31.894418] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:12:58.865 [2024-04-27 02:32:31.894425] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:58.865 [2024-04-27 02:32:31.894514] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:58.865 [2024-04-27 02:32:31.894615] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:58.865 [2024-04-27 02:32:31.894697] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:58.865 [2024-04-27 02:32:31.894699] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:59.123 02:32:32 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:12:59.123 02:32:32 -- common/autotest_common.sh@850 -- # return 0 00:12:59.123 02:32:32 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:12:59.123 02:32:32 -- common/autotest_common.sh@716 -- # xtrace_disable 00:12:59.123 02:32:32 -- common/autotest_common.sh@10 -- # set +x 00:12:59.123 02:32:32 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:59.123 02:32:32 -- target/ns_masking.sh@47 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:12:59.381 [2024-04-27 02:32:32.761659] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xca44d0/0xca89c0) succeed. 00:12:59.381 [2024-04-27 02:32:32.772180] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xca5b10/0xcea050) succeed. 00:12:59.381 02:32:32 -- target/ns_masking.sh@49 -- # MALLOC_BDEV_SIZE=64 00:12:59.381 02:32:32 -- target/ns_masking.sh@50 -- # MALLOC_BLOCK_SIZE=512 00:12:59.381 02:32:32 -- target/ns_masking.sh@52 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:12:59.639 Malloc1 00:12:59.639 02:32:33 -- target/ns_masking.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:12:59.897 Malloc2 00:12:59.897 02:32:33 -- target/ns_masking.sh@56 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:13:00.155 02:32:33 -- target/ns_masking.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 1 00:13:00.155 02:32:33 -- target/ns_masking.sh@58 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:13:00.413 [2024-04-27 02:32:33.881094] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:13:00.413 02:32:33 -- target/ns_masking.sh@61 -- # connect 00:13:00.413 02:32:33 -- target/ns_masking.sh@18 -- # nvme connect -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -I 075299f8-0c84-450b-8c0d-392ad30dbf7b -a 192.168.100.8 -s 4420 -i 4 00:13:00.674 02:32:34 -- target/ns_masking.sh@20 -- # waitforserial SPDKISFASTANDAWESOME 00:13:00.674 02:32:34 -- common/autotest_common.sh@1184 -- # local i=0 00:13:00.674 02:32:34 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:13:00.674 02:32:34 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:13:00.674 02:32:34 -- common/autotest_common.sh@1191 -- # sleep 2 00:13:03.218 02:32:36 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:13:03.218 02:32:36 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:13:03.218 02:32:36 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:13:03.218 02:32:36 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:13:03.219 02:32:36 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:13:03.219 02:32:36 -- common/autotest_common.sh@1194 -- # return 0 00:13:03.219 02:32:36 -- target/ns_masking.sh@22 -- # nvme list-subsys -o json 00:13:03.219 02:32:36 -- target/ns_masking.sh@22 -- # jq -r '.[].Subsystems[] | select(.NQN=="nqn.2016-06.io.spdk:cnode1") | .Paths[0].Name' 00:13:03.219 02:32:36 -- target/ns_masking.sh@22 -- # ctrl_id=nvme0 00:13:03.219 02:32:36 -- target/ns_masking.sh@23 -- # [[ -z nvme0 ]] 00:13:03.219 02:32:36 -- target/ns_masking.sh@62 -- # ns_is_visible 0x1 00:13:03.219 02:32:36 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:13:03.219 02:32:36 -- target/ns_masking.sh@39 -- # grep 0x1 00:13:03.219 [ 0]:0x1 00:13:03.219 02:32:36 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:13:03.219 02:32:36 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:13:03.219 02:32:36 -- target/ns_masking.sh@40 -- # nguid=ac9377b0aef549d583cf83bafa3769f0 00:13:03.219 02:32:36 -- target/ns_masking.sh@41 -- # [[ ac9377b0aef549d583cf83bafa3769f0 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:13:03.219 02:32:36 -- target/ns_masking.sh@65 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc2 -n 2 00:13:03.219 02:32:36 -- target/ns_masking.sh@66 -- # ns_is_visible 0x1 00:13:03.219 02:32:36 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:13:03.219 02:32:36 -- target/ns_masking.sh@39 -- # grep 0x1 00:13:03.219 [ 0]:0x1 00:13:03.219 02:32:36 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:13:03.219 02:32:36 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:13:03.219 02:32:36 -- target/ns_masking.sh@40 -- # nguid=ac9377b0aef549d583cf83bafa3769f0 00:13:03.219 02:32:36 -- target/ns_masking.sh@41 -- # [[ ac9377b0aef549d583cf83bafa3769f0 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:13:03.219 02:32:36 -- target/ns_masking.sh@67 -- # ns_is_visible 0x2 00:13:03.219 02:32:36 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:13:03.219 02:32:36 -- target/ns_masking.sh@39 -- # grep 0x2 00:13:03.219 [ 1]:0x2 00:13:03.219 02:32:36 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:13:03.219 02:32:36 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:13:03.219 02:32:36 -- target/ns_masking.sh@40 -- # nguid=6401014c27bd477da5f9aa8aa02d743a 00:13:03.219 02:32:36 -- target/ns_masking.sh@41 -- # [[ 6401014c27bd477da5f9aa8aa02d743a != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:13:03.219 02:32:36 -- target/ns_masking.sh@69 -- # disconnect 00:13:03.219 02:32:36 -- target/ns_masking.sh@34 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:03.477 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:03.477 02:32:36 -- target/ns_masking.sh@73 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:03.736 02:32:37 -- target/ns_masking.sh@74 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 1 --no-auto-visible 00:13:03.994 02:32:37 -- target/ns_masking.sh@77 -- # connect 1 00:13:03.994 02:32:37 -- target/ns_masking.sh@18 -- # nvme connect -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -I 075299f8-0c84-450b-8c0d-392ad30dbf7b -a 192.168.100.8 -s 4420 -i 4 00:13:04.253 02:32:37 -- target/ns_masking.sh@20 -- # waitforserial SPDKISFASTANDAWESOME 1 00:13:04.253 02:32:37 -- common/autotest_common.sh@1184 -- # local i=0 00:13:04.253 02:32:37 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:13:04.253 02:32:37 -- common/autotest_common.sh@1186 -- # [[ -n 1 ]] 00:13:04.253 02:32:37 -- common/autotest_common.sh@1187 -- # nvme_device_counter=1 00:13:04.253 02:32:37 -- common/autotest_common.sh@1191 -- # sleep 2 00:13:06.155 02:32:39 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:13:06.155 02:32:39 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:13:06.155 02:32:39 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:13:06.155 02:32:39 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:13:06.155 02:32:39 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:13:06.155 02:32:39 -- common/autotest_common.sh@1194 -- # return 0 00:13:06.155 02:32:39 -- target/ns_masking.sh@22 -- # nvme list-subsys -o json 00:13:06.155 02:32:39 -- target/ns_masking.sh@22 -- # jq -r '.[].Subsystems[] | select(.NQN=="nqn.2016-06.io.spdk:cnode1") | .Paths[0].Name' 00:13:06.155 02:32:39 -- target/ns_masking.sh@22 -- # ctrl_id=nvme0 00:13:06.155 02:32:39 -- target/ns_masking.sh@23 -- # [[ -z nvme0 ]] 00:13:06.155 02:32:39 -- target/ns_masking.sh@78 -- # NOT ns_is_visible 0x1 00:13:06.155 02:32:39 -- common/autotest_common.sh@638 -- # local es=0 00:13:06.155 02:32:39 -- common/autotest_common.sh@640 -- # valid_exec_arg ns_is_visible 0x1 00:13:06.155 02:32:39 -- common/autotest_common.sh@626 -- # local arg=ns_is_visible 00:13:06.155 02:32:39 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:13:06.155 02:32:39 -- common/autotest_common.sh@630 -- # type -t ns_is_visible 00:13:06.155 02:32:39 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:13:06.155 02:32:39 -- common/autotest_common.sh@641 -- # ns_is_visible 0x1 00:13:06.155 02:32:39 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:13:06.155 02:32:39 -- target/ns_masking.sh@39 -- # grep 0x1 00:13:06.155 02:32:39 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:13:06.155 02:32:39 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:13:06.413 02:32:39 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:13:06.413 02:32:39 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:13:06.413 02:32:39 -- common/autotest_common.sh@641 -- # es=1 00:13:06.413 02:32:39 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:13:06.413 02:32:39 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:13:06.413 02:32:39 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:13:06.413 02:32:39 -- target/ns_masking.sh@79 -- # ns_is_visible 0x2 00:13:06.413 02:32:39 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:13:06.413 02:32:39 -- target/ns_masking.sh@39 -- # grep 0x2 00:13:06.413 [ 0]:0x2 00:13:06.413 02:32:39 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:13:06.413 02:32:39 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:13:06.413 02:32:39 -- target/ns_masking.sh@40 -- # nguid=6401014c27bd477da5f9aa8aa02d743a 00:13:06.413 02:32:39 -- target/ns_masking.sh@41 -- # [[ 6401014c27bd477da5f9aa8aa02d743a != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:13:06.413 02:32:39 -- target/ns_masking.sh@82 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_add_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:13:06.671 02:32:40 -- target/ns_masking.sh@83 -- # ns_is_visible 0x1 00:13:06.671 02:32:40 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:13:06.671 02:32:40 -- target/ns_masking.sh@39 -- # grep 0x1 00:13:06.671 [ 0]:0x1 00:13:06.671 02:32:40 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:13:06.671 02:32:40 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:13:06.671 02:32:40 -- target/ns_masking.sh@40 -- # nguid=ac9377b0aef549d583cf83bafa3769f0 00:13:06.671 02:32:40 -- target/ns_masking.sh@41 -- # [[ ac9377b0aef549d583cf83bafa3769f0 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:13:06.671 02:32:40 -- target/ns_masking.sh@84 -- # ns_is_visible 0x2 00:13:06.671 02:32:40 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:13:06.671 02:32:40 -- target/ns_masking.sh@39 -- # grep 0x2 00:13:06.671 [ 1]:0x2 00:13:06.671 02:32:40 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:13:06.671 02:32:40 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:13:06.671 02:32:40 -- target/ns_masking.sh@40 -- # nguid=6401014c27bd477da5f9aa8aa02d743a 00:13:06.672 02:32:40 -- target/ns_masking.sh@41 -- # [[ 6401014c27bd477da5f9aa8aa02d743a != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:13:06.672 02:32:40 -- target/ns_masking.sh@87 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:13:06.930 02:32:40 -- target/ns_masking.sh@88 -- # NOT ns_is_visible 0x1 00:13:06.930 02:32:40 -- common/autotest_common.sh@638 -- # local es=0 00:13:06.930 02:32:40 -- common/autotest_common.sh@640 -- # valid_exec_arg ns_is_visible 0x1 00:13:06.930 02:32:40 -- common/autotest_common.sh@626 -- # local arg=ns_is_visible 00:13:06.930 02:32:40 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:13:06.930 02:32:40 -- common/autotest_common.sh@630 -- # type -t ns_is_visible 00:13:06.930 02:32:40 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:13:06.930 02:32:40 -- common/autotest_common.sh@641 -- # ns_is_visible 0x1 00:13:06.930 02:32:40 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:13:06.930 02:32:40 -- target/ns_masking.sh@39 -- # grep 0x1 00:13:06.930 02:32:40 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:13:06.930 02:32:40 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:13:06.930 02:32:40 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:13:06.930 02:32:40 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:13:06.930 02:32:40 -- common/autotest_common.sh@641 -- # es=1 00:13:06.930 02:32:40 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:13:06.930 02:32:40 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:13:06.930 02:32:40 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:13:06.930 02:32:40 -- target/ns_masking.sh@89 -- # ns_is_visible 0x2 00:13:06.930 02:32:40 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:13:06.930 02:32:40 -- target/ns_masking.sh@39 -- # grep 0x2 00:13:06.930 [ 0]:0x2 00:13:06.930 02:32:40 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:13:06.930 02:32:40 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:13:06.930 02:32:40 -- target/ns_masking.sh@40 -- # nguid=6401014c27bd477da5f9aa8aa02d743a 00:13:06.930 02:32:40 -- target/ns_masking.sh@41 -- # [[ 6401014c27bd477da5f9aa8aa02d743a != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:13:06.930 02:32:40 -- target/ns_masking.sh@91 -- # disconnect 00:13:06.930 02:32:40 -- target/ns_masking.sh@34 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:07.188 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:07.188 02:32:40 -- target/ns_masking.sh@94 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_add_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:13:07.446 02:32:40 -- target/ns_masking.sh@95 -- # connect 2 00:13:07.446 02:32:40 -- target/ns_masking.sh@18 -- # nvme connect -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -I 075299f8-0c84-450b-8c0d-392ad30dbf7b -a 192.168.100.8 -s 4420 -i 4 00:13:07.704 02:32:41 -- target/ns_masking.sh@20 -- # waitforserial SPDKISFASTANDAWESOME 2 00:13:07.704 02:32:41 -- common/autotest_common.sh@1184 -- # local i=0 00:13:07.704 02:32:41 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:13:07.704 02:32:41 -- common/autotest_common.sh@1186 -- # [[ -n 2 ]] 00:13:07.704 02:32:41 -- common/autotest_common.sh@1187 -- # nvme_device_counter=2 00:13:07.704 02:32:41 -- common/autotest_common.sh@1191 -- # sleep 2 00:13:10.233 02:32:43 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:13:10.233 02:32:43 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:13:10.233 02:32:43 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:13:10.233 02:32:43 -- common/autotest_common.sh@1193 -- # nvme_devices=2 00:13:10.233 02:32:43 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:13:10.233 02:32:43 -- common/autotest_common.sh@1194 -- # return 0 00:13:10.233 02:32:43 -- target/ns_masking.sh@22 -- # nvme list-subsys -o json 00:13:10.233 02:32:43 -- target/ns_masking.sh@22 -- # jq -r '.[].Subsystems[] | select(.NQN=="nqn.2016-06.io.spdk:cnode1") | .Paths[0].Name' 00:13:10.233 02:32:43 -- target/ns_masking.sh@22 -- # ctrl_id=nvme0 00:13:10.233 02:32:43 -- target/ns_masking.sh@23 -- # [[ -z nvme0 ]] 00:13:10.233 02:32:43 -- target/ns_masking.sh@96 -- # ns_is_visible 0x1 00:13:10.233 02:32:43 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:13:10.233 02:32:43 -- target/ns_masking.sh@39 -- # grep 0x1 00:13:10.233 [ 0]:0x1 00:13:10.233 02:32:43 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:13:10.233 02:32:43 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:13:10.233 02:32:43 -- target/ns_masking.sh@40 -- # nguid=ac9377b0aef549d583cf83bafa3769f0 00:13:10.233 02:32:43 -- target/ns_masking.sh@41 -- # [[ ac9377b0aef549d583cf83bafa3769f0 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:13:10.233 02:32:43 -- target/ns_masking.sh@97 -- # ns_is_visible 0x2 00:13:10.233 02:32:43 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:13:10.233 02:32:43 -- target/ns_masking.sh@39 -- # grep 0x2 00:13:10.233 [ 1]:0x2 00:13:10.233 02:32:43 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:13:10.233 02:32:43 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:13:10.233 02:32:43 -- target/ns_masking.sh@40 -- # nguid=6401014c27bd477da5f9aa8aa02d743a 00:13:10.233 02:32:43 -- target/ns_masking.sh@41 -- # [[ 6401014c27bd477da5f9aa8aa02d743a != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:13:10.233 02:32:43 -- target/ns_masking.sh@100 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:13:10.233 02:32:43 -- target/ns_masking.sh@101 -- # NOT ns_is_visible 0x1 00:13:10.233 02:32:43 -- common/autotest_common.sh@638 -- # local es=0 00:13:10.233 02:32:43 -- common/autotest_common.sh@640 -- # valid_exec_arg ns_is_visible 0x1 00:13:10.233 02:32:43 -- common/autotest_common.sh@626 -- # local arg=ns_is_visible 00:13:10.233 02:32:43 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:13:10.233 02:32:43 -- common/autotest_common.sh@630 -- # type -t ns_is_visible 00:13:10.233 02:32:43 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:13:10.233 02:32:43 -- common/autotest_common.sh@641 -- # ns_is_visible 0x1 00:13:10.233 02:32:43 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:13:10.233 02:32:43 -- target/ns_masking.sh@39 -- # grep 0x1 00:13:10.233 02:32:43 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:13:10.233 02:32:43 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:13:10.233 02:32:43 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:13:10.233 02:32:43 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:13:10.233 02:32:43 -- common/autotest_common.sh@641 -- # es=1 00:13:10.233 02:32:43 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:13:10.233 02:32:43 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:13:10.233 02:32:43 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:13:10.233 02:32:43 -- target/ns_masking.sh@102 -- # ns_is_visible 0x2 00:13:10.233 02:32:43 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:13:10.233 02:32:43 -- target/ns_masking.sh@39 -- # grep 0x2 00:13:10.233 [ 0]:0x2 00:13:10.233 02:32:43 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:13:10.233 02:32:43 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:13:10.233 02:32:43 -- target/ns_masking.sh@40 -- # nguid=6401014c27bd477da5f9aa8aa02d743a 00:13:10.233 02:32:43 -- target/ns_masking.sh@41 -- # [[ 6401014c27bd477da5f9aa8aa02d743a != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:13:10.233 02:32:43 -- target/ns_masking.sh@105 -- # NOT /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host1 00:13:10.233 02:32:43 -- common/autotest_common.sh@638 -- # local es=0 00:13:10.233 02:32:43 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host1 00:13:10.233 02:32:43 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:13:10.233 02:32:43 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:13:10.233 02:32:43 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:13:10.233 02:32:43 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:13:10.233 02:32:43 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:13:10.233 02:32:43 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:13:10.233 02:32:43 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:13:10.233 02:32:43 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py ]] 00:13:10.233 02:32:43 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host1 00:13:10.491 [2024-04-27 02:32:43.896673] nvmf_rpc.c:1779:nvmf_rpc_ns_visible_paused: *ERROR*: Unable to add/remove nqn.2016-06.io.spdk:host1 to namespace ID 2 00:13:10.491 request: 00:13:10.491 { 00:13:10.491 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:13:10.491 "nsid": 2, 00:13:10.491 "host": "nqn.2016-06.io.spdk:host1", 00:13:10.491 "method": "nvmf_ns_remove_host", 00:13:10.491 "req_id": 1 00:13:10.491 } 00:13:10.491 Got JSON-RPC error response 00:13:10.491 response: 00:13:10.491 { 00:13:10.491 "code": -32602, 00:13:10.491 "message": "Invalid parameters" 00:13:10.491 } 00:13:10.491 02:32:43 -- common/autotest_common.sh@641 -- # es=1 00:13:10.491 02:32:43 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:13:10.491 02:32:43 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:13:10.491 02:32:43 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:13:10.491 02:32:43 -- target/ns_masking.sh@106 -- # NOT ns_is_visible 0x1 00:13:10.491 02:32:43 -- common/autotest_common.sh@638 -- # local es=0 00:13:10.491 02:32:43 -- common/autotest_common.sh@640 -- # valid_exec_arg ns_is_visible 0x1 00:13:10.491 02:32:43 -- common/autotest_common.sh@626 -- # local arg=ns_is_visible 00:13:10.491 02:32:43 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:13:10.491 02:32:43 -- common/autotest_common.sh@630 -- # type -t ns_is_visible 00:13:10.491 02:32:43 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:13:10.491 02:32:43 -- common/autotest_common.sh@641 -- # ns_is_visible 0x1 00:13:10.491 02:32:43 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:13:10.491 02:32:43 -- target/ns_masking.sh@39 -- # grep 0x1 00:13:10.491 02:32:43 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:13:10.491 02:32:43 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:13:10.491 02:32:43 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:13:10.491 02:32:43 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:13:10.491 02:32:43 -- common/autotest_common.sh@641 -- # es=1 00:13:10.491 02:32:43 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:13:10.491 02:32:43 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:13:10.491 02:32:43 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:13:10.491 02:32:43 -- target/ns_masking.sh@107 -- # ns_is_visible 0x2 00:13:10.491 02:32:43 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:13:10.491 02:32:43 -- target/ns_masking.sh@39 -- # grep 0x2 00:13:10.491 [ 0]:0x2 00:13:10.491 02:32:43 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:13:10.491 02:32:43 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:13:10.491 02:32:44 -- target/ns_masking.sh@40 -- # nguid=6401014c27bd477da5f9aa8aa02d743a 00:13:10.491 02:32:44 -- target/ns_masking.sh@41 -- # [[ 6401014c27bd477da5f9aa8aa02d743a != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:13:10.491 02:32:44 -- target/ns_masking.sh@108 -- # disconnect 00:13:10.491 02:32:44 -- target/ns_masking.sh@34 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:10.749 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:10.750 02:32:44 -- target/ns_masking.sh@110 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:11.008 02:32:44 -- target/ns_masking.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:13:11.008 02:32:44 -- target/ns_masking.sh@114 -- # nvmftestfini 00:13:11.008 02:32:44 -- nvmf/common.sh@477 -- # nvmfcleanup 00:13:11.008 02:32:44 -- nvmf/common.sh@117 -- # sync 00:13:11.008 02:32:44 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:13:11.008 02:32:44 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:13:11.008 02:32:44 -- nvmf/common.sh@120 -- # set +e 00:13:11.008 02:32:44 -- nvmf/common.sh@121 -- # for i in {1..20} 00:13:11.008 02:32:44 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:13:11.008 rmmod nvme_rdma 00:13:11.008 rmmod nvme_fabrics 00:13:11.008 02:32:44 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:13:11.008 02:32:44 -- nvmf/common.sh@124 -- # set -e 00:13:11.008 02:32:44 -- nvmf/common.sh@125 -- # return 0 00:13:11.008 02:32:44 -- nvmf/common.sh@478 -- # '[' -n 1505587 ']' 00:13:11.008 02:32:44 -- nvmf/common.sh@479 -- # killprocess 1505587 00:13:11.008 02:32:44 -- common/autotest_common.sh@936 -- # '[' -z 1505587 ']' 00:13:11.008 02:32:44 -- common/autotest_common.sh@940 -- # kill -0 1505587 00:13:11.008 02:32:44 -- common/autotest_common.sh@941 -- # uname 00:13:11.008 02:32:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:11.008 02:32:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1505587 00:13:11.266 02:32:44 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:11.266 02:32:44 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:11.266 02:32:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1505587' 00:13:11.266 killing process with pid 1505587 00:13:11.266 02:32:44 -- common/autotest_common.sh@955 -- # kill 1505587 00:13:11.266 02:32:44 -- common/autotest_common.sh@960 -- # wait 1505587 00:13:11.266 [2024-04-27 02:32:44.750579] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:13:11.525 02:32:45 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:13:11.525 02:32:45 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:13:11.525 00:13:11.525 real 0m19.443s 00:13:11.525 user 0m56.770s 00:13:11.525 sys 0m6.166s 00:13:11.525 02:32:45 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:13:11.525 02:32:45 -- common/autotest_common.sh@10 -- # set +x 00:13:11.525 ************************************ 00:13:11.525 END TEST nvmf_ns_masking 00:13:11.525 ************************************ 00:13:11.525 02:32:45 -- nvmf/nvmf.sh@37 -- # [[ 1 -eq 1 ]] 00:13:11.525 02:32:45 -- nvmf/nvmf.sh@38 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=rdma 00:13:11.525 02:32:45 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:11.525 02:32:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:11.525 02:32:45 -- common/autotest_common.sh@10 -- # set +x 00:13:11.784 ************************************ 00:13:11.784 START TEST nvmf_nvme_cli 00:13:11.784 ************************************ 00:13:11.784 02:32:45 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=rdma 00:13:11.784 * Looking for test storage... 00:13:11.784 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:13:11.784 02:32:45 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:13:11.784 02:32:45 -- nvmf/common.sh@7 -- # uname -s 00:13:11.784 02:32:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:11.784 02:32:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:11.784 02:32:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:11.784 02:32:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:11.784 02:32:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:11.784 02:32:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:11.784 02:32:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:11.784 02:32:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:11.784 02:32:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:11.784 02:32:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:11.784 02:32:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:13:11.784 02:32:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:13:11.784 02:32:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:11.784 02:32:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:11.784 02:32:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:11.784 02:32:45 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:13:11.784 02:32:45 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:13:11.784 02:32:45 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:11.784 02:32:45 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:11.784 02:32:45 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:11.784 02:32:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:11.784 02:32:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:11.784 02:32:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:11.784 02:32:45 -- paths/export.sh@5 -- # export PATH 00:13:11.784 02:32:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:11.784 02:32:45 -- nvmf/common.sh@47 -- # : 0 00:13:11.784 02:32:45 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:13:11.784 02:32:45 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:13:11.784 02:32:45 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:13:11.784 02:32:45 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:11.784 02:32:45 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:11.784 02:32:45 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:13:11.784 02:32:45 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:13:11.784 02:32:45 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:13:11.784 02:32:45 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:11.784 02:32:45 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:11.784 02:32:45 -- target/nvme_cli.sh@14 -- # devs=() 00:13:11.784 02:32:45 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:13:11.784 02:32:45 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:13:11.784 02:32:45 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:11.784 02:32:45 -- nvmf/common.sh@437 -- # prepare_net_devs 00:13:11.784 02:32:45 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:13:11.784 02:32:45 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:13:11.784 02:32:45 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:11.784 02:32:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:11.784 02:32:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:11.784 02:32:45 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:13:11.784 02:32:45 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:13:11.784 02:32:45 -- nvmf/common.sh@285 -- # xtrace_disable 00:13:11.784 02:32:45 -- common/autotest_common.sh@10 -- # set +x 00:13:18.348 02:32:50 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:18.348 02:32:50 -- nvmf/common.sh@291 -- # pci_devs=() 00:13:18.348 02:32:50 -- nvmf/common.sh@291 -- # local -a pci_devs 00:13:18.348 02:32:50 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:13:18.348 02:32:50 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:13:18.348 02:32:50 -- nvmf/common.sh@293 -- # pci_drivers=() 00:13:18.348 02:32:50 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:13:18.348 02:32:50 -- nvmf/common.sh@295 -- # net_devs=() 00:13:18.348 02:32:50 -- nvmf/common.sh@295 -- # local -ga net_devs 00:13:18.348 02:32:50 -- nvmf/common.sh@296 -- # e810=() 00:13:18.348 02:32:50 -- nvmf/common.sh@296 -- # local -ga e810 00:13:18.348 02:32:50 -- nvmf/common.sh@297 -- # x722=() 00:13:18.348 02:32:50 -- nvmf/common.sh@297 -- # local -ga x722 00:13:18.348 02:32:50 -- nvmf/common.sh@298 -- # mlx=() 00:13:18.348 02:32:50 -- nvmf/common.sh@298 -- # local -ga mlx 00:13:18.348 02:32:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:18.348 02:32:50 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:18.348 02:32:50 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:18.348 02:32:50 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:18.348 02:32:50 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:18.348 02:32:50 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:18.348 02:32:50 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:18.348 02:32:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:18.348 02:32:50 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:18.348 02:32:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:18.348 02:32:50 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:18.348 02:32:50 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:13:18.348 02:32:50 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:13:18.348 02:32:50 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:13:18.348 02:32:50 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:13:18.348 02:32:50 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:13:18.348 02:32:50 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:13:18.348 02:32:50 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:13:18.348 02:32:50 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:18.348 02:32:50 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:13:18.348 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:13:18.348 02:32:50 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:13:18.348 02:32:50 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:13:18.348 02:32:50 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:13:18.348 02:32:50 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:13:18.348 02:32:50 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:13:18.348 02:32:50 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:13:18.348 02:32:50 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:18.348 02:32:50 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:13:18.348 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:13:18.348 02:32:50 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:13:18.348 02:32:50 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:13:18.348 02:32:50 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:13:18.348 02:32:50 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:13:18.348 02:32:50 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:13:18.348 02:32:50 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:13:18.348 02:32:50 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:13:18.348 02:32:50 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:13:18.348 02:32:50 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:18.348 02:32:50 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:18.348 02:32:50 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:18.348 02:32:50 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:18.348 02:32:50 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:13:18.348 Found net devices under 0000:18:00.0: mlx_0_0 00:13:18.348 02:32:50 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:18.348 02:32:50 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:18.348 02:32:50 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:18.348 02:32:50 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:18.348 02:32:50 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:18.348 02:32:50 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:13:18.348 Found net devices under 0000:18:00.1: mlx_0_1 00:13:18.348 02:32:50 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:18.348 02:32:50 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:13:18.348 02:32:50 -- nvmf/common.sh@403 -- # is_hw=yes 00:13:18.348 02:32:50 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:13:18.348 02:32:50 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:13:18.348 02:32:50 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:13:18.348 02:32:50 -- nvmf/common.sh@409 -- # rdma_device_init 00:13:18.348 02:32:50 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:13:18.348 02:32:50 -- nvmf/common.sh@58 -- # uname 00:13:18.348 02:32:50 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:13:18.348 02:32:50 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:13:18.348 02:32:50 -- nvmf/common.sh@63 -- # modprobe ib_core 00:13:18.348 02:32:51 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:13:18.348 02:32:51 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:13:18.348 02:32:51 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:13:18.348 02:32:51 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:13:18.348 02:32:51 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:13:18.348 02:32:51 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:13:18.348 02:32:51 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:13:18.348 02:32:51 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:13:18.348 02:32:51 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:13:18.348 02:32:51 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:13:18.348 02:32:51 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:13:18.348 02:32:51 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:13:18.348 02:32:51 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:13:18.348 02:32:51 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:18.348 02:32:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:18.348 02:32:51 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:13:18.348 02:32:51 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:13:18.348 02:32:51 -- nvmf/common.sh@105 -- # continue 2 00:13:18.348 02:32:51 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:18.348 02:32:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:18.348 02:32:51 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:13:18.348 02:32:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:18.348 02:32:51 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:13:18.348 02:32:51 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:13:18.348 02:32:51 -- nvmf/common.sh@105 -- # continue 2 00:13:18.348 02:32:51 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:13:18.348 02:32:51 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:13:18.348 02:32:51 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:13:18.348 02:32:51 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:13:18.348 02:32:51 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:18.348 02:32:51 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:18.348 02:32:51 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:13:18.348 02:32:51 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:13:18.348 02:32:51 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:13:18.348 60: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:13:18.348 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:13:18.348 altname enp24s0f0np0 00:13:18.348 altname ens785f0np0 00:13:18.348 inet 192.168.100.8/24 scope global mlx_0_0 00:13:18.348 valid_lft forever preferred_lft forever 00:13:18.348 02:32:51 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:13:18.348 02:32:51 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:13:18.348 02:32:51 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:13:18.348 02:32:51 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:13:18.348 02:32:51 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:18.348 02:32:51 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:18.348 02:32:51 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:13:18.348 02:32:51 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:13:18.349 02:32:51 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:13:18.349 61: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:13:18.349 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:13:18.349 altname enp24s0f1np1 00:13:18.349 altname ens785f1np1 00:13:18.349 inet 192.168.100.9/24 scope global mlx_0_1 00:13:18.349 valid_lft forever preferred_lft forever 00:13:18.349 02:32:51 -- nvmf/common.sh@411 -- # return 0 00:13:18.349 02:32:51 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:13:18.349 02:32:51 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:13:18.349 02:32:51 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:13:18.349 02:32:51 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:13:18.349 02:32:51 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:13:18.349 02:32:51 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:13:18.349 02:32:51 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:13:18.349 02:32:51 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:13:18.349 02:32:51 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:13:18.349 02:32:51 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:13:18.349 02:32:51 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:18.349 02:32:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:18.349 02:32:51 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:13:18.349 02:32:51 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:13:18.349 02:32:51 -- nvmf/common.sh@105 -- # continue 2 00:13:18.349 02:32:51 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:18.349 02:32:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:18.349 02:32:51 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:13:18.349 02:32:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:18.349 02:32:51 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:13:18.349 02:32:51 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:13:18.349 02:32:51 -- nvmf/common.sh@105 -- # continue 2 00:13:18.349 02:32:51 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:13:18.349 02:32:51 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:13:18.349 02:32:51 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:13:18.349 02:32:51 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:13:18.349 02:32:51 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:18.349 02:32:51 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:18.349 02:32:51 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:13:18.349 02:32:51 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:13:18.349 02:32:51 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:13:18.349 02:32:51 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:13:18.349 02:32:51 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:18.349 02:32:51 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:18.349 02:32:51 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:13:18.349 192.168.100.9' 00:13:18.349 02:32:51 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:13:18.349 192.168.100.9' 00:13:18.349 02:32:51 -- nvmf/common.sh@446 -- # head -n 1 00:13:18.349 02:32:51 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:13:18.349 02:32:51 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:13:18.349 192.168.100.9' 00:13:18.349 02:32:51 -- nvmf/common.sh@447 -- # tail -n +2 00:13:18.349 02:32:51 -- nvmf/common.sh@447 -- # head -n 1 00:13:18.349 02:32:51 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:13:18.349 02:32:51 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:13:18.349 02:32:51 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:13:18.349 02:32:51 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:13:18.349 02:32:51 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:13:18.349 02:32:51 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:13:18.349 02:32:51 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:13:18.349 02:32:51 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:13:18.349 02:32:51 -- common/autotest_common.sh@710 -- # xtrace_disable 00:13:18.349 02:32:51 -- common/autotest_common.sh@10 -- # set +x 00:13:18.349 02:32:51 -- nvmf/common.sh@470 -- # nvmfpid=1510429 00:13:18.349 02:32:51 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:18.349 02:32:51 -- nvmf/common.sh@471 -- # waitforlisten 1510429 00:13:18.349 02:32:51 -- common/autotest_common.sh@817 -- # '[' -z 1510429 ']' 00:13:18.349 02:32:51 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:18.349 02:32:51 -- common/autotest_common.sh@822 -- # local max_retries=100 00:13:18.349 02:32:51 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:18.349 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:18.349 02:32:51 -- common/autotest_common.sh@826 -- # xtrace_disable 00:13:18.349 02:32:51 -- common/autotest_common.sh@10 -- # set +x 00:13:18.349 [2024-04-27 02:32:51.279914] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:13:18.349 [2024-04-27 02:32:51.279975] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:18.349 EAL: No free 2048 kB hugepages reported on node 1 00:13:18.349 [2024-04-27 02:32:51.352942] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:18.349 [2024-04-27 02:32:51.434059] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:18.349 [2024-04-27 02:32:51.434105] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:18.349 [2024-04-27 02:32:51.434114] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:13:18.349 [2024-04-27 02:32:51.434123] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:13:18.349 [2024-04-27 02:32:51.434130] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:18.349 [2024-04-27 02:32:51.434233] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:18.349 [2024-04-27 02:32:51.434334] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:18.349 [2024-04-27 02:32:51.434414] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:18.349 [2024-04-27 02:32:51.434416] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:18.607 02:32:52 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:13:18.607 02:32:52 -- common/autotest_common.sh@850 -- # return 0 00:13:18.607 02:32:52 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:13:18.607 02:32:52 -- common/autotest_common.sh@716 -- # xtrace_disable 00:13:18.607 02:32:52 -- common/autotest_common.sh@10 -- # set +x 00:13:18.607 02:32:52 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:18.607 02:32:52 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:13:18.607 02:32:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:18.607 02:32:52 -- common/autotest_common.sh@10 -- # set +x 00:13:18.607 [2024-04-27 02:32:52.168172] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x135c4d0/0x13609c0) succeed. 00:13:18.607 [2024-04-27 02:32:52.178658] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x135db10/0x13a2050) succeed. 00:13:18.866 02:32:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:18.866 02:32:52 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:13:18.866 02:32:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:18.866 02:32:52 -- common/autotest_common.sh@10 -- # set +x 00:13:18.866 Malloc0 00:13:18.866 02:32:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:18.866 02:32:52 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:13:18.866 02:32:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:18.866 02:32:52 -- common/autotest_common.sh@10 -- # set +x 00:13:18.866 Malloc1 00:13:18.866 02:32:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:18.866 02:32:52 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:13:18.866 02:32:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:18.866 02:32:52 -- common/autotest_common.sh@10 -- # set +x 00:13:18.866 02:32:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:18.866 02:32:52 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:13:18.866 02:32:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:18.866 02:32:52 -- common/autotest_common.sh@10 -- # set +x 00:13:18.866 02:32:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:18.866 02:32:52 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:18.866 02:32:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:18.866 02:32:52 -- common/autotest_common.sh@10 -- # set +x 00:13:18.866 02:32:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:18.866 02:32:52 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:13:18.866 02:32:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:18.866 02:32:52 -- common/autotest_common.sh@10 -- # set +x 00:13:18.866 [2024-04-27 02:32:52.378711] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:13:18.866 02:32:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:18.866 02:32:52 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:13:18.866 02:32:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:18.866 02:32:52 -- common/autotest_common.sh@10 -- # set +x 00:13:18.866 02:32:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:18.866 02:32:52 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 4420 00:13:18.866 00:13:18.866 Discovery Log Number of Records 2, Generation counter 2 00:13:18.866 =====Discovery Log Entry 0====== 00:13:18.866 trtype: rdma 00:13:18.866 adrfam: ipv4 00:13:18.866 subtype: current discovery subsystem 00:13:18.866 treq: not required 00:13:18.866 portid: 0 00:13:18.866 trsvcid: 4420 00:13:18.866 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:13:18.866 traddr: 192.168.100.8 00:13:18.866 eflags: explicit discovery connections, duplicate discovery information 00:13:18.866 rdma_prtype: not specified 00:13:18.866 rdma_qptype: connected 00:13:18.866 rdma_cms: rdma-cm 00:13:18.866 rdma_pkey: 0x0000 00:13:18.866 =====Discovery Log Entry 1====== 00:13:18.866 trtype: rdma 00:13:18.866 adrfam: ipv4 00:13:18.866 subtype: nvme subsystem 00:13:18.866 treq: not required 00:13:18.866 portid: 0 00:13:18.866 trsvcid: 4420 00:13:18.866 subnqn: nqn.2016-06.io.spdk:cnode1 00:13:18.866 traddr: 192.168.100.8 00:13:18.866 eflags: none 00:13:18.866 rdma_prtype: not specified 00:13:18.866 rdma_qptype: connected 00:13:18.866 rdma_cms: rdma-cm 00:13:18.866 rdma_pkey: 0x0000 00:13:18.866 02:32:52 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:13:18.866 02:32:52 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:13:18.866 02:32:52 -- nvmf/common.sh@511 -- # local dev _ 00:13:19.124 02:32:52 -- nvmf/common.sh@513 -- # read -r dev _ 00:13:19.124 02:32:52 -- nvmf/common.sh@510 -- # nvme list 00:13:19.124 02:32:52 -- nvmf/common.sh@514 -- # [[ Node == /dev/nvme* ]] 00:13:19.124 02:32:52 -- nvmf/common.sh@513 -- # read -r dev _ 00:13:19.124 02:32:52 -- nvmf/common.sh@514 -- # [[ --------------------- == /dev/nvme* ]] 00:13:19.124 02:32:52 -- nvmf/common.sh@513 -- # read -r dev _ 00:13:19.124 02:32:52 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:13:19.124 02:32:52 -- target/nvme_cli.sh@32 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:13:20.055 02:32:53 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:13:20.055 02:32:53 -- common/autotest_common.sh@1184 -- # local i=0 00:13:20.055 02:32:53 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:13:20.055 02:32:53 -- common/autotest_common.sh@1186 -- # [[ -n 2 ]] 00:13:20.055 02:32:53 -- common/autotest_common.sh@1187 -- # nvme_device_counter=2 00:13:20.055 02:32:53 -- common/autotest_common.sh@1191 -- # sleep 2 00:13:21.951 02:32:55 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:13:21.951 02:32:55 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:13:21.951 02:32:55 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:13:21.951 02:32:55 -- common/autotest_common.sh@1193 -- # nvme_devices=2 00:13:21.951 02:32:55 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:13:21.951 02:32:55 -- common/autotest_common.sh@1194 -- # return 0 00:13:21.951 02:32:55 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:13:21.951 02:32:55 -- nvmf/common.sh@511 -- # local dev _ 00:13:21.951 02:32:55 -- nvmf/common.sh@513 -- # read -r dev _ 00:13:21.951 02:32:55 -- nvmf/common.sh@510 -- # nvme list 00:13:21.951 02:32:55 -- nvmf/common.sh@514 -- # [[ Node == /dev/nvme* ]] 00:13:21.951 02:32:55 -- nvmf/common.sh@513 -- # read -r dev _ 00:13:21.951 02:32:55 -- nvmf/common.sh@514 -- # [[ --------------------- == /dev/nvme* ]] 00:13:21.951 02:32:55 -- nvmf/common.sh@513 -- # read -r dev _ 00:13:21.951 02:32:55 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:13:21.951 02:32:55 -- nvmf/common.sh@515 -- # echo /dev/nvme0n2 00:13:21.951 02:32:55 -- nvmf/common.sh@513 -- # read -r dev _ 00:13:21.951 02:32:55 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:13:21.951 02:32:55 -- nvmf/common.sh@515 -- # echo /dev/nvme0n1 00:13:21.951 02:32:55 -- nvmf/common.sh@513 -- # read -r dev _ 00:13:21.951 02:32:55 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n2 00:13:21.951 /dev/nvme0n1 ]] 00:13:21.951 02:32:55 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:13:21.951 02:32:55 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:13:21.951 02:32:55 -- nvmf/common.sh@511 -- # local dev _ 00:13:21.951 02:32:55 -- nvmf/common.sh@513 -- # read -r dev _ 00:13:21.951 02:32:55 -- nvmf/common.sh@510 -- # nvme list 00:13:21.951 02:32:55 -- nvmf/common.sh@514 -- # [[ Node == /dev/nvme* ]] 00:13:21.951 02:32:55 -- nvmf/common.sh@513 -- # read -r dev _ 00:13:21.951 02:32:55 -- nvmf/common.sh@514 -- # [[ --------------------- == /dev/nvme* ]] 00:13:21.951 02:32:55 -- nvmf/common.sh@513 -- # read -r dev _ 00:13:21.951 02:32:55 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:13:21.951 02:32:55 -- nvmf/common.sh@515 -- # echo /dev/nvme0n2 00:13:21.951 02:32:55 -- nvmf/common.sh@513 -- # read -r dev _ 00:13:21.951 02:32:55 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:13:21.951 02:32:55 -- nvmf/common.sh@515 -- # echo /dev/nvme0n1 00:13:21.951 02:32:55 -- nvmf/common.sh@513 -- # read -r dev _ 00:13:21.951 02:32:55 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:13:21.951 02:32:55 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:23.352 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:23.352 02:32:56 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:23.352 02:32:56 -- common/autotest_common.sh@1205 -- # local i=0 00:13:23.352 02:32:56 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:13:23.352 02:32:56 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:23.352 02:32:56 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:13:23.352 02:32:56 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:23.352 02:32:56 -- common/autotest_common.sh@1217 -- # return 0 00:13:23.352 02:32:56 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:13:23.352 02:32:56 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:23.352 02:32:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:23.352 02:32:56 -- common/autotest_common.sh@10 -- # set +x 00:13:23.352 02:32:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:23.352 02:32:56 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:13:23.352 02:32:56 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:13:23.352 02:32:56 -- nvmf/common.sh@477 -- # nvmfcleanup 00:13:23.352 02:32:56 -- nvmf/common.sh@117 -- # sync 00:13:23.352 02:32:56 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:13:23.352 02:32:56 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:13:23.353 02:32:56 -- nvmf/common.sh@120 -- # set +e 00:13:23.353 02:32:56 -- nvmf/common.sh@121 -- # for i in {1..20} 00:13:23.353 02:32:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:13:23.353 rmmod nvme_rdma 00:13:23.353 rmmod nvme_fabrics 00:13:23.353 02:32:56 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:13:23.353 02:32:56 -- nvmf/common.sh@124 -- # set -e 00:13:23.353 02:32:56 -- nvmf/common.sh@125 -- # return 0 00:13:23.353 02:32:56 -- nvmf/common.sh@478 -- # '[' -n 1510429 ']' 00:13:23.353 02:32:56 -- nvmf/common.sh@479 -- # killprocess 1510429 00:13:23.353 02:32:56 -- common/autotest_common.sh@936 -- # '[' -z 1510429 ']' 00:13:23.353 02:32:56 -- common/autotest_common.sh@940 -- # kill -0 1510429 00:13:23.353 02:32:56 -- common/autotest_common.sh@941 -- # uname 00:13:23.353 02:32:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:23.353 02:32:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1510429 00:13:23.353 02:32:56 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:23.353 02:32:56 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:23.353 02:32:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1510429' 00:13:23.353 killing process with pid 1510429 00:13:23.353 02:32:56 -- common/autotest_common.sh@955 -- # kill 1510429 00:13:23.353 02:32:56 -- common/autotest_common.sh@960 -- # wait 1510429 00:13:23.353 [2024-04-27 02:32:56.759467] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:13:23.612 02:32:57 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:13:23.612 02:32:57 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:13:23.612 00:13:23.612 real 0m11.801s 00:13:23.612 user 0m23.765s 00:13:23.612 sys 0m5.103s 00:13:23.612 02:32:57 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:13:23.612 02:32:57 -- common/autotest_common.sh@10 -- # set +x 00:13:23.612 ************************************ 00:13:23.612 END TEST nvmf_nvme_cli 00:13:23.612 ************************************ 00:13:23.612 02:32:57 -- nvmf/nvmf.sh@40 -- # [[ 0 -eq 1 ]] 00:13:23.612 02:32:57 -- nvmf/nvmf.sh@47 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=rdma 00:13:23.612 02:32:57 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:23.612 02:32:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:23.612 02:32:57 -- common/autotest_common.sh@10 -- # set +x 00:13:23.612 ************************************ 00:13:23.612 START TEST nvmf_host_management 00:13:23.612 ************************************ 00:13:23.612 02:32:57 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=rdma 00:13:23.871 * Looking for test storage... 00:13:23.871 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:13:23.871 02:32:57 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:13:23.871 02:32:57 -- nvmf/common.sh@7 -- # uname -s 00:13:23.871 02:32:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:23.871 02:32:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:23.871 02:32:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:23.871 02:32:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:23.871 02:32:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:23.871 02:32:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:23.871 02:32:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:23.871 02:32:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:23.871 02:32:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:23.871 02:32:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:23.871 02:32:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:13:23.871 02:32:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:13:23.871 02:32:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:23.871 02:32:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:23.871 02:32:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:23.871 02:32:57 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:13:23.871 02:32:57 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:13:23.871 02:32:57 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:23.871 02:32:57 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:23.871 02:32:57 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:23.871 02:32:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:23.871 02:32:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:23.871 02:32:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:23.871 02:32:57 -- paths/export.sh@5 -- # export PATH 00:13:23.871 02:32:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:23.871 02:32:57 -- nvmf/common.sh@47 -- # : 0 00:13:23.871 02:32:57 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:13:23.871 02:32:57 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:13:23.871 02:32:57 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:13:23.871 02:32:57 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:23.871 02:32:57 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:23.871 02:32:57 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:13:23.871 02:32:57 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:13:23.871 02:32:57 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:13:23.871 02:32:57 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:23.871 02:32:57 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:23.871 02:32:57 -- target/host_management.sh@105 -- # nvmftestinit 00:13:23.871 02:32:57 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:13:23.871 02:32:57 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:23.871 02:32:57 -- nvmf/common.sh@437 -- # prepare_net_devs 00:13:23.871 02:32:57 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:13:23.871 02:32:57 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:13:23.871 02:32:57 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:23.871 02:32:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:23.871 02:32:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:23.871 02:32:57 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:13:23.871 02:32:57 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:13:23.871 02:32:57 -- nvmf/common.sh@285 -- # xtrace_disable 00:13:23.871 02:32:57 -- common/autotest_common.sh@10 -- # set +x 00:13:30.432 02:33:03 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:30.432 02:33:03 -- nvmf/common.sh@291 -- # pci_devs=() 00:13:30.432 02:33:03 -- nvmf/common.sh@291 -- # local -a pci_devs 00:13:30.432 02:33:03 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:13:30.432 02:33:03 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:13:30.432 02:33:03 -- nvmf/common.sh@293 -- # pci_drivers=() 00:13:30.432 02:33:03 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:13:30.432 02:33:03 -- nvmf/common.sh@295 -- # net_devs=() 00:13:30.432 02:33:03 -- nvmf/common.sh@295 -- # local -ga net_devs 00:13:30.432 02:33:03 -- nvmf/common.sh@296 -- # e810=() 00:13:30.432 02:33:03 -- nvmf/common.sh@296 -- # local -ga e810 00:13:30.432 02:33:03 -- nvmf/common.sh@297 -- # x722=() 00:13:30.432 02:33:03 -- nvmf/common.sh@297 -- # local -ga x722 00:13:30.432 02:33:03 -- nvmf/common.sh@298 -- # mlx=() 00:13:30.432 02:33:03 -- nvmf/common.sh@298 -- # local -ga mlx 00:13:30.432 02:33:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:30.432 02:33:03 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:30.432 02:33:03 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:30.432 02:33:03 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:30.432 02:33:03 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:30.432 02:33:03 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:30.432 02:33:03 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:30.432 02:33:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:30.432 02:33:03 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:30.432 02:33:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:30.432 02:33:03 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:30.432 02:33:03 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:13:30.432 02:33:03 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:13:30.432 02:33:03 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:13:30.432 02:33:03 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:13:30.432 02:33:03 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:13:30.432 02:33:03 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:13:30.432 02:33:03 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:13:30.432 02:33:03 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:30.432 02:33:03 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:13:30.432 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:13:30.432 02:33:03 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:13:30.432 02:33:03 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:13:30.432 02:33:03 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:13:30.432 02:33:03 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:13:30.432 02:33:03 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:13:30.432 02:33:03 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:13:30.432 02:33:03 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:30.432 02:33:03 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:13:30.432 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:13:30.432 02:33:03 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:13:30.432 02:33:03 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:13:30.432 02:33:03 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:13:30.432 02:33:03 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:13:30.432 02:33:03 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:13:30.432 02:33:03 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:13:30.432 02:33:03 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:13:30.432 02:33:03 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:13:30.432 02:33:03 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:30.432 02:33:03 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:30.432 02:33:03 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:30.432 02:33:03 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:30.432 02:33:03 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:13:30.432 Found net devices under 0000:18:00.0: mlx_0_0 00:13:30.432 02:33:03 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:30.432 02:33:03 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:30.432 02:33:03 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:30.432 02:33:03 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:30.432 02:33:03 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:30.432 02:33:03 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:13:30.432 Found net devices under 0000:18:00.1: mlx_0_1 00:13:30.432 02:33:03 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:30.432 02:33:03 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:13:30.432 02:33:03 -- nvmf/common.sh@403 -- # is_hw=yes 00:13:30.432 02:33:03 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:13:30.432 02:33:03 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:13:30.432 02:33:03 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:13:30.432 02:33:03 -- nvmf/common.sh@409 -- # rdma_device_init 00:13:30.432 02:33:03 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:13:30.432 02:33:03 -- nvmf/common.sh@58 -- # uname 00:13:30.432 02:33:03 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:13:30.432 02:33:03 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:13:30.432 02:33:03 -- nvmf/common.sh@63 -- # modprobe ib_core 00:13:30.432 02:33:03 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:13:30.432 02:33:03 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:13:30.432 02:33:03 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:13:30.432 02:33:03 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:13:30.432 02:33:03 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:13:30.432 02:33:03 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:13:30.432 02:33:03 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:13:30.432 02:33:03 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:13:30.432 02:33:03 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:13:30.432 02:33:03 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:13:30.432 02:33:03 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:13:30.432 02:33:03 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:13:30.432 02:33:03 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:13:30.432 02:33:03 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:30.432 02:33:03 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:30.432 02:33:03 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:13:30.432 02:33:03 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:13:30.432 02:33:03 -- nvmf/common.sh@105 -- # continue 2 00:13:30.432 02:33:03 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:30.432 02:33:03 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:30.432 02:33:03 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:13:30.432 02:33:03 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:30.432 02:33:03 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:13:30.432 02:33:03 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:13:30.432 02:33:03 -- nvmf/common.sh@105 -- # continue 2 00:13:30.432 02:33:03 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:13:30.432 02:33:03 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:13:30.432 02:33:03 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:13:30.433 02:33:03 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:13:30.433 02:33:03 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:30.433 02:33:03 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:30.433 02:33:03 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:13:30.433 02:33:03 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:13:30.433 02:33:03 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:13:30.433 60: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:13:30.433 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:13:30.433 altname enp24s0f0np0 00:13:30.433 altname ens785f0np0 00:13:30.433 inet 192.168.100.8/24 scope global mlx_0_0 00:13:30.433 valid_lft forever preferred_lft forever 00:13:30.433 02:33:03 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:13:30.433 02:33:03 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:13:30.433 02:33:03 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:13:30.433 02:33:03 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:13:30.433 02:33:03 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:30.433 02:33:03 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:30.433 02:33:03 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:13:30.433 02:33:03 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:13:30.433 02:33:03 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:13:30.433 61: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:13:30.433 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:13:30.433 altname enp24s0f1np1 00:13:30.433 altname ens785f1np1 00:13:30.433 inet 192.168.100.9/24 scope global mlx_0_1 00:13:30.433 valid_lft forever preferred_lft forever 00:13:30.433 02:33:03 -- nvmf/common.sh@411 -- # return 0 00:13:30.433 02:33:03 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:13:30.433 02:33:03 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:13:30.433 02:33:03 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:13:30.433 02:33:03 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:13:30.433 02:33:03 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:13:30.433 02:33:03 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:13:30.433 02:33:03 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:13:30.433 02:33:03 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:13:30.433 02:33:03 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:13:30.433 02:33:03 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:13:30.433 02:33:03 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:30.433 02:33:03 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:30.433 02:33:03 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:13:30.433 02:33:03 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:13:30.433 02:33:03 -- nvmf/common.sh@105 -- # continue 2 00:13:30.433 02:33:03 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:30.433 02:33:03 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:30.433 02:33:03 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:13:30.433 02:33:03 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:30.433 02:33:03 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:13:30.433 02:33:03 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:13:30.433 02:33:03 -- nvmf/common.sh@105 -- # continue 2 00:13:30.433 02:33:03 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:13:30.433 02:33:03 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:13:30.433 02:33:03 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:13:30.433 02:33:03 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:13:30.433 02:33:03 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:30.433 02:33:03 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:30.433 02:33:03 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:13:30.433 02:33:03 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:13:30.433 02:33:03 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:13:30.433 02:33:03 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:13:30.433 02:33:03 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:30.433 02:33:03 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:30.433 02:33:03 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:13:30.433 192.168.100.9' 00:13:30.433 02:33:03 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:13:30.433 192.168.100.9' 00:13:30.433 02:33:03 -- nvmf/common.sh@446 -- # head -n 1 00:13:30.433 02:33:03 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:13:30.433 02:33:03 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:13:30.433 192.168.100.9' 00:13:30.433 02:33:03 -- nvmf/common.sh@447 -- # head -n 1 00:13:30.433 02:33:03 -- nvmf/common.sh@447 -- # tail -n +2 00:13:30.433 02:33:03 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:13:30.433 02:33:03 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:13:30.433 02:33:03 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:13:30.433 02:33:03 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:13:30.433 02:33:03 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:13:30.433 02:33:03 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:13:30.433 02:33:03 -- target/host_management.sh@107 -- # run_test nvmf_host_management nvmf_host_management 00:13:30.433 02:33:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:13:30.433 02:33:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:30.433 02:33:03 -- common/autotest_common.sh@10 -- # set +x 00:13:30.433 ************************************ 00:13:30.433 START TEST nvmf_host_management 00:13:30.433 ************************************ 00:13:30.433 02:33:03 -- common/autotest_common.sh@1111 -- # nvmf_host_management 00:13:30.433 02:33:03 -- target/host_management.sh@69 -- # starttarget 00:13:30.433 02:33:03 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:13:30.433 02:33:03 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:13:30.433 02:33:03 -- common/autotest_common.sh@710 -- # xtrace_disable 00:13:30.433 02:33:03 -- common/autotest_common.sh@10 -- # set +x 00:13:30.433 02:33:03 -- nvmf/common.sh@470 -- # nvmfpid=1514251 00:13:30.433 02:33:03 -- nvmf/common.sh@471 -- # waitforlisten 1514251 00:13:30.433 02:33:03 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:13:30.433 02:33:03 -- common/autotest_common.sh@817 -- # '[' -z 1514251 ']' 00:13:30.433 02:33:03 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:30.433 02:33:03 -- common/autotest_common.sh@822 -- # local max_retries=100 00:13:30.433 02:33:03 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:30.433 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:30.433 02:33:03 -- common/autotest_common.sh@826 -- # xtrace_disable 00:13:30.433 02:33:03 -- common/autotest_common.sh@10 -- # set +x 00:13:30.433 [2024-04-27 02:33:03.866196] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:13:30.433 [2024-04-27 02:33:03.866241] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:30.433 EAL: No free 2048 kB hugepages reported on node 1 00:13:30.433 [2024-04-27 02:33:03.937450] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:30.433 [2024-04-27 02:33:04.029915] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:30.433 [2024-04-27 02:33:04.029954] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:30.433 [2024-04-27 02:33:04.029964] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:13:30.433 [2024-04-27 02:33:04.029988] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:13:30.433 [2024-04-27 02:33:04.029996] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:30.433 [2024-04-27 02:33:04.030039] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:30.433 [2024-04-27 02:33:04.030063] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:30.433 [2024-04-27 02:33:04.030187] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:30.433 [2024-04-27 02:33:04.030188] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:13:31.366 02:33:04 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:13:31.366 02:33:04 -- common/autotest_common.sh@850 -- # return 0 00:13:31.366 02:33:04 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:13:31.366 02:33:04 -- common/autotest_common.sh@716 -- # xtrace_disable 00:13:31.366 02:33:04 -- common/autotest_common.sh@10 -- # set +x 00:13:31.366 02:33:04 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:31.366 02:33:04 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:13:31.366 02:33:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:31.366 02:33:04 -- common/autotest_common.sh@10 -- # set +x 00:13:31.366 [2024-04-27 02:33:04.791642] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x13037c0/0x1307cb0) succeed. 00:13:31.366 [2024-04-27 02:33:04.802234] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1304e00/0x1349340) succeed. 00:13:31.366 02:33:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:31.366 02:33:04 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:13:31.366 02:33:04 -- common/autotest_common.sh@710 -- # xtrace_disable 00:13:31.366 02:33:04 -- common/autotest_common.sh@10 -- # set +x 00:13:31.366 02:33:04 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:13:31.366 02:33:04 -- target/host_management.sh@23 -- # cat 00:13:31.366 02:33:04 -- target/host_management.sh@30 -- # rpc_cmd 00:13:31.366 02:33:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:31.366 02:33:04 -- common/autotest_common.sh@10 -- # set +x 00:13:31.366 Malloc0 00:13:31.625 [2024-04-27 02:33:04.993156] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:13:31.625 02:33:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:31.625 02:33:05 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:13:31.625 02:33:05 -- common/autotest_common.sh@716 -- # xtrace_disable 00:13:31.625 02:33:05 -- common/autotest_common.sh@10 -- # set +x 00:13:31.625 02:33:05 -- target/host_management.sh@73 -- # perfpid=1514694 00:13:31.625 02:33:05 -- target/host_management.sh@74 -- # waitforlisten 1514694 /var/tmp/bdevperf.sock 00:13:31.625 02:33:05 -- common/autotest_common.sh@817 -- # '[' -z 1514694 ']' 00:13:31.625 02:33:05 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:13:31.625 02:33:05 -- common/autotest_common.sh@822 -- # local max_retries=100 00:13:31.625 02:33:05 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:13:31.625 02:33:05 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:13:31.625 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:13:31.625 02:33:05 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:13:31.625 02:33:05 -- common/autotest_common.sh@826 -- # xtrace_disable 00:13:31.625 02:33:05 -- nvmf/common.sh@521 -- # config=() 00:13:31.625 02:33:05 -- common/autotest_common.sh@10 -- # set +x 00:13:31.625 02:33:05 -- nvmf/common.sh@521 -- # local subsystem config 00:13:31.625 02:33:05 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:13:31.625 02:33:05 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:13:31.625 { 00:13:31.625 "params": { 00:13:31.625 "name": "Nvme$subsystem", 00:13:31.625 "trtype": "$TEST_TRANSPORT", 00:13:31.625 "traddr": "$NVMF_FIRST_TARGET_IP", 00:13:31.625 "adrfam": "ipv4", 00:13:31.625 "trsvcid": "$NVMF_PORT", 00:13:31.625 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:13:31.625 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:13:31.625 "hdgst": ${hdgst:-false}, 00:13:31.625 "ddgst": ${ddgst:-false} 00:13:31.625 }, 00:13:31.625 "method": "bdev_nvme_attach_controller" 00:13:31.625 } 00:13:31.625 EOF 00:13:31.625 )") 00:13:31.625 02:33:05 -- nvmf/common.sh@543 -- # cat 00:13:31.625 02:33:05 -- nvmf/common.sh@545 -- # jq . 00:13:31.625 02:33:05 -- nvmf/common.sh@546 -- # IFS=, 00:13:31.625 02:33:05 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:13:31.625 "params": { 00:13:31.625 "name": "Nvme0", 00:13:31.625 "trtype": "rdma", 00:13:31.625 "traddr": "192.168.100.8", 00:13:31.625 "adrfam": "ipv4", 00:13:31.625 "trsvcid": "4420", 00:13:31.625 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:13:31.625 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:13:31.625 "hdgst": false, 00:13:31.625 "ddgst": false 00:13:31.625 }, 00:13:31.625 "method": "bdev_nvme_attach_controller" 00:13:31.625 }' 00:13:31.625 [2024-04-27 02:33:05.099065] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:13:31.625 [2024-04-27 02:33:05.099133] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1514694 ] 00:13:31.625 EAL: No free 2048 kB hugepages reported on node 1 00:13:31.625 [2024-04-27 02:33:05.176403] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:31.884 [2024-04-27 02:33:05.263700] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:31.884 Running I/O for 10 seconds... 00:13:32.450 02:33:05 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:13:32.450 02:33:05 -- common/autotest_common.sh@850 -- # return 0 00:13:32.450 02:33:05 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:13:32.450 02:33:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:32.450 02:33:05 -- common/autotest_common.sh@10 -- # set +x 00:13:32.450 02:33:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:32.450 02:33:05 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:13:32.450 02:33:05 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:13:32.450 02:33:05 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:13:32.450 02:33:05 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:13:32.450 02:33:05 -- target/host_management.sh@52 -- # local ret=1 00:13:32.450 02:33:05 -- target/host_management.sh@53 -- # local i 00:13:32.450 02:33:05 -- target/host_management.sh@54 -- # (( i = 10 )) 00:13:32.450 02:33:05 -- target/host_management.sh@54 -- # (( i != 0 )) 00:13:32.450 02:33:05 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:13:32.450 02:33:05 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:13:32.450 02:33:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:32.450 02:33:05 -- common/autotest_common.sh@10 -- # set +x 00:13:32.450 02:33:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:32.450 02:33:05 -- target/host_management.sh@55 -- # read_io_count=1515 00:13:32.450 02:33:06 -- target/host_management.sh@58 -- # '[' 1515 -ge 100 ']' 00:13:32.450 02:33:06 -- target/host_management.sh@59 -- # ret=0 00:13:32.450 02:33:06 -- target/host_management.sh@60 -- # break 00:13:32.450 02:33:06 -- target/host_management.sh@64 -- # return 0 00:13:32.450 02:33:06 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:13:32.450 02:33:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:32.450 02:33:06 -- common/autotest_common.sh@10 -- # set +x 00:13:32.450 02:33:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:32.450 02:33:06 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:13:32.450 02:33:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:32.450 02:33:06 -- common/autotest_common.sh@10 -- # set +x 00:13:32.450 02:33:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:32.450 02:33:06 -- target/host_management.sh@87 -- # sleep 1 00:13:33.827 [2024-04-27 02:33:07.015749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:81920 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000138da900 len:0x10000 key:0x182500 00:13:33.827 [2024-04-27 02:33:07.015786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.827 [2024-04-27 02:33:07.015806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:82048 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000138ca880 len:0x10000 key:0x182500 00:13:33.827 [2024-04-27 02:33:07.015816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.827 [2024-04-27 02:33:07.015828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:82176 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000138ba800 len:0x10000 key:0x182500 00:13:33.827 [2024-04-27 02:33:07.015838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.827 [2024-04-27 02:33:07.015849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:82304 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000138aa780 len:0x10000 key:0x182500 00:13:33.827 [2024-04-27 02:33:07.015859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.827 [2024-04-27 02:33:07.015870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:82432 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001389a700 len:0x10000 key:0x182500 00:13:33.827 [2024-04-27 02:33:07.015879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.827 [2024-04-27 02:33:07.015893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:82560 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001388a680 len:0x10000 key:0x182500 00:13:33.827 [2024-04-27 02:33:07.015903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.828 [2024-04-27 02:33:07.015914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:82688 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001387a600 len:0x10000 key:0x182500 00:13:33.828 [2024-04-27 02:33:07.015924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.828 [2024-04-27 02:33:07.015935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:82816 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001386a580 len:0x10000 key:0x182500 00:13:33.828 [2024-04-27 02:33:07.015944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.828 [2024-04-27 02:33:07.015955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:82944 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001385a500 len:0x10000 key:0x182500 00:13:33.828 [2024-04-27 02:33:07.015965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.828 [2024-04-27 02:33:07.015976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:83072 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001384a480 len:0x10000 key:0x182500 00:13:33.828 [2024-04-27 02:33:07.015986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.828 [2024-04-27 02:33:07.015996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:83200 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001383a400 len:0x10000 key:0x182500 00:13:33.828 [2024-04-27 02:33:07.016006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.828 [2024-04-27 02:33:07.016016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:83328 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001382a380 len:0x10000 key:0x182500 00:13:33.828 [2024-04-27 02:33:07.016026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.828 [2024-04-27 02:33:07.016036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:83456 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001381a300 len:0x10000 key:0x182500 00:13:33.828 [2024-04-27 02:33:07.016045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.828 [2024-04-27 02:33:07.016056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:83584 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001380a280 len:0x10000 key:0x182500 00:13:33.828 [2024-04-27 02:33:07.016066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.828 [2024-04-27 02:33:07.016077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:83712 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000192d1e80 len:0x10000 key:0x182800 00:13:33.828 [2024-04-27 02:33:07.016086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.828 [2024-04-27 02:33:07.016097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:83840 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000192c1e00 len:0x10000 key:0x182800 00:13:33.828 [2024-04-27 02:33:07.016106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.828 [2024-04-27 02:33:07.016118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:83968 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000192b1d80 len:0x10000 key:0x182800 00:13:33.828 [2024-04-27 02:33:07.016128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.828 [2024-04-27 02:33:07.016139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:84096 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000192a1d00 len:0x10000 key:0x182800 00:13:33.828 [2024-04-27 02:33:07.016149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.828 [2024-04-27 02:33:07.016160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:84224 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019291c80 len:0x10000 key:0x182800 00:13:33.828 [2024-04-27 02:33:07.016169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.828 [2024-04-27 02:33:07.016180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:84352 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019281c00 len:0x10000 key:0x182800 00:13:33.828 [2024-04-27 02:33:07.016190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.828 [2024-04-27 02:33:07.016201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:84480 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019271b80 len:0x10000 key:0x182800 00:13:33.828 [2024-04-27 02:33:07.016210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.828 [2024-04-27 02:33:07.016220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:84608 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019261b00 len:0x10000 key:0x182800 00:13:33.828 [2024-04-27 02:33:07.016230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.828 [2024-04-27 02:33:07.016241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:84736 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019251a80 len:0x10000 key:0x182800 00:13:33.828 [2024-04-27 02:33:07.016250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.828 [2024-04-27 02:33:07.016260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:84864 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019241a00 len:0x10000 key:0x182800 00:13:33.828 [2024-04-27 02:33:07.016270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.828 [2024-04-27 02:33:07.016281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:84992 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019231980 len:0x10000 key:0x182800 00:13:33.828 [2024-04-27 02:33:07.016290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.828 [2024-04-27 02:33:07.016301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:85120 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019221900 len:0x10000 key:0x182800 00:13:33.828 [2024-04-27 02:33:07.016310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.828 [2024-04-27 02:33:07.016321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:85248 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019211880 len:0x10000 key:0x182800 00:13:33.828 [2024-04-27 02:33:07.016330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.828 [2024-04-27 02:33:07.016346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:85376 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019201800 len:0x10000 key:0x182800 00:13:33.828 [2024-04-27 02:33:07.016357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.828 [2024-04-27 02:33:07.016368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:85504 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000190eff80 len:0x10000 key:0x182700 00:13:33.828 [2024-04-27 02:33:07.016377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.828 [2024-04-27 02:33:07.016388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:85632 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000190dff00 len:0x10000 key:0x182700 00:13:33.828 [2024-04-27 02:33:07.016397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.828 [2024-04-27 02:33:07.016408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:85760 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000190cfe80 len:0x10000 key:0x182700 00:13:33.828 [2024-04-27 02:33:07.016417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.828 [2024-04-27 02:33:07.016432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:85888 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000190bfe00 len:0x10000 key:0x182700 00:13:33.828 [2024-04-27 02:33:07.016441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.828 [2024-04-27 02:33:07.016452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:86016 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000190afd80 len:0x10000 key:0x182700 00:13:33.828 [2024-04-27 02:33:07.016461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.828 [2024-04-27 02:33:07.016474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:86144 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001909fd00 len:0x10000 key:0x182700 00:13:33.828 [2024-04-27 02:33:07.016483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.828 [2024-04-27 02:33:07.016495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:86272 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001908fc80 len:0x10000 key:0x182700 00:13:33.828 [2024-04-27 02:33:07.016504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.828 [2024-04-27 02:33:07.016515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:86400 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001907fc00 len:0x10000 key:0x182700 00:13:33.828 [2024-04-27 02:33:07.016524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.828 [2024-04-27 02:33:07.016535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:86528 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001906fb80 len:0x10000 key:0x182700 00:13:33.828 [2024-04-27 02:33:07.016545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.828 [2024-04-27 02:33:07.016556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:86656 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001905fb00 len:0x10000 key:0x182700 00:13:33.828 [2024-04-27 02:33:07.016565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.828 [2024-04-27 02:33:07.016576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:86784 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001904fa80 len:0x10000 key:0x182700 00:13:33.828 [2024-04-27 02:33:07.016586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.828 [2024-04-27 02:33:07.016598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:86912 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001903fa00 len:0x10000 key:0x182700 00:13:33.828 [2024-04-27 02:33:07.016607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.828 [2024-04-27 02:33:07.016618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:78848 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000bab4000 len:0x10000 key:0x182400 00:13:33.828 [2024-04-27 02:33:07.016628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.828 [2024-04-27 02:33:07.016639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:78976 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000bad5000 len:0x10000 key:0x182400 00:13:33.828 [2024-04-27 02:33:07.016648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.829 [2024-04-27 02:33:07.016659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:79104 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000be2f000 len:0x10000 key:0x182400 00:13:33.829 [2024-04-27 02:33:07.016668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.829 [2024-04-27 02:33:07.016679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:79232 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000be0e000 len:0x10000 key:0x182400 00:13:33.829 [2024-04-27 02:33:07.016689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.829 [2024-04-27 02:33:07.016700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:79360 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000bded000 len:0x10000 key:0x182400 00:13:33.829 [2024-04-27 02:33:07.016709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.829 [2024-04-27 02:33:07.016720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:79488 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000bdcc000 len:0x10000 key:0x182400 00:13:33.829 [2024-04-27 02:33:07.016729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.829 [2024-04-27 02:33:07.016740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:79616 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000bdab000 len:0x10000 key:0x182400 00:13:33.829 [2024-04-27 02:33:07.016749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.829 [2024-04-27 02:33:07.016762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:79744 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000bd8a000 len:0x10000 key:0x182400 00:13:33.829 [2024-04-27 02:33:07.016771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.829 [2024-04-27 02:33:07.016783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:79872 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d8ff000 len:0x10000 key:0x182400 00:13:33.829 [2024-04-27 02:33:07.016792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.829 [2024-04-27 02:33:07.016802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:80000 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d8de000 len:0x10000 key:0x182400 00:13:33.829 [2024-04-27 02:33:07.016812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.829 [2024-04-27 02:33:07.016823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:80128 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d8bd000 len:0x10000 key:0x182400 00:13:33.829 [2024-04-27 02:33:07.016834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.829 [2024-04-27 02:33:07.016845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:80256 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d89c000 len:0x10000 key:0x182400 00:13:33.829 [2024-04-27 02:33:07.016854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.829 [2024-04-27 02:33:07.016865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:80384 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d87b000 len:0x10000 key:0x182400 00:13:33.829 [2024-04-27 02:33:07.016874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.829 [2024-04-27 02:33:07.016886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:80512 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d85a000 len:0x10000 key:0x182400 00:13:33.829 [2024-04-27 02:33:07.016895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.829 [2024-04-27 02:33:07.016906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:80640 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d839000 len:0x10000 key:0x182400 00:13:33.829 [2024-04-27 02:33:07.016915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.829 [2024-04-27 02:33:07.016926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:80768 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d818000 len:0x10000 key:0x182400 00:13:33.829 [2024-04-27 02:33:07.016935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.829 [2024-04-27 02:33:07.016946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:80896 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d7f7000 len:0x10000 key:0x182400 00:13:33.829 [2024-04-27 02:33:07.016955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.829 [2024-04-27 02:33:07.016967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:81024 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d7d6000 len:0x10000 key:0x182400 00:13:33.829 [2024-04-27 02:33:07.016976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.829 [2024-04-27 02:33:07.016986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:81152 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d7b5000 len:0x10000 key:0x182400 00:13:33.829 [2024-04-27 02:33:07.016996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.829 [2024-04-27 02:33:07.017007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:81280 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d794000 len:0x10000 key:0x182400 00:13:33.829 [2024-04-27 02:33:07.017016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.829 [2024-04-27 02:33:07.017027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:81408 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d773000 len:0x10000 key:0x182400 00:13:33.829 [2024-04-27 02:33:07.017036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.829 [2024-04-27 02:33:07.017047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:81536 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d752000 len:0x10000 key:0x182400 00:13:33.829 [2024-04-27 02:33:07.017057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.829 [2024-04-27 02:33:07.017068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:81664 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d731000 len:0x10000 key:0x182400 00:13:33.829 [2024-04-27 02:33:07.017077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.829 [2024-04-27 02:33:07.017090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:81792 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d710000 len:0x10000 key:0x182400 00:13:33.829 [2024-04-27 02:33:07.017099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:33.829 [2024-04-27 02:33:07.019048] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192015c0 was disconnected and freed. reset controller. 00:13:33.829 [2024-04-27 02:33:07.019959] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:13:33.829 02:33:07 -- target/host_management.sh@91 -- # kill -9 1514694 00:13:33.829 02:33:07 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:13:33.829 02:33:07 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:13:33.829 02:33:07 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:13:33.829 02:33:07 -- nvmf/common.sh@521 -- # config=() 00:13:33.829 02:33:07 -- nvmf/common.sh@521 -- # local subsystem config 00:13:33.829 02:33:07 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:13:33.829 02:33:07 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:13:33.829 { 00:13:33.829 "params": { 00:13:33.829 "name": "Nvme$subsystem", 00:13:33.829 "trtype": "$TEST_TRANSPORT", 00:13:33.829 "traddr": "$NVMF_FIRST_TARGET_IP", 00:13:33.829 "adrfam": "ipv4", 00:13:33.829 "trsvcid": "$NVMF_PORT", 00:13:33.829 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:13:33.829 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:13:33.829 "hdgst": ${hdgst:-false}, 00:13:33.829 "ddgst": ${ddgst:-false} 00:13:33.829 }, 00:13:33.829 "method": "bdev_nvme_attach_controller" 00:13:33.829 } 00:13:33.829 EOF 00:13:33.829 )") 00:13:33.829 02:33:07 -- nvmf/common.sh@543 -- # cat 00:13:33.829 02:33:07 -- nvmf/common.sh@545 -- # jq . 00:13:33.829 02:33:07 -- nvmf/common.sh@546 -- # IFS=, 00:13:33.829 02:33:07 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:13:33.829 "params": { 00:13:33.829 "name": "Nvme0", 00:13:33.829 "trtype": "rdma", 00:13:33.829 "traddr": "192.168.100.8", 00:13:33.829 "adrfam": "ipv4", 00:13:33.829 "trsvcid": "4420", 00:13:33.829 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:13:33.829 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:13:33.829 "hdgst": false, 00:13:33.829 "ddgst": false 00:13:33.829 }, 00:13:33.829 "method": "bdev_nvme_attach_controller" 00:13:33.829 }' 00:13:33.829 [2024-04-27 02:33:07.072497] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:13:33.829 [2024-04-27 02:33:07.072555] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1515046 ] 00:13:33.829 EAL: No free 2048 kB hugepages reported on node 1 00:13:33.829 [2024-04-27 02:33:07.145005] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:33.829 [2024-04-27 02:33:07.226073] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:33.829 Running I/O for 1 seconds... 00:13:35.206 00:13:35.206 Latency(us) 00:13:35.206 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:35.206 Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:13:35.206 Verification LBA range: start 0x0 length 0x400 00:13:35.206 Nvme0n1 : 1.01 3028.77 189.30 0.00 0.00 20696.79 701.66 43310.75 00:13:35.206 =================================================================================================================== 00:13:35.206 Total : 3028.77 189.30 0.00 0.00 20696.79 701.66 43310.75 00:13:35.206 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 68: 1514694 Killed $rootdir/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "0") -q 64 -o 65536 -w verify -t 10 "${NO_HUGE[@]}" 00:13:35.206 02:33:08 -- target/host_management.sh@102 -- # stoptarget 00:13:35.206 02:33:08 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:13:35.206 02:33:08 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:13:35.206 02:33:08 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:13:35.206 02:33:08 -- target/host_management.sh@40 -- # nvmftestfini 00:13:35.206 02:33:08 -- nvmf/common.sh@477 -- # nvmfcleanup 00:13:35.206 02:33:08 -- nvmf/common.sh@117 -- # sync 00:13:35.206 02:33:08 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:13:35.206 02:33:08 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:13:35.206 02:33:08 -- nvmf/common.sh@120 -- # set +e 00:13:35.206 02:33:08 -- nvmf/common.sh@121 -- # for i in {1..20} 00:13:35.206 02:33:08 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:13:35.206 rmmod nvme_rdma 00:13:35.206 rmmod nvme_fabrics 00:13:35.206 02:33:08 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:13:35.206 02:33:08 -- nvmf/common.sh@124 -- # set -e 00:13:35.206 02:33:08 -- nvmf/common.sh@125 -- # return 0 00:13:35.206 02:33:08 -- nvmf/common.sh@478 -- # '[' -n 1514251 ']' 00:13:35.206 02:33:08 -- nvmf/common.sh@479 -- # killprocess 1514251 00:13:35.206 02:33:08 -- common/autotest_common.sh@936 -- # '[' -z 1514251 ']' 00:13:35.206 02:33:08 -- common/autotest_common.sh@940 -- # kill -0 1514251 00:13:35.206 02:33:08 -- common/autotest_common.sh@941 -- # uname 00:13:35.207 02:33:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:35.207 02:33:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1514251 00:13:35.207 02:33:08 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:35.207 02:33:08 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:35.207 02:33:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1514251' 00:13:35.207 killing process with pid 1514251 00:13:35.207 02:33:08 -- common/autotest_common.sh@955 -- # kill 1514251 00:13:35.207 02:33:08 -- common/autotest_common.sh@960 -- # wait 1514251 00:13:35.465 [2024-04-27 02:33:08.883012] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:13:35.724 [2024-04-27 02:33:09.115189] app.c: 630:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:13:35.724 02:33:09 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:13:35.724 02:33:09 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:13:35.724 00:13:35.724 real 0m5.332s 00:13:35.724 user 0m23.651s 00:13:35.724 sys 0m1.076s 00:13:35.724 02:33:09 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:13:35.724 02:33:09 -- common/autotest_common.sh@10 -- # set +x 00:13:35.724 ************************************ 00:13:35.724 END TEST nvmf_host_management 00:13:35.724 ************************************ 00:13:35.724 02:33:09 -- target/host_management.sh@109 -- # trap - SIGINT SIGTERM EXIT 00:13:35.724 00:13:35.724 real 0m11.951s 00:13:35.724 user 0m25.547s 00:13:35.724 sys 0m5.994s 00:13:35.724 02:33:09 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:13:35.725 02:33:09 -- common/autotest_common.sh@10 -- # set +x 00:13:35.725 ************************************ 00:13:35.725 END TEST nvmf_host_management 00:13:35.725 ************************************ 00:13:35.725 02:33:09 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=rdma 00:13:35.725 02:33:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:35.725 02:33:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:35.725 02:33:09 -- common/autotest_common.sh@10 -- # set +x 00:13:35.984 ************************************ 00:13:35.984 START TEST nvmf_lvol 00:13:35.984 ************************************ 00:13:35.984 02:33:09 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=rdma 00:13:35.984 * Looking for test storage... 00:13:35.984 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:13:35.984 02:33:09 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:13:35.984 02:33:09 -- nvmf/common.sh@7 -- # uname -s 00:13:35.984 02:33:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:35.984 02:33:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:35.984 02:33:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:35.984 02:33:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:35.984 02:33:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:35.984 02:33:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:35.984 02:33:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:35.984 02:33:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:35.984 02:33:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:35.984 02:33:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:35.984 02:33:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:13:35.984 02:33:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:13:35.984 02:33:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:35.984 02:33:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:35.984 02:33:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:35.984 02:33:09 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:13:35.984 02:33:09 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:13:35.984 02:33:09 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:35.984 02:33:09 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:35.984 02:33:09 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:35.984 02:33:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:35.984 02:33:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:35.984 02:33:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:35.984 02:33:09 -- paths/export.sh@5 -- # export PATH 00:13:35.984 02:33:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:35.984 02:33:09 -- nvmf/common.sh@47 -- # : 0 00:13:35.984 02:33:09 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:13:35.984 02:33:09 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:13:35.984 02:33:09 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:13:35.984 02:33:09 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:35.984 02:33:09 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:35.984 02:33:09 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:13:35.984 02:33:09 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:13:35.984 02:33:09 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:13:35.984 02:33:09 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:35.984 02:33:09 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:35.984 02:33:09 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:13:35.984 02:33:09 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:13:35.984 02:33:09 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:13:35.984 02:33:09 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:13:35.984 02:33:09 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:13:35.984 02:33:09 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:35.984 02:33:09 -- nvmf/common.sh@437 -- # prepare_net_devs 00:13:35.984 02:33:09 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:13:35.984 02:33:09 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:13:35.984 02:33:09 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:35.984 02:33:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:35.984 02:33:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:35.984 02:33:09 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:13:35.984 02:33:09 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:13:35.984 02:33:09 -- nvmf/common.sh@285 -- # xtrace_disable 00:13:35.984 02:33:09 -- common/autotest_common.sh@10 -- # set +x 00:13:42.543 02:33:15 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:42.543 02:33:15 -- nvmf/common.sh@291 -- # pci_devs=() 00:13:42.543 02:33:15 -- nvmf/common.sh@291 -- # local -a pci_devs 00:13:42.543 02:33:15 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:13:42.543 02:33:15 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:13:42.543 02:33:15 -- nvmf/common.sh@293 -- # pci_drivers=() 00:13:42.543 02:33:15 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:13:42.543 02:33:15 -- nvmf/common.sh@295 -- # net_devs=() 00:13:42.543 02:33:15 -- nvmf/common.sh@295 -- # local -ga net_devs 00:13:42.543 02:33:15 -- nvmf/common.sh@296 -- # e810=() 00:13:42.543 02:33:15 -- nvmf/common.sh@296 -- # local -ga e810 00:13:42.543 02:33:15 -- nvmf/common.sh@297 -- # x722=() 00:13:42.543 02:33:15 -- nvmf/common.sh@297 -- # local -ga x722 00:13:42.543 02:33:15 -- nvmf/common.sh@298 -- # mlx=() 00:13:42.543 02:33:15 -- nvmf/common.sh@298 -- # local -ga mlx 00:13:42.543 02:33:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:42.543 02:33:15 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:42.543 02:33:15 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:42.543 02:33:15 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:42.543 02:33:15 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:42.543 02:33:15 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:42.543 02:33:15 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:42.543 02:33:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:42.543 02:33:15 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:42.543 02:33:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:42.543 02:33:15 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:42.543 02:33:15 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:13:42.543 02:33:15 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:13:42.543 02:33:15 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:13:42.543 02:33:15 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:13:42.543 02:33:15 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:13:42.543 02:33:15 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:13:42.543 02:33:15 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:13:42.543 02:33:15 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:42.543 02:33:15 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:13:42.543 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:13:42.543 02:33:15 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:13:42.543 02:33:15 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:13:42.543 02:33:15 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:13:42.543 02:33:15 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:13:42.543 02:33:15 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:13:42.543 02:33:15 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:13:42.543 02:33:15 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:42.543 02:33:15 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:13:42.543 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:13:42.543 02:33:15 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:13:42.543 02:33:15 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:13:42.543 02:33:15 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:13:42.543 02:33:15 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:13:42.543 02:33:15 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:13:42.543 02:33:15 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:13:42.543 02:33:15 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:13:42.543 02:33:15 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:13:42.543 02:33:15 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:42.543 02:33:15 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:42.543 02:33:15 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:42.543 02:33:15 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:42.543 02:33:15 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:13:42.543 Found net devices under 0000:18:00.0: mlx_0_0 00:13:42.543 02:33:15 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:42.543 02:33:15 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:42.543 02:33:15 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:42.543 02:33:15 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:42.543 02:33:15 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:42.543 02:33:15 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:13:42.543 Found net devices under 0000:18:00.1: mlx_0_1 00:13:42.543 02:33:15 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:42.543 02:33:15 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:13:42.543 02:33:15 -- nvmf/common.sh@403 -- # is_hw=yes 00:13:42.543 02:33:15 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:13:42.543 02:33:15 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:13:42.543 02:33:15 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:13:42.543 02:33:15 -- nvmf/common.sh@409 -- # rdma_device_init 00:13:42.543 02:33:15 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:13:42.543 02:33:15 -- nvmf/common.sh@58 -- # uname 00:13:42.543 02:33:15 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:13:42.543 02:33:15 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:13:42.543 02:33:15 -- nvmf/common.sh@63 -- # modprobe ib_core 00:13:42.543 02:33:15 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:13:42.543 02:33:15 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:13:42.543 02:33:15 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:13:42.543 02:33:15 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:13:42.543 02:33:15 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:13:42.543 02:33:15 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:13:42.543 02:33:15 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:13:42.543 02:33:15 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:13:42.543 02:33:15 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:13:42.543 02:33:15 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:13:42.543 02:33:15 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:13:42.543 02:33:15 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:13:42.543 02:33:15 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:13:42.543 02:33:15 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:42.543 02:33:15 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:42.543 02:33:15 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:13:42.543 02:33:15 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:13:42.543 02:33:15 -- nvmf/common.sh@105 -- # continue 2 00:13:42.543 02:33:15 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:42.543 02:33:15 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:42.543 02:33:15 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:13:42.543 02:33:15 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:42.543 02:33:15 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:13:42.543 02:33:15 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:13:42.543 02:33:15 -- nvmf/common.sh@105 -- # continue 2 00:13:42.543 02:33:15 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:13:42.543 02:33:15 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:13:42.543 02:33:15 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:13:42.543 02:33:15 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:42.543 02:33:15 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:13:42.543 02:33:15 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:42.543 02:33:15 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:13:42.543 02:33:15 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:13:42.544 02:33:15 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:13:42.544 60: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:13:42.544 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:13:42.544 altname enp24s0f0np0 00:13:42.544 altname ens785f0np0 00:13:42.544 inet 192.168.100.8/24 scope global mlx_0_0 00:13:42.544 valid_lft forever preferred_lft forever 00:13:42.544 02:33:15 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:13:42.544 02:33:15 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:13:42.544 02:33:15 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:13:42.544 02:33:15 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:42.544 02:33:15 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:13:42.544 02:33:15 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:42.544 02:33:15 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:13:42.544 02:33:15 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:13:42.544 02:33:15 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:13:42.544 61: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:13:42.544 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:13:42.544 altname enp24s0f1np1 00:13:42.544 altname ens785f1np1 00:13:42.544 inet 192.168.100.9/24 scope global mlx_0_1 00:13:42.544 valid_lft forever preferred_lft forever 00:13:42.544 02:33:15 -- nvmf/common.sh@411 -- # return 0 00:13:42.544 02:33:15 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:13:42.544 02:33:15 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:13:42.544 02:33:15 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:13:42.544 02:33:15 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:13:42.544 02:33:15 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:13:42.544 02:33:15 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:13:42.544 02:33:15 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:13:42.544 02:33:15 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:13:42.544 02:33:15 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:13:42.544 02:33:15 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:13:42.544 02:33:15 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:42.544 02:33:15 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:42.544 02:33:15 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:13:42.544 02:33:15 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:13:42.544 02:33:15 -- nvmf/common.sh@105 -- # continue 2 00:13:42.544 02:33:15 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:42.544 02:33:15 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:42.544 02:33:15 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:13:42.544 02:33:15 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:42.544 02:33:15 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:13:42.544 02:33:15 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:13:42.544 02:33:15 -- nvmf/common.sh@105 -- # continue 2 00:13:42.544 02:33:15 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:13:42.544 02:33:15 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:13:42.544 02:33:15 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:13:42.544 02:33:15 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:42.544 02:33:15 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:13:42.544 02:33:15 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:42.544 02:33:15 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:13:42.544 02:33:15 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:13:42.544 02:33:15 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:13:42.544 02:33:15 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:42.544 02:33:15 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:13:42.544 02:33:15 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:42.544 02:33:15 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:13:42.544 192.168.100.9' 00:13:42.544 02:33:15 -- nvmf/common.sh@446 -- # head -n 1 00:13:42.544 02:33:15 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:13:42.544 192.168.100.9' 00:13:42.544 02:33:15 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:13:42.544 02:33:15 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:13:42.544 192.168.100.9' 00:13:42.544 02:33:15 -- nvmf/common.sh@447 -- # tail -n +2 00:13:42.544 02:33:15 -- nvmf/common.sh@447 -- # head -n 1 00:13:42.544 02:33:15 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:13:42.544 02:33:15 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:13:42.544 02:33:15 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:13:42.544 02:33:15 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:13:42.544 02:33:15 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:13:42.544 02:33:15 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:13:42.544 02:33:15 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:13:42.544 02:33:15 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:13:42.544 02:33:15 -- common/autotest_common.sh@710 -- # xtrace_disable 00:13:42.544 02:33:15 -- common/autotest_common.sh@10 -- # set +x 00:13:42.544 02:33:15 -- nvmf/common.sh@470 -- # nvmfpid=1518160 00:13:42.544 02:33:15 -- nvmf/common.sh@471 -- # waitforlisten 1518160 00:13:42.544 02:33:15 -- common/autotest_common.sh@817 -- # '[' -z 1518160 ']' 00:13:42.544 02:33:15 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:42.544 02:33:15 -- common/autotest_common.sh@822 -- # local max_retries=100 00:13:42.544 02:33:15 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:42.544 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:42.544 02:33:15 -- common/autotest_common.sh@826 -- # xtrace_disable 00:13:42.544 02:33:15 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:13:42.544 02:33:15 -- common/autotest_common.sh@10 -- # set +x 00:13:42.544 [2024-04-27 02:33:15.488450] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:13:42.544 [2024-04-27 02:33:15.488505] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:42.544 EAL: No free 2048 kB hugepages reported on node 1 00:13:42.544 [2024-04-27 02:33:15.560117] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:42.544 [2024-04-27 02:33:15.646500] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:42.544 [2024-04-27 02:33:15.646538] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:42.544 [2024-04-27 02:33:15.646548] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:13:42.544 [2024-04-27 02:33:15.646572] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:13:42.544 [2024-04-27 02:33:15.646579] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:42.544 [2024-04-27 02:33:15.646626] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:42.544 [2024-04-27 02:33:15.646710] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:42.544 [2024-04-27 02:33:15.646712] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:42.801 02:33:16 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:13:42.801 02:33:16 -- common/autotest_common.sh@850 -- # return 0 00:13:42.801 02:33:16 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:13:42.801 02:33:16 -- common/autotest_common.sh@716 -- # xtrace_disable 00:13:42.801 02:33:16 -- common/autotest_common.sh@10 -- # set +x 00:13:42.801 02:33:16 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:42.801 02:33:16 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:13:43.058 [2024-04-27 02:33:16.518104] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x14a2a30/0x14a6f20) succeed. 00:13:43.058 [2024-04-27 02:33:16.528376] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x14a3fd0/0x14e85b0) succeed. 00:13:43.058 02:33:16 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:13:43.316 02:33:16 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:13:43.316 02:33:16 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:13:43.573 02:33:17 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:13:43.573 02:33:17 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:13:43.830 02:33:17 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:13:43.830 02:33:17 -- target/nvmf_lvol.sh@29 -- # lvs=2d3e15f6-c710-4c06-9e91-7b900d47930d 00:13:43.830 02:33:17 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 2d3e15f6-c710-4c06-9e91-7b900d47930d lvol 20 00:13:44.087 02:33:17 -- target/nvmf_lvol.sh@32 -- # lvol=18b210f6-97a5-46e1-9e25-591fe83b1ee0 00:13:44.087 02:33:17 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:13:44.344 02:33:17 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 18b210f6-97a5-46e1-9e25-591fe83b1ee0 00:13:44.344 02:33:17 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:13:44.601 [2024-04-27 02:33:18.105891] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:13:44.601 02:33:18 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:13:44.859 02:33:18 -- target/nvmf_lvol.sh@42 -- # perf_pid=1518562 00:13:44.859 02:33:18 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:13:44.859 02:33:18 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:13:44.859 EAL: No free 2048 kB hugepages reported on node 1 00:13:45.791 02:33:19 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot 18b210f6-97a5-46e1-9e25-591fe83b1ee0 MY_SNAPSHOT 00:13:46.048 02:33:19 -- target/nvmf_lvol.sh@47 -- # snapshot=bda3eb67-3000-42dc-91ef-0358f5ca70b0 00:13:46.048 02:33:19 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize 18b210f6-97a5-46e1-9e25-591fe83b1ee0 30 00:13:46.306 02:33:19 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone bda3eb67-3000-42dc-91ef-0358f5ca70b0 MY_CLONE 00:13:46.306 02:33:19 -- target/nvmf_lvol.sh@49 -- # clone=72c28231-efaf-4e65-a5a2-1494e9e4f7ae 00:13:46.306 02:33:19 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate 72c28231-efaf-4e65-a5a2-1494e9e4f7ae 00:13:46.563 02:33:20 -- target/nvmf_lvol.sh@53 -- # wait 1518562 00:13:56.589 Initializing NVMe Controllers 00:13:56.589 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode0 00:13:56.589 Controller IO queue size 128, less than required. 00:13:56.589 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:56.589 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:13:56.589 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:13:56.589 Initialization complete. Launching workers. 00:13:56.589 ======================================================== 00:13:56.589 Latency(us) 00:13:56.589 Device Information : IOPS MiB/s Average min max 00:13:56.589 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 16704.90 65.25 7664.40 2393.22 38917.79 00:13:56.589 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 16808.00 65.66 7616.98 3555.65 47933.85 00:13:56.589 ======================================================== 00:13:56.589 Total : 33512.90 130.91 7640.62 2393.22 47933.85 00:13:56.589 00:13:56.589 02:33:29 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:13:56.589 02:33:29 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 18b210f6-97a5-46e1-9e25-591fe83b1ee0 00:13:56.589 02:33:30 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 2d3e15f6-c710-4c06-9e91-7b900d47930d 00:13:56.845 02:33:30 -- target/nvmf_lvol.sh@60 -- # rm -f 00:13:56.845 02:33:30 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:13:56.845 02:33:30 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:13:56.845 02:33:30 -- nvmf/common.sh@477 -- # nvmfcleanup 00:13:56.845 02:33:30 -- nvmf/common.sh@117 -- # sync 00:13:56.845 02:33:30 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:13:56.845 02:33:30 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:13:56.845 02:33:30 -- nvmf/common.sh@120 -- # set +e 00:13:56.845 02:33:30 -- nvmf/common.sh@121 -- # for i in {1..20} 00:13:56.845 02:33:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:13:56.845 rmmod nvme_rdma 00:13:56.845 rmmod nvme_fabrics 00:13:56.845 02:33:30 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:13:56.845 02:33:30 -- nvmf/common.sh@124 -- # set -e 00:13:56.845 02:33:30 -- nvmf/common.sh@125 -- # return 0 00:13:56.845 02:33:30 -- nvmf/common.sh@478 -- # '[' -n 1518160 ']' 00:13:56.845 02:33:30 -- nvmf/common.sh@479 -- # killprocess 1518160 00:13:56.845 02:33:30 -- common/autotest_common.sh@936 -- # '[' -z 1518160 ']' 00:13:56.845 02:33:30 -- common/autotest_common.sh@940 -- # kill -0 1518160 00:13:56.845 02:33:30 -- common/autotest_common.sh@941 -- # uname 00:13:56.845 02:33:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:56.845 02:33:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1518160 00:13:56.845 02:33:30 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:56.845 02:33:30 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:56.845 02:33:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1518160' 00:13:56.845 killing process with pid 1518160 00:13:56.845 02:33:30 -- common/autotest_common.sh@955 -- # kill 1518160 00:13:56.845 02:33:30 -- common/autotest_common.sh@960 -- # wait 1518160 00:13:57.103 [2024-04-27 02:33:30.469514] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:13:57.362 02:33:30 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:13:57.362 02:33:30 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:13:57.362 00:13:57.362 real 0m21.358s 00:13:57.362 user 1m11.309s 00:13:57.362 sys 0m5.806s 00:13:57.362 02:33:30 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:13:57.362 02:33:30 -- common/autotest_common.sh@10 -- # set +x 00:13:57.362 ************************************ 00:13:57.362 END TEST nvmf_lvol 00:13:57.362 ************************************ 00:13:57.362 02:33:30 -- nvmf/nvmf.sh@49 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=rdma 00:13:57.362 02:33:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:57.362 02:33:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:57.362 02:33:30 -- common/autotest_common.sh@10 -- # set +x 00:13:57.362 ************************************ 00:13:57.362 START TEST nvmf_lvs_grow 00:13:57.362 ************************************ 00:13:57.362 02:33:30 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=rdma 00:13:57.620 * Looking for test storage... 00:13:57.620 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:13:57.620 02:33:31 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:13:57.620 02:33:31 -- nvmf/common.sh@7 -- # uname -s 00:13:57.620 02:33:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:57.620 02:33:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:57.620 02:33:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:57.620 02:33:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:57.620 02:33:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:57.620 02:33:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:57.620 02:33:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:57.620 02:33:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:57.620 02:33:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:57.620 02:33:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:57.620 02:33:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:13:57.620 02:33:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:13:57.620 02:33:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:57.620 02:33:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:57.620 02:33:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:57.620 02:33:31 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:13:57.620 02:33:31 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:13:57.620 02:33:31 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:57.620 02:33:31 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:57.620 02:33:31 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:57.620 02:33:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:57.620 02:33:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:57.620 02:33:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:57.620 02:33:31 -- paths/export.sh@5 -- # export PATH 00:13:57.620 02:33:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:57.620 02:33:31 -- nvmf/common.sh@47 -- # : 0 00:13:57.620 02:33:31 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:13:57.620 02:33:31 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:13:57.620 02:33:31 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:13:57.620 02:33:31 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:57.620 02:33:31 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:57.620 02:33:31 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:13:57.620 02:33:31 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:13:57.620 02:33:31 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:13:57.620 02:33:31 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:13:57.620 02:33:31 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:13:57.620 02:33:31 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:13:57.620 02:33:31 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:13:57.620 02:33:31 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:57.620 02:33:31 -- nvmf/common.sh@437 -- # prepare_net_devs 00:13:57.620 02:33:31 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:13:57.620 02:33:31 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:13:57.620 02:33:31 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:57.620 02:33:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:57.621 02:33:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:57.621 02:33:31 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:13:57.621 02:33:31 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:13:57.621 02:33:31 -- nvmf/common.sh@285 -- # xtrace_disable 00:13:57.621 02:33:31 -- common/autotest_common.sh@10 -- # set +x 00:14:04.190 02:33:37 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:04.190 02:33:37 -- nvmf/common.sh@291 -- # pci_devs=() 00:14:04.190 02:33:37 -- nvmf/common.sh@291 -- # local -a pci_devs 00:14:04.190 02:33:37 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:14:04.190 02:33:37 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:14:04.190 02:33:37 -- nvmf/common.sh@293 -- # pci_drivers=() 00:14:04.190 02:33:37 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:14:04.190 02:33:37 -- nvmf/common.sh@295 -- # net_devs=() 00:14:04.190 02:33:37 -- nvmf/common.sh@295 -- # local -ga net_devs 00:14:04.190 02:33:37 -- nvmf/common.sh@296 -- # e810=() 00:14:04.190 02:33:37 -- nvmf/common.sh@296 -- # local -ga e810 00:14:04.190 02:33:37 -- nvmf/common.sh@297 -- # x722=() 00:14:04.190 02:33:37 -- nvmf/common.sh@297 -- # local -ga x722 00:14:04.190 02:33:37 -- nvmf/common.sh@298 -- # mlx=() 00:14:04.190 02:33:37 -- nvmf/common.sh@298 -- # local -ga mlx 00:14:04.190 02:33:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:04.190 02:33:37 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:04.190 02:33:37 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:04.190 02:33:37 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:04.190 02:33:37 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:04.190 02:33:37 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:04.190 02:33:37 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:04.190 02:33:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:04.190 02:33:37 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:04.190 02:33:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:04.190 02:33:37 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:04.190 02:33:37 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:14:04.190 02:33:37 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:14:04.190 02:33:37 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:14:04.190 02:33:37 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:14:04.190 02:33:37 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:14:04.190 02:33:37 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:14:04.190 02:33:37 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:14:04.190 02:33:37 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:04.190 02:33:37 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:14:04.190 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:14:04.190 02:33:37 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:14:04.190 02:33:37 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:14:04.190 02:33:37 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:14:04.190 02:33:37 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:14:04.190 02:33:37 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:04.190 02:33:37 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:04.190 02:33:37 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:04.190 02:33:37 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:14:04.190 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:14:04.190 02:33:37 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:14:04.190 02:33:37 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:14:04.190 02:33:37 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:14:04.190 02:33:37 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:14:04.190 02:33:37 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:04.190 02:33:37 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:04.190 02:33:37 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:14:04.190 02:33:37 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:14:04.190 02:33:37 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:04.191 02:33:37 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:04.191 02:33:37 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:04.191 02:33:37 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:04.191 02:33:37 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:14:04.191 Found net devices under 0000:18:00.0: mlx_0_0 00:14:04.191 02:33:37 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:04.191 02:33:37 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:04.191 02:33:37 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:04.191 02:33:37 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:04.191 02:33:37 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:04.191 02:33:37 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:14:04.191 Found net devices under 0000:18:00.1: mlx_0_1 00:14:04.191 02:33:37 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:04.191 02:33:37 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:14:04.191 02:33:37 -- nvmf/common.sh@403 -- # is_hw=yes 00:14:04.191 02:33:37 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:14:04.191 02:33:37 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:14:04.191 02:33:37 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:14:04.191 02:33:37 -- nvmf/common.sh@409 -- # rdma_device_init 00:14:04.191 02:33:37 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:14:04.191 02:33:37 -- nvmf/common.sh@58 -- # uname 00:14:04.191 02:33:37 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:14:04.191 02:33:37 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:14:04.191 02:33:37 -- nvmf/common.sh@63 -- # modprobe ib_core 00:14:04.191 02:33:37 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:14:04.191 02:33:37 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:14:04.191 02:33:37 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:14:04.191 02:33:37 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:14:04.191 02:33:37 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:14:04.191 02:33:37 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:14:04.191 02:33:37 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:14:04.191 02:33:37 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:14:04.191 02:33:37 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:04.191 02:33:37 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:04.191 02:33:37 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:04.191 02:33:37 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:04.191 02:33:37 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:04.191 02:33:37 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:04.191 02:33:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:04.191 02:33:37 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:14:04.191 02:33:37 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:14:04.191 02:33:37 -- nvmf/common.sh@105 -- # continue 2 00:14:04.191 02:33:37 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:04.191 02:33:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:04.191 02:33:37 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:14:04.191 02:33:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:04.191 02:33:37 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:14:04.191 02:33:37 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:14:04.191 02:33:37 -- nvmf/common.sh@105 -- # continue 2 00:14:04.191 02:33:37 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:04.191 02:33:37 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:14:04.191 02:33:37 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:14:04.191 02:33:37 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:14:04.191 02:33:37 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:04.191 02:33:37 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:04.191 02:33:37 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:14:04.191 02:33:37 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:14:04.191 02:33:37 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:14:04.191 60: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:14:04.191 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:14:04.191 altname enp24s0f0np0 00:14:04.191 altname ens785f0np0 00:14:04.191 inet 192.168.100.8/24 scope global mlx_0_0 00:14:04.191 valid_lft forever preferred_lft forever 00:14:04.191 02:33:37 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:04.191 02:33:37 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:14:04.191 02:33:37 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:14:04.191 02:33:37 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:14:04.191 02:33:37 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:04.191 02:33:37 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:04.191 02:33:37 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:14:04.191 02:33:37 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:14:04.191 02:33:37 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:14:04.191 61: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:14:04.191 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:14:04.191 altname enp24s0f1np1 00:14:04.191 altname ens785f1np1 00:14:04.191 inet 192.168.100.9/24 scope global mlx_0_1 00:14:04.191 valid_lft forever preferred_lft forever 00:14:04.191 02:33:37 -- nvmf/common.sh@411 -- # return 0 00:14:04.191 02:33:37 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:14:04.191 02:33:37 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:14:04.191 02:33:37 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:14:04.191 02:33:37 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:14:04.191 02:33:37 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:14:04.191 02:33:37 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:04.191 02:33:37 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:04.191 02:33:37 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:04.191 02:33:37 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:04.191 02:33:37 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:04.191 02:33:37 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:04.191 02:33:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:04.191 02:33:37 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:14:04.191 02:33:37 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:14:04.191 02:33:37 -- nvmf/common.sh@105 -- # continue 2 00:14:04.191 02:33:37 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:04.191 02:33:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:04.191 02:33:37 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:14:04.191 02:33:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:04.191 02:33:37 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:14:04.191 02:33:37 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:14:04.191 02:33:37 -- nvmf/common.sh@105 -- # continue 2 00:14:04.191 02:33:37 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:04.191 02:33:37 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:14:04.191 02:33:37 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:14:04.191 02:33:37 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:14:04.191 02:33:37 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:04.191 02:33:37 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:04.191 02:33:37 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:04.191 02:33:37 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:14:04.191 02:33:37 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:14:04.191 02:33:37 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:14:04.191 02:33:37 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:04.191 02:33:37 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:04.191 02:33:37 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:14:04.191 192.168.100.9' 00:14:04.191 02:33:37 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:14:04.191 192.168.100.9' 00:14:04.191 02:33:37 -- nvmf/common.sh@446 -- # head -n 1 00:14:04.191 02:33:37 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:14:04.191 02:33:37 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:14:04.191 192.168.100.9' 00:14:04.191 02:33:37 -- nvmf/common.sh@447 -- # tail -n +2 00:14:04.191 02:33:37 -- nvmf/common.sh@447 -- # head -n 1 00:14:04.191 02:33:37 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:14:04.191 02:33:37 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:14:04.191 02:33:37 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:14:04.191 02:33:37 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:14:04.191 02:33:37 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:14:04.191 02:33:37 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:14:04.191 02:33:37 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:14:04.191 02:33:37 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:14:04.191 02:33:37 -- common/autotest_common.sh@710 -- # xtrace_disable 00:14:04.191 02:33:37 -- common/autotest_common.sh@10 -- # set +x 00:14:04.191 02:33:37 -- nvmf/common.sh@470 -- # nvmfpid=1523103 00:14:04.191 02:33:37 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:14:04.191 02:33:37 -- nvmf/common.sh@471 -- # waitforlisten 1523103 00:14:04.191 02:33:37 -- common/autotest_common.sh@817 -- # '[' -z 1523103 ']' 00:14:04.191 02:33:37 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:04.191 02:33:37 -- common/autotest_common.sh@822 -- # local max_retries=100 00:14:04.191 02:33:37 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:04.191 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:04.191 02:33:37 -- common/autotest_common.sh@826 -- # xtrace_disable 00:14:04.191 02:33:37 -- common/autotest_common.sh@10 -- # set +x 00:14:04.191 [2024-04-27 02:33:37.355484] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:14:04.191 [2024-04-27 02:33:37.355551] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:04.191 EAL: No free 2048 kB hugepages reported on node 1 00:14:04.191 [2024-04-27 02:33:37.426465] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:04.191 [2024-04-27 02:33:37.514028] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:04.191 [2024-04-27 02:33:37.514064] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:04.191 [2024-04-27 02:33:37.514074] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:04.191 [2024-04-27 02:33:37.514083] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:04.191 [2024-04-27 02:33:37.514091] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:04.191 [2024-04-27 02:33:37.514115] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:04.759 02:33:38 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:14:04.759 02:33:38 -- common/autotest_common.sh@850 -- # return 0 00:14:04.759 02:33:38 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:14:04.759 02:33:38 -- common/autotest_common.sh@716 -- # xtrace_disable 00:14:04.759 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:14:04.759 02:33:38 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:04.759 02:33:38 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:14:05.017 [2024-04-27 02:33:38.387297] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x97d3e0/0x9818d0) succeed. 00:14:05.017 [2024-04-27 02:33:38.396253] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x97e8e0/0x9c2f60) succeed. 00:14:05.017 02:33:38 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:14:05.017 02:33:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:14:05.017 02:33:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:05.017 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:14:05.017 ************************************ 00:14:05.017 START TEST lvs_grow_clean 00:14:05.017 ************************************ 00:14:05.017 02:33:38 -- common/autotest_common.sh@1111 -- # lvs_grow 00:14:05.017 02:33:38 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:14:05.017 02:33:38 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:14:05.017 02:33:38 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:14:05.017 02:33:38 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:14:05.017 02:33:38 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:14:05.017 02:33:38 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:14:05.017 02:33:38 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:05.017 02:33:38 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:05.276 02:33:38 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:05.276 02:33:38 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:14:05.276 02:33:38 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:14:05.534 02:33:39 -- target/nvmf_lvs_grow.sh@28 -- # lvs=92fca31b-d9d4-461b-9866-99fccc3e5769 00:14:05.534 02:33:39 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 92fca31b-d9d4-461b-9866-99fccc3e5769 00:14:05.534 02:33:39 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:14:05.793 02:33:39 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:14:05.793 02:33:39 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:14:05.793 02:33:39 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 92fca31b-d9d4-461b-9866-99fccc3e5769 lvol 150 00:14:05.793 02:33:39 -- target/nvmf_lvs_grow.sh@33 -- # lvol=94952d6b-f11e-426e-8f59-f55a79123b6a 00:14:05.793 02:33:39 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:05.793 02:33:39 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:14:06.052 [2024-04-27 02:33:39.549200] bdev_aio.c:1030:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:14:06.052 [2024-04-27 02:33:39.549262] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:14:06.052 true 00:14:06.052 02:33:39 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 92fca31b-d9d4-461b-9866-99fccc3e5769 00:14:06.052 02:33:39 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:14:06.310 02:33:39 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:14:06.310 02:33:39 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:06.310 02:33:39 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 94952d6b-f11e-426e-8f59-f55a79123b6a 00:14:06.568 02:33:40 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:14:06.827 [2024-04-27 02:33:40.207369] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:06.827 02:33:40 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:14:06.827 02:33:40 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=1523600 00:14:06.827 02:33:40 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:14:06.827 02:33:40 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:06.827 02:33:40 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 1523600 /var/tmp/bdevperf.sock 00:14:06.827 02:33:40 -- common/autotest_common.sh@817 -- # '[' -z 1523600 ']' 00:14:06.827 02:33:40 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:06.827 02:33:40 -- common/autotest_common.sh@822 -- # local max_retries=100 00:14:06.827 02:33:40 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:06.827 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:06.827 02:33:40 -- common/autotest_common.sh@826 -- # xtrace_disable 00:14:06.827 02:33:40 -- common/autotest_common.sh@10 -- # set +x 00:14:06.827 [2024-04-27 02:33:40.426845] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:14:06.827 [2024-04-27 02:33:40.426902] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1523600 ] 00:14:07.086 EAL: No free 2048 kB hugepages reported on node 1 00:14:07.086 [2024-04-27 02:33:40.499224] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:07.086 [2024-04-27 02:33:40.586148] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:07.651 02:33:41 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:14:07.651 02:33:41 -- common/autotest_common.sh@850 -- # return 0 00:14:07.651 02:33:41 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:14:07.909 Nvme0n1 00:14:07.909 02:33:41 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:14:08.167 [ 00:14:08.167 { 00:14:08.167 "name": "Nvme0n1", 00:14:08.167 "aliases": [ 00:14:08.167 "94952d6b-f11e-426e-8f59-f55a79123b6a" 00:14:08.167 ], 00:14:08.167 "product_name": "NVMe disk", 00:14:08.167 "block_size": 4096, 00:14:08.167 "num_blocks": 38912, 00:14:08.167 "uuid": "94952d6b-f11e-426e-8f59-f55a79123b6a", 00:14:08.167 "assigned_rate_limits": { 00:14:08.167 "rw_ios_per_sec": 0, 00:14:08.167 "rw_mbytes_per_sec": 0, 00:14:08.167 "r_mbytes_per_sec": 0, 00:14:08.167 "w_mbytes_per_sec": 0 00:14:08.167 }, 00:14:08.167 "claimed": false, 00:14:08.167 "zoned": false, 00:14:08.167 "supported_io_types": { 00:14:08.167 "read": true, 00:14:08.167 "write": true, 00:14:08.167 "unmap": true, 00:14:08.167 "write_zeroes": true, 00:14:08.167 "flush": true, 00:14:08.167 "reset": true, 00:14:08.167 "compare": true, 00:14:08.167 "compare_and_write": true, 00:14:08.167 "abort": true, 00:14:08.167 "nvme_admin": true, 00:14:08.167 "nvme_io": true 00:14:08.167 }, 00:14:08.167 "memory_domains": [ 00:14:08.167 { 00:14:08.167 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:14:08.167 "dma_device_type": 0 00:14:08.167 } 00:14:08.167 ], 00:14:08.167 "driver_specific": { 00:14:08.167 "nvme": [ 00:14:08.167 { 00:14:08.167 "trid": { 00:14:08.167 "trtype": "RDMA", 00:14:08.167 "adrfam": "IPv4", 00:14:08.167 "traddr": "192.168.100.8", 00:14:08.167 "trsvcid": "4420", 00:14:08.167 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:14:08.167 }, 00:14:08.167 "ctrlr_data": { 00:14:08.167 "cntlid": 1, 00:14:08.167 "vendor_id": "0x8086", 00:14:08.167 "model_number": "SPDK bdev Controller", 00:14:08.167 "serial_number": "SPDK0", 00:14:08.167 "firmware_revision": "24.05", 00:14:08.167 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:08.167 "oacs": { 00:14:08.167 "security": 0, 00:14:08.167 "format": 0, 00:14:08.167 "firmware": 0, 00:14:08.167 "ns_manage": 0 00:14:08.167 }, 00:14:08.167 "multi_ctrlr": true, 00:14:08.167 "ana_reporting": false 00:14:08.167 }, 00:14:08.167 "vs": { 00:14:08.167 "nvme_version": "1.3" 00:14:08.167 }, 00:14:08.167 "ns_data": { 00:14:08.167 "id": 1, 00:14:08.167 "can_share": true 00:14:08.167 } 00:14:08.167 } 00:14:08.167 ], 00:14:08.167 "mp_policy": "active_passive" 00:14:08.167 } 00:14:08.168 } 00:14:08.168 ] 00:14:08.168 02:33:41 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=1523750 00:14:08.168 02:33:41 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:14:08.168 02:33:41 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:14:08.168 Running I/O for 10 seconds... 00:14:09.538 Latency(us) 00:14:09.538 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:09.538 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:09.538 Nvme0n1 : 1.00 34628.00 135.27 0.00 0.00 0.00 0.00 0.00 00:14:09.538 =================================================================================================================== 00:14:09.538 Total : 34628.00 135.27 0.00 0.00 0.00 0.00 0.00 00:14:09.538 00:14:10.103 02:33:43 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 92fca31b-d9d4-461b-9866-99fccc3e5769 00:14:10.360 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:10.360 Nvme0n1 : 2.00 35055.50 136.94 0.00 0.00 0.00 0.00 0.00 00:14:10.361 =================================================================================================================== 00:14:10.361 Total : 35055.50 136.94 0.00 0.00 0.00 0.00 0.00 00:14:10.361 00:14:10.361 true 00:14:10.361 02:33:43 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 92fca31b-d9d4-461b-9866-99fccc3e5769 00:14:10.361 02:33:43 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:14:10.619 02:33:44 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:14:10.619 02:33:44 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:14:10.619 02:33:44 -- target/nvmf_lvs_grow.sh@65 -- # wait 1523750 00:14:11.185 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:11.185 Nvme0n1 : 3.00 35203.33 137.51 0.00 0.00 0.00 0.00 0.00 00:14:11.185 =================================================================================================================== 00:14:11.185 Total : 35203.33 137.51 0.00 0.00 0.00 0.00 0.00 00:14:11.185 00:14:12.560 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:12.560 Nvme0n1 : 4.00 35366.50 138.15 0.00 0.00 0.00 0.00 0.00 00:14:12.560 =================================================================================================================== 00:14:12.560 Total : 35366.50 138.15 0.00 0.00 0.00 0.00 0.00 00:14:12.560 00:14:13.492 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:13.492 Nvme0n1 : 5.00 35458.00 138.51 0.00 0.00 0.00 0.00 0.00 00:14:13.492 =================================================================================================================== 00:14:13.492 Total : 35458.00 138.51 0.00 0.00 0.00 0.00 0.00 00:14:13.492 00:14:14.476 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:14.476 Nvme0n1 : 6.00 35513.33 138.72 0.00 0.00 0.00 0.00 0.00 00:14:14.476 =================================================================================================================== 00:14:14.476 Total : 35513.33 138.72 0.00 0.00 0.00 0.00 0.00 00:14:14.476 00:14:15.412 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:15.412 Nvme0n1 : 7.00 35564.57 138.92 0.00 0.00 0.00 0.00 0.00 00:14:15.412 =================================================================================================================== 00:14:15.412 Total : 35564.57 138.92 0.00 0.00 0.00 0.00 0.00 00:14:15.412 00:14:16.348 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:16.348 Nvme0n1 : 8.00 35605.25 139.08 0.00 0.00 0.00 0.00 0.00 00:14:16.348 =================================================================================================================== 00:14:16.348 Total : 35605.25 139.08 0.00 0.00 0.00 0.00 0.00 00:14:16.348 00:14:17.284 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:17.284 Nvme0n1 : 9.00 35586.67 139.01 0.00 0.00 0.00 0.00 0.00 00:14:17.284 =================================================================================================================== 00:14:17.284 Total : 35586.67 139.01 0.00 0.00 0.00 0.00 0.00 00:14:17.284 00:14:18.220 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:18.220 Nvme0n1 : 10.00 35612.00 139.11 0.00 0.00 0.00 0.00 0.00 00:14:18.220 =================================================================================================================== 00:14:18.220 Total : 35612.00 139.11 0.00 0.00 0.00 0.00 0.00 00:14:18.220 00:14:18.220 00:14:18.220 Latency(us) 00:14:18.220 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:18.220 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:18.220 Nvme0n1 : 10.00 35612.63 139.11 0.00 0.00 3591.48 2493.22 14132.98 00:14:18.220 =================================================================================================================== 00:14:18.220 Total : 35612.63 139.11 0.00 0.00 3591.48 2493.22 14132.98 00:14:18.220 0 00:14:18.220 02:33:51 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 1523600 00:14:18.220 02:33:51 -- common/autotest_common.sh@936 -- # '[' -z 1523600 ']' 00:14:18.220 02:33:51 -- common/autotest_common.sh@940 -- # kill -0 1523600 00:14:18.220 02:33:51 -- common/autotest_common.sh@941 -- # uname 00:14:18.220 02:33:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:18.220 02:33:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1523600 00:14:18.479 02:33:51 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:18.479 02:33:51 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:18.479 02:33:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1523600' 00:14:18.479 killing process with pid 1523600 00:14:18.479 02:33:51 -- common/autotest_common.sh@955 -- # kill 1523600 00:14:18.479 Received shutdown signal, test time was about 10.000000 seconds 00:14:18.479 00:14:18.479 Latency(us) 00:14:18.479 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:18.479 =================================================================================================================== 00:14:18.479 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:14:18.479 02:33:51 -- common/autotest_common.sh@960 -- # wait 1523600 00:14:18.738 02:33:52 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:18.738 02:33:52 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 92fca31b-d9d4-461b-9866-99fccc3e5769 00:14:18.738 02:33:52 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:14:18.998 02:33:52 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:14:18.998 02:33:52 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:14:18.998 02:33:52 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:19.259 [2024-04-27 02:33:52.630967] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:14:19.259 02:33:52 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 92fca31b-d9d4-461b-9866-99fccc3e5769 00:14:19.259 02:33:52 -- common/autotest_common.sh@638 -- # local es=0 00:14:19.259 02:33:52 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 92fca31b-d9d4-461b-9866-99fccc3e5769 00:14:19.259 02:33:52 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:14:19.259 02:33:52 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:19.259 02:33:52 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:14:19.259 02:33:52 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:19.259 02:33:52 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:14:19.259 02:33:52 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:19.259 02:33:52 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:14:19.259 02:33:52 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py ]] 00:14:19.259 02:33:52 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 92fca31b-d9d4-461b-9866-99fccc3e5769 00:14:19.259 request: 00:14:19.259 { 00:14:19.259 "uuid": "92fca31b-d9d4-461b-9866-99fccc3e5769", 00:14:19.259 "method": "bdev_lvol_get_lvstores", 00:14:19.259 "req_id": 1 00:14:19.259 } 00:14:19.259 Got JSON-RPC error response 00:14:19.259 response: 00:14:19.259 { 00:14:19.259 "code": -19, 00:14:19.259 "message": "No such device" 00:14:19.259 } 00:14:19.259 02:33:52 -- common/autotest_common.sh@641 -- # es=1 00:14:19.259 02:33:52 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:14:19.259 02:33:52 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:14:19.259 02:33:52 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:14:19.259 02:33:52 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:19.519 aio_bdev 00:14:19.519 02:33:53 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 94952d6b-f11e-426e-8f59-f55a79123b6a 00:14:19.519 02:33:53 -- common/autotest_common.sh@885 -- # local bdev_name=94952d6b-f11e-426e-8f59-f55a79123b6a 00:14:19.519 02:33:53 -- common/autotest_common.sh@886 -- # local bdev_timeout= 00:14:19.519 02:33:53 -- common/autotest_common.sh@887 -- # local i 00:14:19.519 02:33:53 -- common/autotest_common.sh@888 -- # [[ -z '' ]] 00:14:19.519 02:33:53 -- common/autotest_common.sh@888 -- # bdev_timeout=2000 00:14:19.519 02:33:53 -- common/autotest_common.sh@890 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:14:19.778 02:33:53 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 94952d6b-f11e-426e-8f59-f55a79123b6a -t 2000 00:14:19.778 [ 00:14:19.778 { 00:14:19.778 "name": "94952d6b-f11e-426e-8f59-f55a79123b6a", 00:14:19.778 "aliases": [ 00:14:19.778 "lvs/lvol" 00:14:19.778 ], 00:14:19.778 "product_name": "Logical Volume", 00:14:19.778 "block_size": 4096, 00:14:19.778 "num_blocks": 38912, 00:14:19.778 "uuid": "94952d6b-f11e-426e-8f59-f55a79123b6a", 00:14:19.778 "assigned_rate_limits": { 00:14:19.778 "rw_ios_per_sec": 0, 00:14:19.778 "rw_mbytes_per_sec": 0, 00:14:19.778 "r_mbytes_per_sec": 0, 00:14:19.778 "w_mbytes_per_sec": 0 00:14:19.778 }, 00:14:19.778 "claimed": false, 00:14:19.778 "zoned": false, 00:14:19.778 "supported_io_types": { 00:14:19.778 "read": true, 00:14:19.778 "write": true, 00:14:19.778 "unmap": true, 00:14:19.778 "write_zeroes": true, 00:14:19.778 "flush": false, 00:14:19.778 "reset": true, 00:14:19.778 "compare": false, 00:14:19.778 "compare_and_write": false, 00:14:19.778 "abort": false, 00:14:19.778 "nvme_admin": false, 00:14:19.778 "nvme_io": false 00:14:19.778 }, 00:14:19.778 "driver_specific": { 00:14:19.778 "lvol": { 00:14:19.778 "lvol_store_uuid": "92fca31b-d9d4-461b-9866-99fccc3e5769", 00:14:19.778 "base_bdev": "aio_bdev", 00:14:19.778 "thin_provision": false, 00:14:19.778 "snapshot": false, 00:14:19.778 "clone": false, 00:14:19.778 "esnap_clone": false 00:14:19.778 } 00:14:19.778 } 00:14:19.778 } 00:14:19.778 ] 00:14:19.778 02:33:53 -- common/autotest_common.sh@893 -- # return 0 00:14:19.778 02:33:53 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 92fca31b-d9d4-461b-9866-99fccc3e5769 00:14:19.778 02:33:53 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:14:20.037 02:33:53 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:14:20.037 02:33:53 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 92fca31b-d9d4-461b-9866-99fccc3e5769 00:14:20.037 02:33:53 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:14:20.296 02:33:53 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:14:20.296 02:33:53 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 94952d6b-f11e-426e-8f59-f55a79123b6a 00:14:20.296 02:33:53 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 92fca31b-d9d4-461b-9866-99fccc3e5769 00:14:20.555 02:33:54 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:20.814 02:33:54 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:20.814 00:14:20.814 real 0m15.639s 00:14:20.814 user 0m15.579s 00:14:20.814 sys 0m1.186s 00:14:20.814 02:33:54 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:14:20.814 02:33:54 -- common/autotest_common.sh@10 -- # set +x 00:14:20.814 ************************************ 00:14:20.814 END TEST lvs_grow_clean 00:14:20.814 ************************************ 00:14:20.814 02:33:54 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:14:20.814 02:33:54 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:20.814 02:33:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:20.814 02:33:54 -- common/autotest_common.sh@10 -- # set +x 00:14:21.073 ************************************ 00:14:21.073 START TEST lvs_grow_dirty 00:14:21.073 ************************************ 00:14:21.073 02:33:54 -- common/autotest_common.sh@1111 -- # lvs_grow dirty 00:14:21.073 02:33:54 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:14:21.073 02:33:54 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:14:21.073 02:33:54 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:14:21.073 02:33:54 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:14:21.074 02:33:54 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:14:21.074 02:33:54 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:14:21.074 02:33:54 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:21.074 02:33:54 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:21.074 02:33:54 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:21.074 02:33:54 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:14:21.074 02:33:54 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:14:21.332 02:33:54 -- target/nvmf_lvs_grow.sh@28 -- # lvs=d25269b7-e17b-4bb0-829b-6f1af3cfa1a9 00:14:21.332 02:33:54 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d25269b7-e17b-4bb0-829b-6f1af3cfa1a9 00:14:21.332 02:33:54 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:14:21.590 02:33:55 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:14:21.590 02:33:55 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:14:21.590 02:33:55 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u d25269b7-e17b-4bb0-829b-6f1af3cfa1a9 lvol 150 00:14:21.590 02:33:55 -- target/nvmf_lvs_grow.sh@33 -- # lvol=59ee937f-ed2f-47cb-af33-9fafc08241c2 00:14:21.590 02:33:55 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:21.590 02:33:55 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:14:21.905 [2024-04-27 02:33:55.353516] bdev_aio.c:1030:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:14:21.905 [2024-04-27 02:33:55.353572] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:14:21.905 true 00:14:21.905 02:33:55 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:14:21.905 02:33:55 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d25269b7-e17b-4bb0-829b-6f1af3cfa1a9 00:14:22.198 02:33:55 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:14:22.198 02:33:55 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:22.199 02:33:55 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 59ee937f-ed2f-47cb-af33-9fafc08241c2 00:14:22.458 02:33:55 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:14:22.458 02:33:56 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:14:22.717 02:33:56 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=1525767 00:14:22.717 02:33:56 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:14:22.717 02:33:56 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:22.717 02:33:56 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 1525767 /var/tmp/bdevperf.sock 00:14:22.717 02:33:56 -- common/autotest_common.sh@817 -- # '[' -z 1525767 ']' 00:14:22.717 02:33:56 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:22.717 02:33:56 -- common/autotest_common.sh@822 -- # local max_retries=100 00:14:22.717 02:33:56 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:22.717 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:22.717 02:33:56 -- common/autotest_common.sh@826 -- # xtrace_disable 00:14:22.717 02:33:56 -- common/autotest_common.sh@10 -- # set +x 00:14:22.717 [2024-04-27 02:33:56.275715] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:14:22.717 [2024-04-27 02:33:56.275787] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1525767 ] 00:14:22.717 EAL: No free 2048 kB hugepages reported on node 1 00:14:22.976 [2024-04-27 02:33:56.346453] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:22.976 [2024-04-27 02:33:56.424903] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:23.544 02:33:57 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:14:23.544 02:33:57 -- common/autotest_common.sh@850 -- # return 0 00:14:23.544 02:33:57 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:14:23.803 Nvme0n1 00:14:23.803 02:33:57 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:14:24.062 [ 00:14:24.062 { 00:14:24.062 "name": "Nvme0n1", 00:14:24.062 "aliases": [ 00:14:24.062 "59ee937f-ed2f-47cb-af33-9fafc08241c2" 00:14:24.062 ], 00:14:24.062 "product_name": "NVMe disk", 00:14:24.062 "block_size": 4096, 00:14:24.062 "num_blocks": 38912, 00:14:24.062 "uuid": "59ee937f-ed2f-47cb-af33-9fafc08241c2", 00:14:24.062 "assigned_rate_limits": { 00:14:24.062 "rw_ios_per_sec": 0, 00:14:24.062 "rw_mbytes_per_sec": 0, 00:14:24.062 "r_mbytes_per_sec": 0, 00:14:24.062 "w_mbytes_per_sec": 0 00:14:24.062 }, 00:14:24.062 "claimed": false, 00:14:24.062 "zoned": false, 00:14:24.062 "supported_io_types": { 00:14:24.062 "read": true, 00:14:24.062 "write": true, 00:14:24.062 "unmap": true, 00:14:24.062 "write_zeroes": true, 00:14:24.062 "flush": true, 00:14:24.062 "reset": true, 00:14:24.062 "compare": true, 00:14:24.062 "compare_and_write": true, 00:14:24.062 "abort": true, 00:14:24.062 "nvme_admin": true, 00:14:24.062 "nvme_io": true 00:14:24.062 }, 00:14:24.062 "memory_domains": [ 00:14:24.062 { 00:14:24.062 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:14:24.062 "dma_device_type": 0 00:14:24.062 } 00:14:24.062 ], 00:14:24.062 "driver_specific": { 00:14:24.062 "nvme": [ 00:14:24.062 { 00:14:24.062 "trid": { 00:14:24.062 "trtype": "RDMA", 00:14:24.062 "adrfam": "IPv4", 00:14:24.062 "traddr": "192.168.100.8", 00:14:24.062 "trsvcid": "4420", 00:14:24.062 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:14:24.062 }, 00:14:24.062 "ctrlr_data": { 00:14:24.062 "cntlid": 1, 00:14:24.062 "vendor_id": "0x8086", 00:14:24.062 "model_number": "SPDK bdev Controller", 00:14:24.062 "serial_number": "SPDK0", 00:14:24.062 "firmware_revision": "24.05", 00:14:24.062 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:24.062 "oacs": { 00:14:24.062 "security": 0, 00:14:24.062 "format": 0, 00:14:24.062 "firmware": 0, 00:14:24.062 "ns_manage": 0 00:14:24.062 }, 00:14:24.062 "multi_ctrlr": true, 00:14:24.062 "ana_reporting": false 00:14:24.062 }, 00:14:24.062 "vs": { 00:14:24.062 "nvme_version": "1.3" 00:14:24.062 }, 00:14:24.062 "ns_data": { 00:14:24.062 "id": 1, 00:14:24.062 "can_share": true 00:14:24.062 } 00:14:24.062 } 00:14:24.062 ], 00:14:24.062 "mp_policy": "active_passive" 00:14:24.062 } 00:14:24.062 } 00:14:24.063 ] 00:14:24.063 02:33:57 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=1525951 00:14:24.063 02:33:57 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:14:24.063 02:33:57 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:14:24.063 Running I/O for 10 seconds... 00:14:24.999 Latency(us) 00:14:24.999 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:24.999 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:24.999 Nvme0n1 : 1.00 34815.00 136.00 0.00 0.00 0.00 0.00 0.00 00:14:24.999 =================================================================================================================== 00:14:24.999 Total : 34815.00 136.00 0.00 0.00 0.00 0.00 0.00 00:14:24.999 00:14:25.937 02:33:59 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u d25269b7-e17b-4bb0-829b-6f1af3cfa1a9 00:14:26.197 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:26.197 Nvme0n1 : 2.00 35215.50 137.56 0.00 0.00 0.00 0.00 0.00 00:14:26.197 =================================================================================================================== 00:14:26.197 Total : 35215.50 137.56 0.00 0.00 0.00 0.00 0.00 00:14:26.197 00:14:26.197 true 00:14:26.197 02:33:59 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d25269b7-e17b-4bb0-829b-6f1af3cfa1a9 00:14:26.197 02:33:59 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:14:26.456 02:33:59 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:14:26.456 02:33:59 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:14:26.456 02:33:59 -- target/nvmf_lvs_grow.sh@65 -- # wait 1525951 00:14:27.024 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:27.024 Nvme0n1 : 3.00 35169.00 137.38 0.00 0.00 0.00 0.00 0.00 00:14:27.024 =================================================================================================================== 00:14:27.024 Total : 35169.00 137.38 0.00 0.00 0.00 0.00 0.00 00:14:27.024 00:14:28.403 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:28.403 Nvme0n1 : 4.00 35320.75 137.97 0.00 0.00 0.00 0.00 0.00 00:14:28.403 =================================================================================================================== 00:14:28.403 Total : 35320.75 137.97 0.00 0.00 0.00 0.00 0.00 00:14:28.403 00:14:29.342 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:29.342 Nvme0n1 : 5.00 35410.80 138.32 0.00 0.00 0.00 0.00 0.00 00:14:29.342 =================================================================================================================== 00:14:29.342 Total : 35410.80 138.32 0.00 0.00 0.00 0.00 0.00 00:14:29.342 00:14:30.281 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:30.281 Nvme0n1 : 6.00 35492.67 138.64 0.00 0.00 0.00 0.00 0.00 00:14:30.281 =================================================================================================================== 00:14:30.281 Total : 35492.67 138.64 0.00 0.00 0.00 0.00 0.00 00:14:30.281 00:14:31.219 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:31.219 Nvme0n1 : 7.00 35547.57 138.86 0.00 0.00 0.00 0.00 0.00 00:14:31.219 =================================================================================================================== 00:14:31.219 Total : 35547.57 138.86 0.00 0.00 0.00 0.00 0.00 00:14:31.219 00:14:32.158 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:32.158 Nvme0n1 : 8.00 35539.75 138.83 0.00 0.00 0.00 0.00 0.00 00:14:32.158 =================================================================================================================== 00:14:32.158 Total : 35539.75 138.83 0.00 0.00 0.00 0.00 0.00 00:14:32.158 00:14:33.096 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:33.096 Nvme0n1 : 9.00 35590.89 139.03 0.00 0.00 0.00 0.00 0.00 00:14:33.096 =================================================================================================================== 00:14:33.096 Total : 35590.89 139.03 0.00 0.00 0.00 0.00 0.00 00:14:33.096 00:14:34.034 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:34.034 Nvme0n1 : 10.00 35612.60 139.11 0.00 0.00 0.00 0.00 0.00 00:14:34.034 =================================================================================================================== 00:14:34.034 Total : 35612.60 139.11 0.00 0.00 0.00 0.00 0.00 00:14:34.034 00:14:34.034 00:14:34.034 Latency(us) 00:14:34.034 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:34.034 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:34.034 Nvme0n1 : 10.00 35610.62 139.10 0.00 0.00 3591.65 2607.19 16184.54 00:14:34.034 =================================================================================================================== 00:14:34.034 Total : 35610.62 139.10 0.00 0.00 3591.65 2607.19 16184.54 00:14:34.034 0 00:14:34.034 02:34:07 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 1525767 00:14:34.034 02:34:07 -- common/autotest_common.sh@936 -- # '[' -z 1525767 ']' 00:14:34.034 02:34:07 -- common/autotest_common.sh@940 -- # kill -0 1525767 00:14:34.034 02:34:07 -- common/autotest_common.sh@941 -- # uname 00:14:34.034 02:34:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:34.294 02:34:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1525767 00:14:34.294 02:34:07 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:34.294 02:34:07 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:34.294 02:34:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1525767' 00:14:34.294 killing process with pid 1525767 00:14:34.294 02:34:07 -- common/autotest_common.sh@955 -- # kill 1525767 00:14:34.294 Received shutdown signal, test time was about 10.000000 seconds 00:14:34.294 00:14:34.294 Latency(us) 00:14:34.294 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:34.294 =================================================================================================================== 00:14:34.294 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:14:34.294 02:34:07 -- common/autotest_common.sh@960 -- # wait 1525767 00:14:34.553 02:34:07 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:34.553 02:34:08 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d25269b7-e17b-4bb0-829b-6f1af3cfa1a9 00:14:34.553 02:34:08 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:14:34.812 02:34:08 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:14:34.812 02:34:08 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:14:34.812 02:34:08 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 1523103 00:14:34.812 02:34:08 -- target/nvmf_lvs_grow.sh@74 -- # wait 1523103 00:14:34.812 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 1523103 Killed "${NVMF_APP[@]}" "$@" 00:14:34.812 02:34:08 -- target/nvmf_lvs_grow.sh@74 -- # true 00:14:34.812 02:34:08 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:14:34.812 02:34:08 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:14:34.812 02:34:08 -- common/autotest_common.sh@710 -- # xtrace_disable 00:14:34.812 02:34:08 -- common/autotest_common.sh@10 -- # set +x 00:14:34.812 02:34:08 -- nvmf/common.sh@470 -- # nvmfpid=1527415 00:14:34.812 02:34:08 -- nvmf/common.sh@471 -- # waitforlisten 1527415 00:14:34.812 02:34:08 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:14:34.812 02:34:08 -- common/autotest_common.sh@817 -- # '[' -z 1527415 ']' 00:14:34.812 02:34:08 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:34.812 02:34:08 -- common/autotest_common.sh@822 -- # local max_retries=100 00:14:34.812 02:34:08 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:34.812 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:34.812 02:34:08 -- common/autotest_common.sh@826 -- # xtrace_disable 00:14:34.812 02:34:08 -- common/autotest_common.sh@10 -- # set +x 00:14:35.071 [2024-04-27 02:34:08.435348] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:14:35.071 [2024-04-27 02:34:08.435410] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:35.071 EAL: No free 2048 kB hugepages reported on node 1 00:14:35.071 [2024-04-27 02:34:08.507060] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:35.071 [2024-04-27 02:34:08.591863] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:35.071 [2024-04-27 02:34:08.591901] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:35.072 [2024-04-27 02:34:08.591910] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:35.072 [2024-04-27 02:34:08.591935] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:35.072 [2024-04-27 02:34:08.591943] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:35.072 [2024-04-27 02:34:08.591962] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:35.639 02:34:09 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:14:35.639 02:34:09 -- common/autotest_common.sh@850 -- # return 0 00:14:35.639 02:34:09 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:14:35.639 02:34:09 -- common/autotest_common.sh@716 -- # xtrace_disable 00:14:35.639 02:34:09 -- common/autotest_common.sh@10 -- # set +x 00:14:35.898 02:34:09 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:35.898 02:34:09 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:35.898 [2024-04-27 02:34:09.426720] blobstore.c:4779:bs_recover: *NOTICE*: Performing recovery on blobstore 00:14:35.898 [2024-04-27 02:34:09.426813] blobstore.c:4726:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:14:35.898 [2024-04-27 02:34:09.426843] blobstore.c:4726:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:14:35.898 02:34:09 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:14:35.898 02:34:09 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev 59ee937f-ed2f-47cb-af33-9fafc08241c2 00:14:35.898 02:34:09 -- common/autotest_common.sh@885 -- # local bdev_name=59ee937f-ed2f-47cb-af33-9fafc08241c2 00:14:35.898 02:34:09 -- common/autotest_common.sh@886 -- # local bdev_timeout= 00:14:35.898 02:34:09 -- common/autotest_common.sh@887 -- # local i 00:14:35.898 02:34:09 -- common/autotest_common.sh@888 -- # [[ -z '' ]] 00:14:35.898 02:34:09 -- common/autotest_common.sh@888 -- # bdev_timeout=2000 00:14:35.898 02:34:09 -- common/autotest_common.sh@890 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:14:36.157 02:34:09 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 59ee937f-ed2f-47cb-af33-9fafc08241c2 -t 2000 00:14:36.417 [ 00:14:36.417 { 00:14:36.417 "name": "59ee937f-ed2f-47cb-af33-9fafc08241c2", 00:14:36.417 "aliases": [ 00:14:36.417 "lvs/lvol" 00:14:36.417 ], 00:14:36.417 "product_name": "Logical Volume", 00:14:36.417 "block_size": 4096, 00:14:36.417 "num_blocks": 38912, 00:14:36.417 "uuid": "59ee937f-ed2f-47cb-af33-9fafc08241c2", 00:14:36.417 "assigned_rate_limits": { 00:14:36.417 "rw_ios_per_sec": 0, 00:14:36.417 "rw_mbytes_per_sec": 0, 00:14:36.417 "r_mbytes_per_sec": 0, 00:14:36.417 "w_mbytes_per_sec": 0 00:14:36.417 }, 00:14:36.417 "claimed": false, 00:14:36.417 "zoned": false, 00:14:36.417 "supported_io_types": { 00:14:36.417 "read": true, 00:14:36.417 "write": true, 00:14:36.417 "unmap": true, 00:14:36.417 "write_zeroes": true, 00:14:36.417 "flush": false, 00:14:36.417 "reset": true, 00:14:36.417 "compare": false, 00:14:36.417 "compare_and_write": false, 00:14:36.417 "abort": false, 00:14:36.417 "nvme_admin": false, 00:14:36.417 "nvme_io": false 00:14:36.417 }, 00:14:36.417 "driver_specific": { 00:14:36.417 "lvol": { 00:14:36.417 "lvol_store_uuid": "d25269b7-e17b-4bb0-829b-6f1af3cfa1a9", 00:14:36.417 "base_bdev": "aio_bdev", 00:14:36.417 "thin_provision": false, 00:14:36.417 "snapshot": false, 00:14:36.417 "clone": false, 00:14:36.417 "esnap_clone": false 00:14:36.417 } 00:14:36.417 } 00:14:36.417 } 00:14:36.417 ] 00:14:36.417 02:34:09 -- common/autotest_common.sh@893 -- # return 0 00:14:36.417 02:34:09 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d25269b7-e17b-4bb0-829b-6f1af3cfa1a9 00:14:36.417 02:34:09 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:14:36.417 02:34:09 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:14:36.417 02:34:09 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:14:36.417 02:34:09 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d25269b7-e17b-4bb0-829b-6f1af3cfa1a9 00:14:36.676 02:34:10 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:14:36.676 02:34:10 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:36.935 [2024-04-27 02:34:10.339117] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:14:36.936 02:34:10 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d25269b7-e17b-4bb0-829b-6f1af3cfa1a9 00:14:36.936 02:34:10 -- common/autotest_common.sh@638 -- # local es=0 00:14:36.936 02:34:10 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d25269b7-e17b-4bb0-829b-6f1af3cfa1a9 00:14:36.936 02:34:10 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:14:36.936 02:34:10 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:36.936 02:34:10 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:14:36.936 02:34:10 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:36.936 02:34:10 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:14:36.936 02:34:10 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:36.936 02:34:10 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:14:36.936 02:34:10 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py ]] 00:14:36.936 02:34:10 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d25269b7-e17b-4bb0-829b-6f1af3cfa1a9 00:14:37.195 request: 00:14:37.195 { 00:14:37.195 "uuid": "d25269b7-e17b-4bb0-829b-6f1af3cfa1a9", 00:14:37.195 "method": "bdev_lvol_get_lvstores", 00:14:37.195 "req_id": 1 00:14:37.195 } 00:14:37.195 Got JSON-RPC error response 00:14:37.195 response: 00:14:37.195 { 00:14:37.195 "code": -19, 00:14:37.195 "message": "No such device" 00:14:37.195 } 00:14:37.195 02:34:10 -- common/autotest_common.sh@641 -- # es=1 00:14:37.195 02:34:10 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:14:37.195 02:34:10 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:14:37.195 02:34:10 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:14:37.195 02:34:10 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:37.195 aio_bdev 00:14:37.195 02:34:10 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 59ee937f-ed2f-47cb-af33-9fafc08241c2 00:14:37.195 02:34:10 -- common/autotest_common.sh@885 -- # local bdev_name=59ee937f-ed2f-47cb-af33-9fafc08241c2 00:14:37.195 02:34:10 -- common/autotest_common.sh@886 -- # local bdev_timeout= 00:14:37.195 02:34:10 -- common/autotest_common.sh@887 -- # local i 00:14:37.195 02:34:10 -- common/autotest_common.sh@888 -- # [[ -z '' ]] 00:14:37.195 02:34:10 -- common/autotest_common.sh@888 -- # bdev_timeout=2000 00:14:37.195 02:34:10 -- common/autotest_common.sh@890 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:14:37.454 02:34:10 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 59ee937f-ed2f-47cb-af33-9fafc08241c2 -t 2000 00:14:37.454 [ 00:14:37.454 { 00:14:37.454 "name": "59ee937f-ed2f-47cb-af33-9fafc08241c2", 00:14:37.454 "aliases": [ 00:14:37.454 "lvs/lvol" 00:14:37.454 ], 00:14:37.454 "product_name": "Logical Volume", 00:14:37.454 "block_size": 4096, 00:14:37.454 "num_blocks": 38912, 00:14:37.454 "uuid": "59ee937f-ed2f-47cb-af33-9fafc08241c2", 00:14:37.454 "assigned_rate_limits": { 00:14:37.454 "rw_ios_per_sec": 0, 00:14:37.454 "rw_mbytes_per_sec": 0, 00:14:37.454 "r_mbytes_per_sec": 0, 00:14:37.454 "w_mbytes_per_sec": 0 00:14:37.454 }, 00:14:37.454 "claimed": false, 00:14:37.454 "zoned": false, 00:14:37.454 "supported_io_types": { 00:14:37.454 "read": true, 00:14:37.454 "write": true, 00:14:37.454 "unmap": true, 00:14:37.454 "write_zeroes": true, 00:14:37.454 "flush": false, 00:14:37.454 "reset": true, 00:14:37.454 "compare": false, 00:14:37.454 "compare_and_write": false, 00:14:37.454 "abort": false, 00:14:37.454 "nvme_admin": false, 00:14:37.454 "nvme_io": false 00:14:37.454 }, 00:14:37.454 "driver_specific": { 00:14:37.454 "lvol": { 00:14:37.454 "lvol_store_uuid": "d25269b7-e17b-4bb0-829b-6f1af3cfa1a9", 00:14:37.454 "base_bdev": "aio_bdev", 00:14:37.454 "thin_provision": false, 00:14:37.454 "snapshot": false, 00:14:37.454 "clone": false, 00:14:37.454 "esnap_clone": false 00:14:37.454 } 00:14:37.454 } 00:14:37.454 } 00:14:37.454 ] 00:14:37.714 02:34:11 -- common/autotest_common.sh@893 -- # return 0 00:14:37.714 02:34:11 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d25269b7-e17b-4bb0-829b-6f1af3cfa1a9 00:14:37.714 02:34:11 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:14:37.714 02:34:11 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:14:37.714 02:34:11 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d25269b7-e17b-4bb0-829b-6f1af3cfa1a9 00:14:37.714 02:34:11 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:14:37.974 02:34:11 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:14:37.974 02:34:11 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 59ee937f-ed2f-47cb-af33-9fafc08241c2 00:14:38.233 02:34:11 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u d25269b7-e17b-4bb0-829b-6f1af3cfa1a9 00:14:38.233 02:34:11 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:38.493 02:34:11 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:38.493 00:14:38.493 real 0m17.534s 00:14:38.493 user 0m45.473s 00:14:38.493 sys 0m3.426s 00:14:38.493 02:34:11 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:14:38.493 02:34:11 -- common/autotest_common.sh@10 -- # set +x 00:14:38.493 ************************************ 00:14:38.493 END TEST lvs_grow_dirty 00:14:38.493 ************************************ 00:14:38.493 02:34:12 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:14:38.493 02:34:12 -- common/autotest_common.sh@794 -- # type=--id 00:14:38.493 02:34:12 -- common/autotest_common.sh@795 -- # id=0 00:14:38.493 02:34:12 -- common/autotest_common.sh@796 -- # '[' --id = --pid ']' 00:14:38.493 02:34:12 -- common/autotest_common.sh@800 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:14:38.493 02:34:12 -- common/autotest_common.sh@800 -- # shm_files=nvmf_trace.0 00:14:38.493 02:34:12 -- common/autotest_common.sh@802 -- # [[ -z nvmf_trace.0 ]] 00:14:38.493 02:34:12 -- common/autotest_common.sh@806 -- # for n in $shm_files 00:14:38.493 02:34:12 -- common/autotest_common.sh@807 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:14:38.493 nvmf_trace.0 00:14:38.493 02:34:12 -- common/autotest_common.sh@809 -- # return 0 00:14:38.493 02:34:12 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:14:38.493 02:34:12 -- nvmf/common.sh@477 -- # nvmfcleanup 00:14:38.493 02:34:12 -- nvmf/common.sh@117 -- # sync 00:14:38.493 02:34:12 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:14:38.493 02:34:12 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:14:38.493 02:34:12 -- nvmf/common.sh@120 -- # set +e 00:14:38.493 02:34:12 -- nvmf/common.sh@121 -- # for i in {1..20} 00:14:38.493 02:34:12 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:14:38.493 rmmod nvme_rdma 00:14:38.493 rmmod nvme_fabrics 00:14:38.493 02:34:12 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:14:38.493 02:34:12 -- nvmf/common.sh@124 -- # set -e 00:14:38.493 02:34:12 -- nvmf/common.sh@125 -- # return 0 00:14:38.752 02:34:12 -- nvmf/common.sh@478 -- # '[' -n 1527415 ']' 00:14:38.752 02:34:12 -- nvmf/common.sh@479 -- # killprocess 1527415 00:14:38.752 02:34:12 -- common/autotest_common.sh@936 -- # '[' -z 1527415 ']' 00:14:38.752 02:34:12 -- common/autotest_common.sh@940 -- # kill -0 1527415 00:14:38.752 02:34:12 -- common/autotest_common.sh@941 -- # uname 00:14:38.752 02:34:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:38.752 02:34:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1527415 00:14:38.752 02:34:12 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:38.752 02:34:12 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:38.752 02:34:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1527415' 00:14:38.752 killing process with pid 1527415 00:14:38.752 02:34:12 -- common/autotest_common.sh@955 -- # kill 1527415 00:14:38.752 02:34:12 -- common/autotest_common.sh@960 -- # wait 1527415 00:14:39.012 02:34:12 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:14:39.012 02:34:12 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:14:39.012 00:14:39.012 real 0m41.413s 00:14:39.012 user 1m7.203s 00:14:39.012 sys 0m9.950s 00:14:39.012 02:34:12 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:14:39.012 02:34:12 -- common/autotest_common.sh@10 -- # set +x 00:14:39.012 ************************************ 00:14:39.012 END TEST nvmf_lvs_grow 00:14:39.012 ************************************ 00:14:39.012 02:34:12 -- nvmf/nvmf.sh@50 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=rdma 00:14:39.012 02:34:12 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:39.012 02:34:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:39.012 02:34:12 -- common/autotest_common.sh@10 -- # set +x 00:14:39.012 ************************************ 00:14:39.012 START TEST nvmf_bdev_io_wait 00:14:39.012 ************************************ 00:14:39.012 02:34:12 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=rdma 00:14:39.272 * Looking for test storage... 00:14:39.272 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:14:39.272 02:34:12 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:14:39.272 02:34:12 -- nvmf/common.sh@7 -- # uname -s 00:14:39.272 02:34:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:39.272 02:34:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:39.272 02:34:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:39.272 02:34:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:39.272 02:34:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:39.272 02:34:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:39.272 02:34:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:39.272 02:34:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:39.272 02:34:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:39.272 02:34:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:39.272 02:34:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:14:39.272 02:34:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:14:39.272 02:34:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:39.272 02:34:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:39.272 02:34:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:39.272 02:34:12 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:14:39.272 02:34:12 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:14:39.272 02:34:12 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:39.272 02:34:12 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:39.273 02:34:12 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:39.273 02:34:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:39.273 02:34:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:39.273 02:34:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:39.273 02:34:12 -- paths/export.sh@5 -- # export PATH 00:14:39.273 02:34:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:39.273 02:34:12 -- nvmf/common.sh@47 -- # : 0 00:14:39.273 02:34:12 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:14:39.273 02:34:12 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:14:39.273 02:34:12 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:14:39.273 02:34:12 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:39.273 02:34:12 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:39.273 02:34:12 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:14:39.273 02:34:12 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:14:39.273 02:34:12 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:14:39.273 02:34:12 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:39.273 02:34:12 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:39.273 02:34:12 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:14:39.273 02:34:12 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:14:39.273 02:34:12 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:39.273 02:34:12 -- nvmf/common.sh@437 -- # prepare_net_devs 00:14:39.273 02:34:12 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:14:39.273 02:34:12 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:14:39.273 02:34:12 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:39.273 02:34:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:39.273 02:34:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:39.273 02:34:12 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:14:39.273 02:34:12 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:14:39.273 02:34:12 -- nvmf/common.sh@285 -- # xtrace_disable 00:14:39.273 02:34:12 -- common/autotest_common.sh@10 -- # set +x 00:14:45.849 02:34:19 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:45.849 02:34:19 -- nvmf/common.sh@291 -- # pci_devs=() 00:14:45.849 02:34:19 -- nvmf/common.sh@291 -- # local -a pci_devs 00:14:45.849 02:34:19 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:14:45.849 02:34:19 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:14:45.849 02:34:19 -- nvmf/common.sh@293 -- # pci_drivers=() 00:14:45.849 02:34:19 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:14:45.849 02:34:19 -- nvmf/common.sh@295 -- # net_devs=() 00:14:45.849 02:34:19 -- nvmf/common.sh@295 -- # local -ga net_devs 00:14:45.849 02:34:19 -- nvmf/common.sh@296 -- # e810=() 00:14:45.849 02:34:19 -- nvmf/common.sh@296 -- # local -ga e810 00:14:45.849 02:34:19 -- nvmf/common.sh@297 -- # x722=() 00:14:45.849 02:34:19 -- nvmf/common.sh@297 -- # local -ga x722 00:14:45.849 02:34:19 -- nvmf/common.sh@298 -- # mlx=() 00:14:45.849 02:34:19 -- nvmf/common.sh@298 -- # local -ga mlx 00:14:45.849 02:34:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:45.849 02:34:19 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:45.850 02:34:19 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:45.850 02:34:19 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:45.850 02:34:19 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:45.850 02:34:19 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:45.850 02:34:19 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:45.850 02:34:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:45.850 02:34:19 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:45.850 02:34:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:45.850 02:34:19 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:45.850 02:34:19 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:14:45.850 02:34:19 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:14:45.850 02:34:19 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:14:45.850 02:34:19 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:14:45.850 02:34:19 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:14:45.850 02:34:19 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:14:45.850 02:34:19 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:14:45.850 02:34:19 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:45.850 02:34:19 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:14:45.850 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:14:45.850 02:34:19 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:14:45.850 02:34:19 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:14:45.850 02:34:19 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:14:45.850 02:34:19 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:14:45.850 02:34:19 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:45.850 02:34:19 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:45.850 02:34:19 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:45.850 02:34:19 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:14:45.850 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:14:45.850 02:34:19 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:14:45.850 02:34:19 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:14:45.850 02:34:19 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:14:45.850 02:34:19 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:14:45.850 02:34:19 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:45.850 02:34:19 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:45.850 02:34:19 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:14:45.850 02:34:19 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:14:45.850 02:34:19 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:45.850 02:34:19 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:45.850 02:34:19 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:45.850 02:34:19 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:45.850 02:34:19 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:14:45.850 Found net devices under 0000:18:00.0: mlx_0_0 00:14:45.850 02:34:19 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:45.850 02:34:19 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:45.850 02:34:19 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:45.850 02:34:19 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:45.850 02:34:19 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:45.850 02:34:19 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:14:45.850 Found net devices under 0000:18:00.1: mlx_0_1 00:14:45.850 02:34:19 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:45.850 02:34:19 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:14:45.850 02:34:19 -- nvmf/common.sh@403 -- # is_hw=yes 00:14:45.850 02:34:19 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:14:45.850 02:34:19 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:14:45.850 02:34:19 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:14:45.850 02:34:19 -- nvmf/common.sh@409 -- # rdma_device_init 00:14:45.850 02:34:19 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:14:45.850 02:34:19 -- nvmf/common.sh@58 -- # uname 00:14:45.850 02:34:19 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:14:45.850 02:34:19 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:14:45.850 02:34:19 -- nvmf/common.sh@63 -- # modprobe ib_core 00:14:45.850 02:34:19 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:14:45.850 02:34:19 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:14:45.850 02:34:19 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:14:45.850 02:34:19 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:14:45.850 02:34:19 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:14:45.850 02:34:19 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:14:45.850 02:34:19 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:14:45.850 02:34:19 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:14:45.850 02:34:19 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:45.850 02:34:19 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:45.850 02:34:19 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:45.850 02:34:19 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:45.850 02:34:19 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:45.850 02:34:19 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:45.850 02:34:19 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:45.850 02:34:19 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:14:45.850 02:34:19 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:14:45.850 02:34:19 -- nvmf/common.sh@105 -- # continue 2 00:14:45.850 02:34:19 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:45.850 02:34:19 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:45.850 02:34:19 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:14:45.850 02:34:19 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:45.850 02:34:19 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:14:45.850 02:34:19 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:14:45.850 02:34:19 -- nvmf/common.sh@105 -- # continue 2 00:14:45.850 02:34:19 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:45.850 02:34:19 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:14:45.850 02:34:19 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:14:45.850 02:34:19 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:14:45.850 02:34:19 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:45.850 02:34:19 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:45.850 02:34:19 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:14:45.850 02:34:19 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:14:45.850 02:34:19 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:14:45.850 60: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:14:45.850 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:14:45.850 altname enp24s0f0np0 00:14:45.850 altname ens785f0np0 00:14:45.850 inet 192.168.100.8/24 scope global mlx_0_0 00:14:45.850 valid_lft forever preferred_lft forever 00:14:45.850 02:34:19 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:45.850 02:34:19 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:14:45.850 02:34:19 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:14:45.850 02:34:19 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:14:45.850 02:34:19 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:45.850 02:34:19 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:45.850 02:34:19 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:14:45.850 02:34:19 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:14:45.850 02:34:19 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:14:45.850 61: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:14:45.850 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:14:45.850 altname enp24s0f1np1 00:14:45.850 altname ens785f1np1 00:14:45.850 inet 192.168.100.9/24 scope global mlx_0_1 00:14:45.850 valid_lft forever preferred_lft forever 00:14:45.850 02:34:19 -- nvmf/common.sh@411 -- # return 0 00:14:45.850 02:34:19 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:14:45.850 02:34:19 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:14:45.850 02:34:19 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:14:45.850 02:34:19 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:14:45.850 02:34:19 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:14:45.850 02:34:19 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:45.850 02:34:19 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:45.850 02:34:19 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:45.850 02:34:19 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:45.850 02:34:19 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:45.850 02:34:19 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:45.850 02:34:19 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:45.850 02:34:19 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:14:45.850 02:34:19 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:14:45.850 02:34:19 -- nvmf/common.sh@105 -- # continue 2 00:14:45.850 02:34:19 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:45.850 02:34:19 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:45.850 02:34:19 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:14:45.850 02:34:19 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:45.850 02:34:19 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:14:45.850 02:34:19 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:14:45.850 02:34:19 -- nvmf/common.sh@105 -- # continue 2 00:14:45.850 02:34:19 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:45.850 02:34:19 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:14:45.850 02:34:19 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:14:45.850 02:34:19 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:14:45.850 02:34:19 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:45.850 02:34:19 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:45.850 02:34:19 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:45.850 02:34:19 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:14:45.850 02:34:19 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:14:45.850 02:34:19 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:14:45.850 02:34:19 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:45.850 02:34:19 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:45.850 02:34:19 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:14:45.850 192.168.100.9' 00:14:45.850 02:34:19 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:14:45.850 192.168.100.9' 00:14:45.850 02:34:19 -- nvmf/common.sh@446 -- # head -n 1 00:14:45.850 02:34:19 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:14:45.850 02:34:19 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:14:45.850 192.168.100.9' 00:14:45.850 02:34:19 -- nvmf/common.sh@447 -- # tail -n +2 00:14:45.850 02:34:19 -- nvmf/common.sh@447 -- # head -n 1 00:14:45.850 02:34:19 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:14:45.851 02:34:19 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:14:45.851 02:34:19 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:14:45.851 02:34:19 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:14:45.851 02:34:19 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:14:45.851 02:34:19 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:14:45.851 02:34:19 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:14:45.851 02:34:19 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:14:45.851 02:34:19 -- common/autotest_common.sh@710 -- # xtrace_disable 00:14:45.851 02:34:19 -- common/autotest_common.sh@10 -- # set +x 00:14:45.851 02:34:19 -- nvmf/common.sh@470 -- # nvmfpid=1530922 00:14:45.851 02:34:19 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:14:45.851 02:34:19 -- nvmf/common.sh@471 -- # waitforlisten 1530922 00:14:45.851 02:34:19 -- common/autotest_common.sh@817 -- # '[' -z 1530922 ']' 00:14:45.851 02:34:19 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:45.851 02:34:19 -- common/autotest_common.sh@822 -- # local max_retries=100 00:14:45.851 02:34:19 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:45.851 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:45.851 02:34:19 -- common/autotest_common.sh@826 -- # xtrace_disable 00:14:45.851 02:34:19 -- common/autotest_common.sh@10 -- # set +x 00:14:45.851 [2024-04-27 02:34:19.415372] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:14:45.851 [2024-04-27 02:34:19.415436] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:45.851 EAL: No free 2048 kB hugepages reported on node 1 00:14:46.110 [2024-04-27 02:34:19.485718] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:46.110 [2024-04-27 02:34:19.569201] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:46.110 [2024-04-27 02:34:19.569249] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:46.110 [2024-04-27 02:34:19.569259] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:46.110 [2024-04-27 02:34:19.569268] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:46.110 [2024-04-27 02:34:19.569276] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:46.110 [2024-04-27 02:34:19.569329] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:46.110 [2024-04-27 02:34:19.569428] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:46.110 [2024-04-27 02:34:19.569453] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:46.110 [2024-04-27 02:34:19.569456] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:46.679 02:34:20 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:14:46.679 02:34:20 -- common/autotest_common.sh@850 -- # return 0 00:14:46.679 02:34:20 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:14:46.679 02:34:20 -- common/autotest_common.sh@716 -- # xtrace_disable 00:14:46.679 02:34:20 -- common/autotest_common.sh@10 -- # set +x 00:14:46.679 02:34:20 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:46.679 02:34:20 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:14:46.679 02:34:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:46.679 02:34:20 -- common/autotest_common.sh@10 -- # set +x 00:14:46.679 02:34:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:46.679 02:34:20 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:14:46.679 02:34:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:46.679 02:34:20 -- common/autotest_common.sh@10 -- # set +x 00:14:46.938 02:34:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:46.938 02:34:20 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:14:46.938 02:34:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:46.938 02:34:20 -- common/autotest_common.sh@10 -- # set +x 00:14:46.938 [2024-04-27 02:34:20.374233] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x67e540/0x682a30) succeed. 00:14:46.938 [2024-04-27 02:34:20.384268] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x67fb30/0x6c40c0) succeed. 00:14:46.938 02:34:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:46.938 02:34:20 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:14:46.938 02:34:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:46.938 02:34:20 -- common/autotest_common.sh@10 -- # set +x 00:14:46.938 Malloc0 00:14:46.938 02:34:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:46.938 02:34:20 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:14:46.938 02:34:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:46.938 02:34:20 -- common/autotest_common.sh@10 -- # set +x 00:14:47.198 02:34:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:47.198 02:34:20 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:14:47.198 02:34:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:47.198 02:34:20 -- common/autotest_common.sh@10 -- # set +x 00:14:47.198 02:34:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:47.198 02:34:20 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:14:47.198 02:34:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:47.198 02:34:20 -- common/autotest_common.sh@10 -- # set +x 00:14:47.198 [2024-04-27 02:34:20.577030] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:47.198 02:34:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:47.198 02:34:20 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=1531124 00:14:47.198 02:34:20 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:14:47.198 02:34:20 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:14:47.198 02:34:20 -- target/bdev_io_wait.sh@30 -- # READ_PID=1531126 00:14:47.198 02:34:20 -- nvmf/common.sh@521 -- # config=() 00:14:47.198 02:34:20 -- nvmf/common.sh@521 -- # local subsystem config 00:14:47.198 02:34:20 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:14:47.198 02:34:20 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:14:47.198 { 00:14:47.198 "params": { 00:14:47.198 "name": "Nvme$subsystem", 00:14:47.198 "trtype": "$TEST_TRANSPORT", 00:14:47.198 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:47.198 "adrfam": "ipv4", 00:14:47.198 "trsvcid": "$NVMF_PORT", 00:14:47.198 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:47.198 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:47.198 "hdgst": ${hdgst:-false}, 00:14:47.198 "ddgst": ${ddgst:-false} 00:14:47.198 }, 00:14:47.198 "method": "bdev_nvme_attach_controller" 00:14:47.198 } 00:14:47.198 EOF 00:14:47.198 )") 00:14:47.198 02:34:20 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:14:47.198 02:34:20 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:14:47.198 02:34:20 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=1531128 00:14:47.198 02:34:20 -- nvmf/common.sh@521 -- # config=() 00:14:47.198 02:34:20 -- nvmf/common.sh@521 -- # local subsystem config 00:14:47.198 02:34:20 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:14:47.198 02:34:20 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:14:47.198 { 00:14:47.198 "params": { 00:14:47.198 "name": "Nvme$subsystem", 00:14:47.198 "trtype": "$TEST_TRANSPORT", 00:14:47.198 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:47.199 "adrfam": "ipv4", 00:14:47.199 "trsvcid": "$NVMF_PORT", 00:14:47.199 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:47.199 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:47.199 "hdgst": ${hdgst:-false}, 00:14:47.199 "ddgst": ${ddgst:-false} 00:14:47.199 }, 00:14:47.199 "method": "bdev_nvme_attach_controller" 00:14:47.199 } 00:14:47.199 EOF 00:14:47.199 )") 00:14:47.199 02:34:20 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=1531131 00:14:47.199 02:34:20 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:14:47.199 02:34:20 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:14:47.199 02:34:20 -- nvmf/common.sh@543 -- # cat 00:14:47.199 02:34:20 -- target/bdev_io_wait.sh@35 -- # sync 00:14:47.199 02:34:20 -- nvmf/common.sh@521 -- # config=() 00:14:47.199 02:34:20 -- nvmf/common.sh@521 -- # local subsystem config 00:14:47.199 02:34:20 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:14:47.199 02:34:20 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:14:47.199 { 00:14:47.199 "params": { 00:14:47.199 "name": "Nvme$subsystem", 00:14:47.199 "trtype": "$TEST_TRANSPORT", 00:14:47.199 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:47.199 "adrfam": "ipv4", 00:14:47.199 "trsvcid": "$NVMF_PORT", 00:14:47.199 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:47.199 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:47.199 "hdgst": ${hdgst:-false}, 00:14:47.199 "ddgst": ${ddgst:-false} 00:14:47.199 }, 00:14:47.199 "method": "bdev_nvme_attach_controller" 00:14:47.199 } 00:14:47.199 EOF 00:14:47.199 )") 00:14:47.199 02:34:20 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:14:47.199 02:34:20 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:14:47.199 02:34:20 -- nvmf/common.sh@543 -- # cat 00:14:47.199 02:34:20 -- nvmf/common.sh@521 -- # config=() 00:14:47.199 02:34:20 -- nvmf/common.sh@521 -- # local subsystem config 00:14:47.199 02:34:20 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:14:47.199 02:34:20 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:14:47.199 { 00:14:47.199 "params": { 00:14:47.199 "name": "Nvme$subsystem", 00:14:47.199 "trtype": "$TEST_TRANSPORT", 00:14:47.199 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:47.199 "adrfam": "ipv4", 00:14:47.199 "trsvcid": "$NVMF_PORT", 00:14:47.199 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:47.199 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:47.199 "hdgst": ${hdgst:-false}, 00:14:47.199 "ddgst": ${ddgst:-false} 00:14:47.199 }, 00:14:47.199 "method": "bdev_nvme_attach_controller" 00:14:47.199 } 00:14:47.199 EOF 00:14:47.199 )") 00:14:47.199 02:34:20 -- nvmf/common.sh@543 -- # cat 00:14:47.199 02:34:20 -- target/bdev_io_wait.sh@37 -- # wait 1531124 00:14:47.199 02:34:20 -- nvmf/common.sh@543 -- # cat 00:14:47.199 02:34:20 -- nvmf/common.sh@545 -- # jq . 00:14:47.199 02:34:20 -- nvmf/common.sh@545 -- # jq . 00:14:47.199 02:34:20 -- nvmf/common.sh@545 -- # jq . 00:14:47.199 02:34:20 -- nvmf/common.sh@546 -- # IFS=, 00:14:47.199 02:34:20 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:14:47.199 "params": { 00:14:47.199 "name": "Nvme1", 00:14:47.199 "trtype": "rdma", 00:14:47.199 "traddr": "192.168.100.8", 00:14:47.199 "adrfam": "ipv4", 00:14:47.199 "trsvcid": "4420", 00:14:47.199 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:14:47.199 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:14:47.199 "hdgst": false, 00:14:47.199 "ddgst": false 00:14:47.199 }, 00:14:47.199 "method": "bdev_nvme_attach_controller" 00:14:47.199 }' 00:14:47.199 02:34:20 -- nvmf/common.sh@545 -- # jq . 00:14:47.199 02:34:20 -- nvmf/common.sh@546 -- # IFS=, 00:14:47.199 02:34:20 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:14:47.199 "params": { 00:14:47.199 "name": "Nvme1", 00:14:47.199 "trtype": "rdma", 00:14:47.199 "traddr": "192.168.100.8", 00:14:47.199 "adrfam": "ipv4", 00:14:47.199 "trsvcid": "4420", 00:14:47.199 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:14:47.199 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:14:47.199 "hdgst": false, 00:14:47.199 "ddgst": false 00:14:47.199 }, 00:14:47.199 "method": "bdev_nvme_attach_controller" 00:14:47.199 }' 00:14:47.199 02:34:20 -- nvmf/common.sh@546 -- # IFS=, 00:14:47.199 02:34:20 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:14:47.199 "params": { 00:14:47.199 "name": "Nvme1", 00:14:47.199 "trtype": "rdma", 00:14:47.199 "traddr": "192.168.100.8", 00:14:47.199 "adrfam": "ipv4", 00:14:47.199 "trsvcid": "4420", 00:14:47.199 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:14:47.199 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:14:47.199 "hdgst": false, 00:14:47.199 "ddgst": false 00:14:47.199 }, 00:14:47.199 "method": "bdev_nvme_attach_controller" 00:14:47.199 }' 00:14:47.199 02:34:20 -- nvmf/common.sh@546 -- # IFS=, 00:14:47.199 02:34:20 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:14:47.199 "params": { 00:14:47.199 "name": "Nvme1", 00:14:47.199 "trtype": "rdma", 00:14:47.199 "traddr": "192.168.100.8", 00:14:47.199 "adrfam": "ipv4", 00:14:47.199 "trsvcid": "4420", 00:14:47.199 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:14:47.199 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:14:47.199 "hdgst": false, 00:14:47.199 "ddgst": false 00:14:47.199 }, 00:14:47.199 "method": "bdev_nvme_attach_controller" 00:14:47.199 }' 00:14:47.199 [2024-04-27 02:34:20.629168] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:14:47.199 [2024-04-27 02:34:20.629229] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:14:47.199 [2024-04-27 02:34:20.629742] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:14:47.199 [2024-04-27 02:34:20.629790] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:14:47.199 [2024-04-27 02:34:20.632114] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:14:47.199 [2024-04-27 02:34:20.632124] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:14:47.199 [2024-04-27 02:34:20.632170] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-04-27 02:34:20.632171] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:14:47.199 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:14:47.199 EAL: No free 2048 kB hugepages reported on node 1 00:14:47.200 EAL: No free 2048 kB hugepages reported on node 1 00:14:47.460 [2024-04-27 02:34:20.827435] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:47.460 EAL: No free 2048 kB hugepages reported on node 1 00:14:47.460 [2024-04-27 02:34:20.910166] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:14:47.460 [2024-04-27 02:34:20.933335] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:47.460 EAL: No free 2048 kB hugepages reported on node 1 00:14:47.460 [2024-04-27 02:34:20.989457] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:47.460 [2024-04-27 02:34:21.024442] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:14:47.460 [2024-04-27 02:34:21.060282] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:47.460 [2024-04-27 02:34:21.070181] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:14:47.719 [2024-04-27 02:34:21.139574] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:14:47.719 Running I/O for 1 seconds... 00:14:47.719 Running I/O for 1 seconds... 00:14:47.719 Running I/O for 1 seconds... 00:14:47.719 Running I/O for 1 seconds... 00:14:48.659 00:14:48.659 Latency(us) 00:14:48.659 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:48.659 Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:14:48.659 Nvme1n1 : 1.01 18067.05 70.57 0.00 0.00 7063.67 3960.65 12708.29 00:14:48.659 =================================================================================================================== 00:14:48.659 Total : 18067.05 70.57 0.00 0.00 7063.67 3960.65 12708.29 00:14:48.659 00:14:48.659 Latency(us) 00:14:48.659 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:48.659 Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:14:48.659 Nvme1n1 : 1.01 14793.00 57.79 0.00 0.00 8626.55 5185.89 18692.01 00:14:48.659 =================================================================================================================== 00:14:48.659 Total : 14793.00 57.79 0.00 0.00 8626.55 5185.89 18692.01 00:14:48.659 00:14:48.659 Latency(us) 00:14:48.659 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:48.659 Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:14:48.659 Nvme1n1 : 1.00 17770.30 69.42 0.00 0.00 7187.62 3462.01 16640.45 00:14:48.659 =================================================================================================================== 00:14:48.659 Total : 17770.30 69.42 0.00 0.00 7187.62 3462.01 16640.45 00:14:48.920 00:14:48.920 Latency(us) 00:14:48.920 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:48.920 Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:14:48.920 Nvme1n1 : 1.00 262302.16 1024.62 0.00 0.00 486.27 193.22 1866.35 00:14:48.920 =================================================================================================================== 00:14:48.920 Total : 262302.16 1024.62 0.00 0.00 486.27 193.22 1866.35 00:14:48.920 02:34:22 -- target/bdev_io_wait.sh@38 -- # wait 1531126 00:14:49.248 02:34:22 -- target/bdev_io_wait.sh@39 -- # wait 1531128 00:14:49.248 02:34:22 -- target/bdev_io_wait.sh@40 -- # wait 1531131 00:14:49.248 02:34:22 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:49.248 02:34:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:49.248 02:34:22 -- common/autotest_common.sh@10 -- # set +x 00:14:49.248 02:34:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:49.248 02:34:22 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:14:49.248 02:34:22 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:14:49.248 02:34:22 -- nvmf/common.sh@477 -- # nvmfcleanup 00:14:49.248 02:34:22 -- nvmf/common.sh@117 -- # sync 00:14:49.248 02:34:22 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:14:49.248 02:34:22 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:14:49.248 02:34:22 -- nvmf/common.sh@120 -- # set +e 00:14:49.248 02:34:22 -- nvmf/common.sh@121 -- # for i in {1..20} 00:14:49.248 02:34:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:14:49.248 rmmod nvme_rdma 00:14:49.248 rmmod nvme_fabrics 00:14:49.248 02:34:22 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:14:49.248 02:34:22 -- nvmf/common.sh@124 -- # set -e 00:14:49.248 02:34:22 -- nvmf/common.sh@125 -- # return 0 00:14:49.248 02:34:22 -- nvmf/common.sh@478 -- # '[' -n 1530922 ']' 00:14:49.248 02:34:22 -- nvmf/common.sh@479 -- # killprocess 1530922 00:14:49.248 02:34:22 -- common/autotest_common.sh@936 -- # '[' -z 1530922 ']' 00:14:49.248 02:34:22 -- common/autotest_common.sh@940 -- # kill -0 1530922 00:14:49.248 02:34:22 -- common/autotest_common.sh@941 -- # uname 00:14:49.248 02:34:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:49.248 02:34:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1530922 00:14:49.248 02:34:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:49.248 02:34:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:49.248 02:34:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1530922' 00:14:49.248 killing process with pid 1530922 00:14:49.248 02:34:22 -- common/autotest_common.sh@955 -- # kill 1530922 00:14:49.248 02:34:22 -- common/autotest_common.sh@960 -- # wait 1530922 00:14:49.248 [2024-04-27 02:34:22.817270] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:14:49.519 02:34:23 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:14:49.519 02:34:23 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:14:49.519 00:14:49.519 real 0m10.433s 00:14:49.519 user 0m21.334s 00:14:49.519 sys 0m6.535s 00:14:49.519 02:34:23 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:14:49.519 02:34:23 -- common/autotest_common.sh@10 -- # set +x 00:14:49.519 ************************************ 00:14:49.519 END TEST nvmf_bdev_io_wait 00:14:49.519 ************************************ 00:14:49.519 02:34:23 -- nvmf/nvmf.sh@51 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=rdma 00:14:49.519 02:34:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:49.519 02:34:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:49.519 02:34:23 -- common/autotest_common.sh@10 -- # set +x 00:14:49.778 ************************************ 00:14:49.778 START TEST nvmf_queue_depth 00:14:49.778 ************************************ 00:14:49.778 02:34:23 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=rdma 00:14:49.778 * Looking for test storage... 00:14:49.778 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:14:49.778 02:34:23 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:14:49.778 02:34:23 -- nvmf/common.sh@7 -- # uname -s 00:14:49.778 02:34:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:49.778 02:34:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:49.778 02:34:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:49.778 02:34:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:49.778 02:34:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:49.778 02:34:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:49.778 02:34:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:49.778 02:34:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:49.778 02:34:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:49.778 02:34:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:49.778 02:34:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:14:49.778 02:34:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:14:49.778 02:34:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:49.778 02:34:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:49.778 02:34:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:49.778 02:34:23 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:14:49.778 02:34:23 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:14:49.778 02:34:23 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:49.778 02:34:23 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:49.778 02:34:23 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:49.778 02:34:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:49.778 02:34:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:49.778 02:34:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:49.778 02:34:23 -- paths/export.sh@5 -- # export PATH 00:14:49.778 02:34:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:49.778 02:34:23 -- nvmf/common.sh@47 -- # : 0 00:14:49.778 02:34:23 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:14:49.778 02:34:23 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:14:49.778 02:34:23 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:14:49.778 02:34:23 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:49.778 02:34:23 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:49.778 02:34:23 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:14:49.778 02:34:23 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:14:49.778 02:34:23 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:14:49.778 02:34:23 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:14:49.778 02:34:23 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:14:49.778 02:34:23 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:14:49.778 02:34:23 -- target/queue_depth.sh@19 -- # nvmftestinit 00:14:49.778 02:34:23 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:14:49.778 02:34:23 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:49.779 02:34:23 -- nvmf/common.sh@437 -- # prepare_net_devs 00:14:49.779 02:34:23 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:14:49.779 02:34:23 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:14:49.779 02:34:23 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:49.779 02:34:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:49.779 02:34:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:49.779 02:34:23 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:14:49.779 02:34:23 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:14:49.779 02:34:23 -- nvmf/common.sh@285 -- # xtrace_disable 00:14:49.779 02:34:23 -- common/autotest_common.sh@10 -- # set +x 00:14:55.059 02:34:28 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:55.059 02:34:28 -- nvmf/common.sh@291 -- # pci_devs=() 00:14:55.059 02:34:28 -- nvmf/common.sh@291 -- # local -a pci_devs 00:14:55.059 02:34:28 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:14:55.059 02:34:28 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:14:55.059 02:34:28 -- nvmf/common.sh@293 -- # pci_drivers=() 00:14:55.059 02:34:28 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:14:55.059 02:34:28 -- nvmf/common.sh@295 -- # net_devs=() 00:14:55.059 02:34:28 -- nvmf/common.sh@295 -- # local -ga net_devs 00:14:55.059 02:34:28 -- nvmf/common.sh@296 -- # e810=() 00:14:55.059 02:34:28 -- nvmf/common.sh@296 -- # local -ga e810 00:14:55.059 02:34:28 -- nvmf/common.sh@297 -- # x722=() 00:14:55.059 02:34:28 -- nvmf/common.sh@297 -- # local -ga x722 00:14:55.059 02:34:28 -- nvmf/common.sh@298 -- # mlx=() 00:14:55.059 02:34:28 -- nvmf/common.sh@298 -- # local -ga mlx 00:14:55.059 02:34:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:55.059 02:34:28 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:55.059 02:34:28 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:55.060 02:34:28 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:55.060 02:34:28 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:55.060 02:34:28 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:55.060 02:34:28 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:55.060 02:34:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:55.060 02:34:28 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:55.060 02:34:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:55.060 02:34:28 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:55.060 02:34:28 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:14:55.060 02:34:28 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:14:55.060 02:34:28 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:14:55.060 02:34:28 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:14:55.060 02:34:28 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:14:55.060 02:34:28 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:14:55.060 02:34:28 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:14:55.060 02:34:28 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:55.060 02:34:28 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:14:55.060 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:14:55.060 02:34:28 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:14:55.060 02:34:28 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:14:55.060 02:34:28 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:14:55.060 02:34:28 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:14:55.060 02:34:28 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:55.060 02:34:28 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:55.060 02:34:28 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:55.060 02:34:28 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:14:55.060 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:14:55.060 02:34:28 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:14:55.060 02:34:28 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:14:55.060 02:34:28 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:14:55.060 02:34:28 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:14:55.060 02:34:28 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:55.060 02:34:28 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:55.060 02:34:28 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:14:55.060 02:34:28 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:14:55.060 02:34:28 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:55.060 02:34:28 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:55.060 02:34:28 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:55.060 02:34:28 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:55.060 02:34:28 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:14:55.060 Found net devices under 0000:18:00.0: mlx_0_0 00:14:55.060 02:34:28 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:55.060 02:34:28 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:55.060 02:34:28 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:55.060 02:34:28 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:55.060 02:34:28 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:55.060 02:34:28 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:14:55.060 Found net devices under 0000:18:00.1: mlx_0_1 00:14:55.060 02:34:28 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:55.060 02:34:28 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:14:55.060 02:34:28 -- nvmf/common.sh@403 -- # is_hw=yes 00:14:55.060 02:34:28 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:14:55.060 02:34:28 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:14:55.060 02:34:28 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:14:55.060 02:34:28 -- nvmf/common.sh@409 -- # rdma_device_init 00:14:55.060 02:34:28 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:14:55.060 02:34:28 -- nvmf/common.sh@58 -- # uname 00:14:55.060 02:34:28 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:14:55.060 02:34:28 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:14:55.060 02:34:28 -- nvmf/common.sh@63 -- # modprobe ib_core 00:14:55.060 02:34:28 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:14:55.060 02:34:28 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:14:55.060 02:34:28 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:14:55.060 02:34:28 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:14:55.060 02:34:28 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:14:55.060 02:34:28 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:14:55.060 02:34:28 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:14:55.060 02:34:28 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:14:55.060 02:34:28 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:55.060 02:34:28 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:55.060 02:34:28 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:55.060 02:34:28 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:55.060 02:34:28 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:55.060 02:34:28 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:55.060 02:34:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:55.060 02:34:28 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:14:55.060 02:34:28 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:14:55.060 02:34:28 -- nvmf/common.sh@105 -- # continue 2 00:14:55.060 02:34:28 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:55.060 02:34:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:55.060 02:34:28 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:14:55.060 02:34:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:55.060 02:34:28 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:14:55.060 02:34:28 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:14:55.060 02:34:28 -- nvmf/common.sh@105 -- # continue 2 00:14:55.060 02:34:28 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:55.060 02:34:28 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:14:55.060 02:34:28 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:14:55.060 02:34:28 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:55.060 02:34:28 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:55.060 02:34:28 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:14:55.060 02:34:28 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:14:55.060 02:34:28 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:14:55.060 02:34:28 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:14:55.060 60: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:14:55.060 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:14:55.060 altname enp24s0f0np0 00:14:55.060 altname ens785f0np0 00:14:55.060 inet 192.168.100.8/24 scope global mlx_0_0 00:14:55.060 valid_lft forever preferred_lft forever 00:14:55.060 02:34:28 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:55.060 02:34:28 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:14:55.060 02:34:28 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:14:55.060 02:34:28 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:14:55.060 02:34:28 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:55.060 02:34:28 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:55.060 02:34:28 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:14:55.060 02:34:28 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:14:55.060 02:34:28 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:14:55.060 61: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:14:55.060 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:14:55.060 altname enp24s0f1np1 00:14:55.060 altname ens785f1np1 00:14:55.060 inet 192.168.100.9/24 scope global mlx_0_1 00:14:55.060 valid_lft forever preferred_lft forever 00:14:55.060 02:34:28 -- nvmf/common.sh@411 -- # return 0 00:14:55.060 02:34:28 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:14:55.060 02:34:28 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:14:55.060 02:34:28 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:14:55.060 02:34:28 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:14:55.060 02:34:28 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:14:55.060 02:34:28 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:55.060 02:34:28 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:55.060 02:34:28 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:55.060 02:34:28 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:55.060 02:34:28 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:55.060 02:34:28 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:55.060 02:34:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:55.060 02:34:28 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:14:55.060 02:34:28 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:14:55.060 02:34:28 -- nvmf/common.sh@105 -- # continue 2 00:14:55.060 02:34:28 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:55.060 02:34:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:55.060 02:34:28 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:14:55.060 02:34:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:55.060 02:34:28 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:14:55.060 02:34:28 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:14:55.060 02:34:28 -- nvmf/common.sh@105 -- # continue 2 00:14:55.060 02:34:28 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:55.060 02:34:28 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:14:55.060 02:34:28 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:14:55.060 02:34:28 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:14:55.060 02:34:28 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:55.060 02:34:28 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:55.060 02:34:28 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:55.060 02:34:28 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:14:55.060 02:34:28 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:14:55.060 02:34:28 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:14:55.060 02:34:28 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:55.060 02:34:28 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:55.060 02:34:28 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:14:55.060 192.168.100.9' 00:14:55.060 02:34:28 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:14:55.060 192.168.100.9' 00:14:55.060 02:34:28 -- nvmf/common.sh@446 -- # head -n 1 00:14:55.321 02:34:28 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:14:55.321 02:34:28 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:14:55.321 192.168.100.9' 00:14:55.321 02:34:28 -- nvmf/common.sh@447 -- # tail -n +2 00:14:55.321 02:34:28 -- nvmf/common.sh@447 -- # head -n 1 00:14:55.321 02:34:28 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:14:55.321 02:34:28 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:14:55.321 02:34:28 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:14:55.321 02:34:28 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:14:55.321 02:34:28 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:14:55.321 02:34:28 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:14:55.321 02:34:28 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:14:55.321 02:34:28 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:14:55.321 02:34:28 -- common/autotest_common.sh@710 -- # xtrace_disable 00:14:55.321 02:34:28 -- common/autotest_common.sh@10 -- # set +x 00:14:55.321 02:34:28 -- nvmf/common.sh@470 -- # nvmfpid=1534137 00:14:55.321 02:34:28 -- nvmf/common.sh@471 -- # waitforlisten 1534137 00:14:55.321 02:34:28 -- common/autotest_common.sh@817 -- # '[' -z 1534137 ']' 00:14:55.321 02:34:28 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:55.321 02:34:28 -- common/autotest_common.sh@822 -- # local max_retries=100 00:14:55.321 02:34:28 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:55.321 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:55.321 02:34:28 -- common/autotest_common.sh@826 -- # xtrace_disable 00:14:55.321 02:34:28 -- common/autotest_common.sh@10 -- # set +x 00:14:55.321 02:34:28 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:14:55.321 [2024-04-27 02:34:28.768449] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:14:55.321 [2024-04-27 02:34:28.768505] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:55.321 EAL: No free 2048 kB hugepages reported on node 1 00:14:55.321 [2024-04-27 02:34:28.840974] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:55.321 [2024-04-27 02:34:28.928412] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:55.321 [2024-04-27 02:34:28.928449] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:55.321 [2024-04-27 02:34:28.928459] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:55.321 [2024-04-27 02:34:28.928483] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:55.321 [2024-04-27 02:34:28.928491] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:55.321 [2024-04-27 02:34:28.928515] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:56.261 02:34:29 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:14:56.261 02:34:29 -- common/autotest_common.sh@850 -- # return 0 00:14:56.261 02:34:29 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:14:56.261 02:34:29 -- common/autotest_common.sh@716 -- # xtrace_disable 00:14:56.261 02:34:29 -- common/autotest_common.sh@10 -- # set +x 00:14:56.261 02:34:29 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:56.261 02:34:29 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:14:56.261 02:34:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:56.261 02:34:29 -- common/autotest_common.sh@10 -- # set +x 00:14:56.261 [2024-04-27 02:34:29.641125] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x169f6e0/0x16a3bd0) succeed. 00:14:56.261 [2024-04-27 02:34:29.649786] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x16a0be0/0x16e5260) succeed. 00:14:56.261 02:34:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:56.261 02:34:29 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:14:56.261 02:34:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:56.261 02:34:29 -- common/autotest_common.sh@10 -- # set +x 00:14:56.261 Malloc0 00:14:56.261 02:34:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:56.261 02:34:29 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:14:56.261 02:34:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:56.261 02:34:29 -- common/autotest_common.sh@10 -- # set +x 00:14:56.261 02:34:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:56.261 02:34:29 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:14:56.261 02:34:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:56.261 02:34:29 -- common/autotest_common.sh@10 -- # set +x 00:14:56.261 02:34:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:56.261 02:34:29 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:14:56.261 02:34:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:56.261 02:34:29 -- common/autotest_common.sh@10 -- # set +x 00:14:56.261 [2024-04-27 02:34:29.734632] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:56.261 02:34:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:56.261 02:34:29 -- target/queue_depth.sh@30 -- # bdevperf_pid=1534275 00:14:56.261 02:34:29 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:56.261 02:34:29 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:14:56.261 02:34:29 -- target/queue_depth.sh@33 -- # waitforlisten 1534275 /var/tmp/bdevperf.sock 00:14:56.261 02:34:29 -- common/autotest_common.sh@817 -- # '[' -z 1534275 ']' 00:14:56.261 02:34:29 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:56.261 02:34:29 -- common/autotest_common.sh@822 -- # local max_retries=100 00:14:56.261 02:34:29 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:56.261 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:56.261 02:34:29 -- common/autotest_common.sh@826 -- # xtrace_disable 00:14:56.261 02:34:29 -- common/autotest_common.sh@10 -- # set +x 00:14:56.261 [2024-04-27 02:34:29.783638] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:14:56.261 [2024-04-27 02:34:29.783688] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1534275 ] 00:14:56.261 EAL: No free 2048 kB hugepages reported on node 1 00:14:56.261 [2024-04-27 02:34:29.855119] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:56.520 [2024-04-27 02:34:29.943365] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:57.090 02:34:30 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:14:57.090 02:34:30 -- common/autotest_common.sh@850 -- # return 0 00:14:57.090 02:34:30 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:14:57.090 02:34:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:57.090 02:34:30 -- common/autotest_common.sh@10 -- # set +x 00:14:57.090 NVMe0n1 00:14:57.090 02:34:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:57.090 02:34:30 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:14:57.349 Running I/O for 10 seconds... 00:15:07.333 00:15:07.333 Latency(us) 00:15:07.333 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:07.333 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:15:07.333 Verification LBA range: start 0x0 length 0x4000 00:15:07.333 NVMe0n1 : 10.04 17725.28 69.24 0.00 0.00 57612.88 19261.89 41715.09 00:15:07.333 =================================================================================================================== 00:15:07.333 Total : 17725.28 69.24 0.00 0.00 57612.88 19261.89 41715.09 00:15:07.333 0 00:15:07.333 02:34:40 -- target/queue_depth.sh@39 -- # killprocess 1534275 00:15:07.333 02:34:40 -- common/autotest_common.sh@936 -- # '[' -z 1534275 ']' 00:15:07.333 02:34:40 -- common/autotest_common.sh@940 -- # kill -0 1534275 00:15:07.333 02:34:40 -- common/autotest_common.sh@941 -- # uname 00:15:07.333 02:34:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:07.333 02:34:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1534275 00:15:07.333 02:34:40 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:07.333 02:34:40 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:07.333 02:34:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1534275' 00:15:07.333 killing process with pid 1534275 00:15:07.333 02:34:40 -- common/autotest_common.sh@955 -- # kill 1534275 00:15:07.333 Received shutdown signal, test time was about 10.000000 seconds 00:15:07.333 00:15:07.333 Latency(us) 00:15:07.333 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:07.333 =================================================================================================================== 00:15:07.333 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:07.333 02:34:40 -- common/autotest_common.sh@960 -- # wait 1534275 00:15:07.592 02:34:41 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:15:07.592 02:34:41 -- target/queue_depth.sh@43 -- # nvmftestfini 00:15:07.592 02:34:41 -- nvmf/common.sh@477 -- # nvmfcleanup 00:15:07.592 02:34:41 -- nvmf/common.sh@117 -- # sync 00:15:07.592 02:34:41 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:15:07.592 02:34:41 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:15:07.592 02:34:41 -- nvmf/common.sh@120 -- # set +e 00:15:07.592 02:34:41 -- nvmf/common.sh@121 -- # for i in {1..20} 00:15:07.593 02:34:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:15:07.593 rmmod nvme_rdma 00:15:07.593 rmmod nvme_fabrics 00:15:07.852 02:34:41 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:15:07.852 02:34:41 -- nvmf/common.sh@124 -- # set -e 00:15:07.852 02:34:41 -- nvmf/common.sh@125 -- # return 0 00:15:07.852 02:34:41 -- nvmf/common.sh@478 -- # '[' -n 1534137 ']' 00:15:07.852 02:34:41 -- nvmf/common.sh@479 -- # killprocess 1534137 00:15:07.852 02:34:41 -- common/autotest_common.sh@936 -- # '[' -z 1534137 ']' 00:15:07.852 02:34:41 -- common/autotest_common.sh@940 -- # kill -0 1534137 00:15:07.852 02:34:41 -- common/autotest_common.sh@941 -- # uname 00:15:07.852 02:34:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:07.852 02:34:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1534137 00:15:07.852 02:34:41 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:07.852 02:34:41 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:07.852 02:34:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1534137' 00:15:07.852 killing process with pid 1534137 00:15:07.852 02:34:41 -- common/autotest_common.sh@955 -- # kill 1534137 00:15:07.852 02:34:41 -- common/autotest_common.sh@960 -- # wait 1534137 00:15:07.852 [2024-04-27 02:34:41.319089] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:15:08.112 02:34:41 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:15:08.112 02:34:41 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:15:08.112 00:15:08.112 real 0m18.338s 00:15:08.112 user 0m25.912s 00:15:08.112 sys 0m4.895s 00:15:08.112 02:34:41 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:15:08.112 02:34:41 -- common/autotest_common.sh@10 -- # set +x 00:15:08.112 ************************************ 00:15:08.112 END TEST nvmf_queue_depth 00:15:08.112 ************************************ 00:15:08.112 02:34:41 -- nvmf/nvmf.sh@52 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=rdma 00:15:08.112 02:34:41 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:08.112 02:34:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:08.112 02:34:41 -- common/autotest_common.sh@10 -- # set +x 00:15:08.372 ************************************ 00:15:08.372 START TEST nvmf_multipath 00:15:08.372 ************************************ 00:15:08.372 02:34:41 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=rdma 00:15:08.372 * Looking for test storage... 00:15:08.372 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:15:08.372 02:34:41 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:15:08.372 02:34:41 -- nvmf/common.sh@7 -- # uname -s 00:15:08.372 02:34:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:08.372 02:34:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:08.372 02:34:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:08.372 02:34:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:08.372 02:34:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:08.372 02:34:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:08.372 02:34:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:08.372 02:34:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:08.372 02:34:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:08.372 02:34:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:08.372 02:34:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:15:08.372 02:34:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:15:08.372 02:34:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:08.372 02:34:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:08.372 02:34:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:08.372 02:34:41 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:15:08.372 02:34:41 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:15:08.372 02:34:41 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:08.373 02:34:41 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:08.373 02:34:41 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:08.373 02:34:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:08.373 02:34:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:08.373 02:34:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:08.373 02:34:41 -- paths/export.sh@5 -- # export PATH 00:15:08.373 02:34:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:08.373 02:34:41 -- nvmf/common.sh@47 -- # : 0 00:15:08.373 02:34:41 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:15:08.373 02:34:41 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:15:08.373 02:34:41 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:15:08.373 02:34:41 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:08.373 02:34:41 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:08.373 02:34:41 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:15:08.373 02:34:41 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:15:08.373 02:34:41 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:15:08.373 02:34:41 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:08.373 02:34:41 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:08.373 02:34:41 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:15:08.373 02:34:41 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:15:08.373 02:34:41 -- target/multipath.sh@43 -- # nvmftestinit 00:15:08.373 02:34:41 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:15:08.373 02:34:41 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:08.373 02:34:41 -- nvmf/common.sh@437 -- # prepare_net_devs 00:15:08.373 02:34:41 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:15:08.373 02:34:41 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:15:08.373 02:34:41 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:08.373 02:34:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:08.373 02:34:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:08.373 02:34:41 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:15:08.373 02:34:41 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:15:08.373 02:34:41 -- nvmf/common.sh@285 -- # xtrace_disable 00:15:08.373 02:34:41 -- common/autotest_common.sh@10 -- # set +x 00:15:13.647 02:34:47 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:13.648 02:34:47 -- nvmf/common.sh@291 -- # pci_devs=() 00:15:13.648 02:34:47 -- nvmf/common.sh@291 -- # local -a pci_devs 00:15:13.648 02:34:47 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:15:13.648 02:34:47 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:15:13.648 02:34:47 -- nvmf/common.sh@293 -- # pci_drivers=() 00:15:13.648 02:34:47 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:15:13.648 02:34:47 -- nvmf/common.sh@295 -- # net_devs=() 00:15:13.648 02:34:47 -- nvmf/common.sh@295 -- # local -ga net_devs 00:15:13.648 02:34:47 -- nvmf/common.sh@296 -- # e810=() 00:15:13.648 02:34:47 -- nvmf/common.sh@296 -- # local -ga e810 00:15:13.648 02:34:47 -- nvmf/common.sh@297 -- # x722=() 00:15:13.648 02:34:47 -- nvmf/common.sh@297 -- # local -ga x722 00:15:13.648 02:34:47 -- nvmf/common.sh@298 -- # mlx=() 00:15:13.648 02:34:47 -- nvmf/common.sh@298 -- # local -ga mlx 00:15:13.648 02:34:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:13.648 02:34:47 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:13.648 02:34:47 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:13.648 02:34:47 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:13.648 02:34:47 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:13.648 02:34:47 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:13.648 02:34:47 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:13.648 02:34:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:13.648 02:34:47 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:13.648 02:34:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:13.648 02:34:47 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:13.648 02:34:47 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:15:13.648 02:34:47 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:15:13.648 02:34:47 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:15:13.648 02:34:47 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:15:13.648 02:34:47 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:15:13.648 02:34:47 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:15:13.648 02:34:47 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:15:13.648 02:34:47 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:15:13.648 02:34:47 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:15:13.648 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:15:13.648 02:34:47 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:15:13.648 02:34:47 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:15:13.648 02:34:47 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:15:13.648 02:34:47 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:15:13.648 02:34:47 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:15:13.648 02:34:47 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:15:13.648 02:34:47 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:15:13.648 02:34:47 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:15:13.648 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:15:13.648 02:34:47 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:15:13.648 02:34:47 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:15:13.648 02:34:47 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:15:13.648 02:34:47 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:15:13.648 02:34:47 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:15:13.648 02:34:47 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:15:13.648 02:34:47 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:15:13.648 02:34:47 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:15:13.648 02:34:47 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:15:13.648 02:34:47 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:13.648 02:34:47 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:15:13.648 02:34:47 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:13.648 02:34:47 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:15:13.648 Found net devices under 0000:18:00.0: mlx_0_0 00:15:13.648 02:34:47 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:15:13.648 02:34:47 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:15:13.648 02:34:47 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:13.648 02:34:47 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:15:13.648 02:34:47 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:13.648 02:34:47 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:15:13.648 Found net devices under 0000:18:00.1: mlx_0_1 00:15:13.648 02:34:47 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:15:13.648 02:34:47 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:15:13.648 02:34:47 -- nvmf/common.sh@403 -- # is_hw=yes 00:15:13.648 02:34:47 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:15:13.648 02:34:47 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:15:13.648 02:34:47 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:15:13.648 02:34:47 -- nvmf/common.sh@409 -- # rdma_device_init 00:15:13.648 02:34:47 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:15:13.648 02:34:47 -- nvmf/common.sh@58 -- # uname 00:15:13.648 02:34:47 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:15:13.648 02:34:47 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:15:13.648 02:34:47 -- nvmf/common.sh@63 -- # modprobe ib_core 00:15:13.648 02:34:47 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:15:13.648 02:34:47 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:15:13.648 02:34:47 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:15:13.648 02:34:47 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:15:13.648 02:34:47 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:15:13.648 02:34:47 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:15:13.648 02:34:47 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:15:13.648 02:34:47 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:15:13.648 02:34:47 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:15:13.648 02:34:47 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:15:13.648 02:34:47 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:15:13.648 02:34:47 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:15:13.648 02:34:47 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:15:13.648 02:34:47 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:13.648 02:34:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:13.648 02:34:47 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:15:13.648 02:34:47 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:15:13.648 02:34:47 -- nvmf/common.sh@105 -- # continue 2 00:15:13.648 02:34:47 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:13.648 02:34:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:13.648 02:34:47 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:15:13.648 02:34:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:13.648 02:34:47 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:15:13.648 02:34:47 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:15:13.648 02:34:47 -- nvmf/common.sh@105 -- # continue 2 00:15:13.648 02:34:47 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:15:13.648 02:34:47 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:15:13.648 02:34:47 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:15:13.648 02:34:47 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:15:13.648 02:34:47 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:13.648 02:34:47 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:13.648 02:34:47 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:15:13.648 02:34:47 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:15:13.648 02:34:47 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:15:13.648 60: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:15:13.648 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:15:13.648 altname enp24s0f0np0 00:15:13.648 altname ens785f0np0 00:15:13.648 inet 192.168.100.8/24 scope global mlx_0_0 00:15:13.648 valid_lft forever preferred_lft forever 00:15:13.648 02:34:47 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:15:13.648 02:34:47 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:15:13.648 02:34:47 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:15:13.648 02:34:47 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:15:13.648 02:34:47 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:13.648 02:34:47 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:13.907 02:34:47 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:15:13.907 02:34:47 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:15:13.907 02:34:47 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:15:13.907 61: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:15:13.907 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:15:13.907 altname enp24s0f1np1 00:15:13.907 altname ens785f1np1 00:15:13.907 inet 192.168.100.9/24 scope global mlx_0_1 00:15:13.907 valid_lft forever preferred_lft forever 00:15:13.907 02:34:47 -- nvmf/common.sh@411 -- # return 0 00:15:13.907 02:34:47 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:15:13.907 02:34:47 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:15:13.907 02:34:47 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:15:13.907 02:34:47 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:15:13.907 02:34:47 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:15:13.907 02:34:47 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:15:13.907 02:34:47 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:15:13.907 02:34:47 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:15:13.907 02:34:47 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:15:13.907 02:34:47 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:15:13.907 02:34:47 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:13.907 02:34:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:13.907 02:34:47 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:15:13.907 02:34:47 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:15:13.907 02:34:47 -- nvmf/common.sh@105 -- # continue 2 00:15:13.907 02:34:47 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:13.907 02:34:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:13.908 02:34:47 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:15:13.908 02:34:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:13.908 02:34:47 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:15:13.908 02:34:47 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:15:13.908 02:34:47 -- nvmf/common.sh@105 -- # continue 2 00:15:13.908 02:34:47 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:15:13.908 02:34:47 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:15:13.908 02:34:47 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:15:13.908 02:34:47 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:15:13.908 02:34:47 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:13.908 02:34:47 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:13.908 02:34:47 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:15:13.908 02:34:47 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:15:13.908 02:34:47 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:15:13.908 02:34:47 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:13.908 02:34:47 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:15:13.908 02:34:47 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:13.908 02:34:47 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:15:13.908 192.168.100.9' 00:15:13.908 02:34:47 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:15:13.908 192.168.100.9' 00:15:13.908 02:34:47 -- nvmf/common.sh@446 -- # head -n 1 00:15:13.908 02:34:47 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:15:13.908 02:34:47 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:15:13.908 192.168.100.9' 00:15:13.908 02:34:47 -- nvmf/common.sh@447 -- # tail -n +2 00:15:13.908 02:34:47 -- nvmf/common.sh@447 -- # head -n 1 00:15:13.908 02:34:47 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:15:13.908 02:34:47 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:15:13.908 02:34:47 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:15:13.908 02:34:47 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:15:13.908 02:34:47 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:15:13.908 02:34:47 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:15:13.908 02:34:47 -- target/multipath.sh@45 -- # '[' -z 192.168.100.9 ']' 00:15:13.908 02:34:47 -- target/multipath.sh@51 -- # '[' rdma '!=' tcp ']' 00:15:13.908 02:34:47 -- target/multipath.sh@52 -- # echo 'run this test only with TCP transport for now' 00:15:13.908 run this test only with TCP transport for now 00:15:13.908 02:34:47 -- target/multipath.sh@53 -- # nvmftestfini 00:15:13.908 02:34:47 -- nvmf/common.sh@477 -- # nvmfcleanup 00:15:13.908 02:34:47 -- nvmf/common.sh@117 -- # sync 00:15:13.908 02:34:47 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:15:13.908 02:34:47 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:15:13.908 02:34:47 -- nvmf/common.sh@120 -- # set +e 00:15:13.908 02:34:47 -- nvmf/common.sh@121 -- # for i in {1..20} 00:15:13.908 02:34:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:15:13.908 rmmod nvme_rdma 00:15:13.908 rmmod nvme_fabrics 00:15:13.908 02:34:47 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:15:13.908 02:34:47 -- nvmf/common.sh@124 -- # set -e 00:15:13.908 02:34:47 -- nvmf/common.sh@125 -- # return 0 00:15:13.908 02:34:47 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:15:13.908 02:34:47 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:15:13.908 02:34:47 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:15:13.908 02:34:47 -- target/multipath.sh@54 -- # exit 0 00:15:13.908 02:34:47 -- target/multipath.sh@1 -- # nvmftestfini 00:15:13.908 02:34:47 -- nvmf/common.sh@477 -- # nvmfcleanup 00:15:13.908 02:34:47 -- nvmf/common.sh@117 -- # sync 00:15:13.908 02:34:47 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:15:13.908 02:34:47 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:15:13.908 02:34:47 -- nvmf/common.sh@120 -- # set +e 00:15:13.908 02:34:47 -- nvmf/common.sh@121 -- # for i in {1..20} 00:15:13.908 02:34:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:15:13.908 02:34:47 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:15:13.908 02:34:47 -- nvmf/common.sh@124 -- # set -e 00:15:13.908 02:34:47 -- nvmf/common.sh@125 -- # return 0 00:15:13.908 02:34:47 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:15:13.908 02:34:47 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:15:13.908 02:34:47 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:15:13.908 00:15:13.908 real 0m5.707s 00:15:13.908 user 0m1.589s 00:15:13.908 sys 0m4.280s 00:15:13.908 02:34:47 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:15:13.908 02:34:47 -- common/autotest_common.sh@10 -- # set +x 00:15:13.908 ************************************ 00:15:13.908 END TEST nvmf_multipath 00:15:13.908 ************************************ 00:15:13.908 02:34:47 -- nvmf/nvmf.sh@53 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=rdma 00:15:13.908 02:34:47 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:13.908 02:34:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:13.908 02:34:47 -- common/autotest_common.sh@10 -- # set +x 00:15:14.167 ************************************ 00:15:14.167 START TEST nvmf_zcopy 00:15:14.167 ************************************ 00:15:14.167 02:34:47 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=rdma 00:15:14.167 * Looking for test storage... 00:15:14.167 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:15:14.167 02:34:47 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:15:14.167 02:34:47 -- nvmf/common.sh@7 -- # uname -s 00:15:14.167 02:34:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:14.167 02:34:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:14.167 02:34:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:14.167 02:34:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:14.168 02:34:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:14.168 02:34:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:14.168 02:34:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:14.168 02:34:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:14.168 02:34:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:14.168 02:34:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:14.168 02:34:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:15:14.168 02:34:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:15:14.168 02:34:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:14.168 02:34:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:14.168 02:34:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:14.168 02:34:47 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:15:14.168 02:34:47 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:15:14.168 02:34:47 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:14.168 02:34:47 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:14.168 02:34:47 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:14.168 02:34:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:14.168 02:34:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:14.168 02:34:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:14.168 02:34:47 -- paths/export.sh@5 -- # export PATH 00:15:14.168 02:34:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:14.168 02:34:47 -- nvmf/common.sh@47 -- # : 0 00:15:14.168 02:34:47 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:15:14.168 02:34:47 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:15:14.168 02:34:47 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:15:14.168 02:34:47 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:14.168 02:34:47 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:14.168 02:34:47 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:15:14.168 02:34:47 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:15:14.168 02:34:47 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:15:14.168 02:34:47 -- target/zcopy.sh@12 -- # nvmftestinit 00:15:14.168 02:34:47 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:15:14.168 02:34:47 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:14.168 02:34:47 -- nvmf/common.sh@437 -- # prepare_net_devs 00:15:14.168 02:34:47 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:15:14.168 02:34:47 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:15:14.168 02:34:47 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:14.168 02:34:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:14.168 02:34:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:14.427 02:34:47 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:15:14.427 02:34:47 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:15:14.427 02:34:47 -- nvmf/common.sh@285 -- # xtrace_disable 00:15:14.427 02:34:47 -- common/autotest_common.sh@10 -- # set +x 00:15:21.090 02:34:53 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:21.090 02:34:53 -- nvmf/common.sh@291 -- # pci_devs=() 00:15:21.090 02:34:53 -- nvmf/common.sh@291 -- # local -a pci_devs 00:15:21.090 02:34:53 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:15:21.090 02:34:53 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:15:21.090 02:34:53 -- nvmf/common.sh@293 -- # pci_drivers=() 00:15:21.090 02:34:53 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:15:21.090 02:34:53 -- nvmf/common.sh@295 -- # net_devs=() 00:15:21.090 02:34:53 -- nvmf/common.sh@295 -- # local -ga net_devs 00:15:21.090 02:34:53 -- nvmf/common.sh@296 -- # e810=() 00:15:21.090 02:34:53 -- nvmf/common.sh@296 -- # local -ga e810 00:15:21.090 02:34:53 -- nvmf/common.sh@297 -- # x722=() 00:15:21.090 02:34:53 -- nvmf/common.sh@297 -- # local -ga x722 00:15:21.090 02:34:53 -- nvmf/common.sh@298 -- # mlx=() 00:15:21.090 02:34:53 -- nvmf/common.sh@298 -- # local -ga mlx 00:15:21.090 02:34:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:21.090 02:34:53 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:21.090 02:34:53 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:21.090 02:34:53 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:21.090 02:34:53 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:21.090 02:34:53 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:21.090 02:34:53 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:21.090 02:34:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:21.090 02:34:53 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:21.090 02:34:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:21.090 02:34:53 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:21.090 02:34:53 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:15:21.090 02:34:53 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:15:21.090 02:34:53 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:15:21.090 02:34:53 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:15:21.090 02:34:53 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:15:21.090 02:34:53 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:15:21.090 02:34:53 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:15:21.090 02:34:53 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:15:21.090 02:34:53 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:15:21.090 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:15:21.090 02:34:53 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:15:21.090 02:34:53 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:15:21.090 02:34:53 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:15:21.090 02:34:53 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:15:21.090 02:34:53 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:15:21.090 02:34:53 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:15:21.090 02:34:53 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:15:21.090 02:34:53 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:15:21.090 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:15:21.090 02:34:53 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:15:21.090 02:34:53 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:15:21.090 02:34:53 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:15:21.090 02:34:53 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:15:21.090 02:34:53 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:15:21.090 02:34:53 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:15:21.090 02:34:53 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:15:21.090 02:34:53 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:15:21.090 02:34:53 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:15:21.090 02:34:53 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:21.090 02:34:53 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:15:21.090 02:34:53 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:21.090 02:34:53 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:15:21.090 Found net devices under 0000:18:00.0: mlx_0_0 00:15:21.090 02:34:53 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:15:21.090 02:34:53 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:15:21.090 02:34:53 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:21.090 02:34:53 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:15:21.090 02:34:53 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:21.090 02:34:53 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:15:21.090 Found net devices under 0000:18:00.1: mlx_0_1 00:15:21.090 02:34:53 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:15:21.090 02:34:53 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:15:21.090 02:34:53 -- nvmf/common.sh@403 -- # is_hw=yes 00:15:21.090 02:34:53 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:15:21.090 02:34:53 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:15:21.090 02:34:53 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:15:21.090 02:34:53 -- nvmf/common.sh@409 -- # rdma_device_init 00:15:21.090 02:34:53 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:15:21.090 02:34:53 -- nvmf/common.sh@58 -- # uname 00:15:21.090 02:34:53 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:15:21.091 02:34:53 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:15:21.091 02:34:53 -- nvmf/common.sh@63 -- # modprobe ib_core 00:15:21.091 02:34:53 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:15:21.091 02:34:53 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:15:21.091 02:34:53 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:15:21.091 02:34:53 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:15:21.091 02:34:53 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:15:21.091 02:34:53 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:15:21.091 02:34:53 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:15:21.091 02:34:53 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:15:21.091 02:34:53 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:15:21.091 02:34:53 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:15:21.091 02:34:53 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:15:21.091 02:34:53 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:15:21.091 02:34:53 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:15:21.091 02:34:53 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:21.091 02:34:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:21.091 02:34:53 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:15:21.091 02:34:53 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:15:21.091 02:34:53 -- nvmf/common.sh@105 -- # continue 2 00:15:21.091 02:34:53 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:21.091 02:34:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:21.091 02:34:53 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:15:21.091 02:34:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:21.091 02:34:53 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:15:21.091 02:34:53 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:15:21.091 02:34:53 -- nvmf/common.sh@105 -- # continue 2 00:15:21.091 02:34:53 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:15:21.091 02:34:53 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:15:21.091 02:34:53 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:15:21.091 02:34:53 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:15:21.091 02:34:53 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:21.091 02:34:53 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:21.091 02:34:53 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:15:21.091 02:34:53 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:15:21.091 02:34:53 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:15:21.091 60: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:15:21.091 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:15:21.091 altname enp24s0f0np0 00:15:21.091 altname ens785f0np0 00:15:21.091 inet 192.168.100.8/24 scope global mlx_0_0 00:15:21.091 valid_lft forever preferred_lft forever 00:15:21.091 02:34:53 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:15:21.091 02:34:53 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:15:21.091 02:34:53 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:15:21.091 02:34:53 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:21.091 02:34:53 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:15:21.091 02:34:53 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:21.091 02:34:53 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:15:21.091 02:34:53 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:15:21.091 02:34:53 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:15:21.091 61: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:15:21.091 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:15:21.091 altname enp24s0f1np1 00:15:21.091 altname ens785f1np1 00:15:21.091 inet 192.168.100.9/24 scope global mlx_0_1 00:15:21.091 valid_lft forever preferred_lft forever 00:15:21.091 02:34:53 -- nvmf/common.sh@411 -- # return 0 00:15:21.091 02:34:53 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:15:21.091 02:34:53 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:15:21.091 02:34:53 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:15:21.091 02:34:53 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:15:21.091 02:34:53 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:15:21.091 02:34:53 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:15:21.091 02:34:53 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:15:21.091 02:34:53 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:15:21.091 02:34:53 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:15:21.091 02:34:53 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:15:21.091 02:34:53 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:21.091 02:34:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:21.091 02:34:53 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:15:21.091 02:34:53 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:15:21.091 02:34:53 -- nvmf/common.sh@105 -- # continue 2 00:15:21.091 02:34:53 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:21.091 02:34:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:21.091 02:34:53 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:15:21.091 02:34:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:21.091 02:34:53 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:15:21.091 02:34:53 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:15:21.091 02:34:53 -- nvmf/common.sh@105 -- # continue 2 00:15:21.091 02:34:53 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:15:21.091 02:34:53 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:15:21.091 02:34:53 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:15:21.091 02:34:53 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:15:21.091 02:34:53 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:21.091 02:34:53 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:21.091 02:34:53 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:15:21.091 02:34:53 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:15:21.091 02:34:53 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:15:21.091 02:34:53 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:15:21.091 02:34:53 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:21.091 02:34:53 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:21.091 02:34:53 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:15:21.091 192.168.100.9' 00:15:21.091 02:34:53 -- nvmf/common.sh@446 -- # head -n 1 00:15:21.091 02:34:53 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:15:21.091 192.168.100.9' 00:15:21.091 02:34:53 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:15:21.091 02:34:53 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:15:21.091 192.168.100.9' 00:15:21.091 02:34:53 -- nvmf/common.sh@447 -- # tail -n +2 00:15:21.091 02:34:53 -- nvmf/common.sh@447 -- # head -n 1 00:15:21.091 02:34:53 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:15:21.091 02:34:53 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:15:21.091 02:34:53 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:15:21.091 02:34:53 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:15:21.091 02:34:53 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:15:21.091 02:34:53 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:15:21.091 02:34:53 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:15:21.091 02:34:53 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:15:21.091 02:34:53 -- common/autotest_common.sh@710 -- # xtrace_disable 00:15:21.091 02:34:53 -- common/autotest_common.sh@10 -- # set +x 00:15:21.091 02:34:53 -- nvmf/common.sh@470 -- # nvmfpid=1541525 00:15:21.091 02:34:53 -- nvmf/common.sh@471 -- # waitforlisten 1541525 00:15:21.091 02:34:53 -- common/autotest_common.sh@817 -- # '[' -z 1541525 ']' 00:15:21.091 02:34:53 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:21.091 02:34:53 -- common/autotest_common.sh@822 -- # local max_retries=100 00:15:21.091 02:34:53 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:21.091 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:21.091 02:34:53 -- common/autotest_common.sh@826 -- # xtrace_disable 00:15:21.091 02:34:53 -- common/autotest_common.sh@10 -- # set +x 00:15:21.091 02:34:53 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:21.091 [2024-04-27 02:34:53.928191] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:15:21.091 [2024-04-27 02:34:53.928250] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:21.091 EAL: No free 2048 kB hugepages reported on node 1 00:15:21.091 [2024-04-27 02:34:54.000908] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:21.091 [2024-04-27 02:34:54.086151] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:21.091 [2024-04-27 02:34:54.086189] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:21.091 [2024-04-27 02:34:54.086198] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:15:21.091 [2024-04-27 02:34:54.086207] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:15:21.091 [2024-04-27 02:34:54.086214] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:21.091 [2024-04-27 02:34:54.086233] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:21.352 02:34:54 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:15:21.352 02:34:54 -- common/autotest_common.sh@850 -- # return 0 00:15:21.352 02:34:54 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:15:21.352 02:34:54 -- common/autotest_common.sh@716 -- # xtrace_disable 00:15:21.352 02:34:54 -- common/autotest_common.sh@10 -- # set +x 00:15:21.352 02:34:54 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:21.352 02:34:54 -- target/zcopy.sh@15 -- # '[' rdma '!=' tcp ']' 00:15:21.352 02:34:54 -- target/zcopy.sh@16 -- # echo 'Unsupported transport: rdma' 00:15:21.352 Unsupported transport: rdma 00:15:21.352 02:34:54 -- target/zcopy.sh@17 -- # exit 0 00:15:21.352 02:34:54 -- target/zcopy.sh@1 -- # process_shm --id 0 00:15:21.352 02:34:54 -- common/autotest_common.sh@794 -- # type=--id 00:15:21.352 02:34:54 -- common/autotest_common.sh@795 -- # id=0 00:15:21.352 02:34:54 -- common/autotest_common.sh@796 -- # '[' --id = --pid ']' 00:15:21.352 02:34:54 -- common/autotest_common.sh@800 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:15:21.352 02:34:54 -- common/autotest_common.sh@800 -- # shm_files=nvmf_trace.0 00:15:21.352 02:34:54 -- common/autotest_common.sh@802 -- # [[ -z nvmf_trace.0 ]] 00:15:21.352 02:34:54 -- common/autotest_common.sh@806 -- # for n in $shm_files 00:15:21.352 02:34:54 -- common/autotest_common.sh@807 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:15:21.352 nvmf_trace.0 00:15:21.352 02:34:54 -- common/autotest_common.sh@809 -- # return 0 00:15:21.352 02:34:54 -- target/zcopy.sh@1 -- # nvmftestfini 00:15:21.352 02:34:54 -- nvmf/common.sh@477 -- # nvmfcleanup 00:15:21.352 02:34:54 -- nvmf/common.sh@117 -- # sync 00:15:21.352 02:34:54 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:15:21.352 02:34:54 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:15:21.352 02:34:54 -- nvmf/common.sh@120 -- # set +e 00:15:21.352 02:34:54 -- nvmf/common.sh@121 -- # for i in {1..20} 00:15:21.352 02:34:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:15:21.352 rmmod nvme_rdma 00:15:21.352 rmmod nvme_fabrics 00:15:21.352 02:34:54 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:15:21.352 02:34:54 -- nvmf/common.sh@124 -- # set -e 00:15:21.352 02:34:54 -- nvmf/common.sh@125 -- # return 0 00:15:21.352 02:34:54 -- nvmf/common.sh@478 -- # '[' -n 1541525 ']' 00:15:21.352 02:34:54 -- nvmf/common.sh@479 -- # killprocess 1541525 00:15:21.352 02:34:54 -- common/autotest_common.sh@936 -- # '[' -z 1541525 ']' 00:15:21.352 02:34:54 -- common/autotest_common.sh@940 -- # kill -0 1541525 00:15:21.352 02:34:54 -- common/autotest_common.sh@941 -- # uname 00:15:21.352 02:34:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:21.352 02:34:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1541525 00:15:21.352 02:34:54 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:21.352 02:34:54 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:21.352 02:34:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1541525' 00:15:21.352 killing process with pid 1541525 00:15:21.352 02:34:54 -- common/autotest_common.sh@955 -- # kill 1541525 00:15:21.352 02:34:54 -- common/autotest_common.sh@960 -- # wait 1541525 00:15:21.611 02:34:55 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:15:21.611 02:34:55 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:15:21.611 00:15:21.611 real 0m7.442s 00:15:21.611 user 0m3.065s 00:15:21.611 sys 0m5.040s 00:15:21.611 02:34:55 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:15:21.611 02:34:55 -- common/autotest_common.sh@10 -- # set +x 00:15:21.611 ************************************ 00:15:21.611 END TEST nvmf_zcopy 00:15:21.611 ************************************ 00:15:21.611 02:34:55 -- nvmf/nvmf.sh@54 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=rdma 00:15:21.611 02:34:55 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:21.611 02:34:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:21.611 02:34:55 -- common/autotest_common.sh@10 -- # set +x 00:15:21.871 ************************************ 00:15:21.871 START TEST nvmf_nmic 00:15:21.871 ************************************ 00:15:21.871 02:34:55 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=rdma 00:15:21.871 * Looking for test storage... 00:15:21.871 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:15:21.871 02:34:55 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:15:21.871 02:34:55 -- nvmf/common.sh@7 -- # uname -s 00:15:21.871 02:34:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:21.871 02:34:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:21.871 02:34:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:21.871 02:34:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:21.871 02:34:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:21.871 02:34:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:21.871 02:34:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:21.871 02:34:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:21.871 02:34:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:21.871 02:34:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:21.871 02:34:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:15:21.871 02:34:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:15:21.871 02:34:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:21.871 02:34:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:21.871 02:34:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:21.871 02:34:55 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:15:21.871 02:34:55 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:15:21.871 02:34:55 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:21.871 02:34:55 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:21.871 02:34:55 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:21.871 02:34:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:21.871 02:34:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:21.871 02:34:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:21.871 02:34:55 -- paths/export.sh@5 -- # export PATH 00:15:21.871 02:34:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:21.871 02:34:55 -- nvmf/common.sh@47 -- # : 0 00:15:21.871 02:34:55 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:15:21.871 02:34:55 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:15:21.871 02:34:55 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:15:21.871 02:34:55 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:21.871 02:34:55 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:21.871 02:34:55 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:15:21.871 02:34:55 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:15:21.871 02:34:55 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:15:21.871 02:34:55 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:21.871 02:34:55 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:21.871 02:34:55 -- target/nmic.sh@14 -- # nvmftestinit 00:15:21.871 02:34:55 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:15:21.871 02:34:55 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:21.871 02:34:55 -- nvmf/common.sh@437 -- # prepare_net_devs 00:15:21.871 02:34:55 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:15:21.871 02:34:55 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:15:21.871 02:34:55 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:21.872 02:34:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:21.872 02:34:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:21.872 02:34:55 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:15:21.872 02:34:55 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:15:21.872 02:34:55 -- nvmf/common.sh@285 -- # xtrace_disable 00:15:21.872 02:34:55 -- common/autotest_common.sh@10 -- # set +x 00:15:28.443 02:35:00 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:28.443 02:35:00 -- nvmf/common.sh@291 -- # pci_devs=() 00:15:28.443 02:35:00 -- nvmf/common.sh@291 -- # local -a pci_devs 00:15:28.443 02:35:00 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:15:28.443 02:35:00 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:15:28.443 02:35:00 -- nvmf/common.sh@293 -- # pci_drivers=() 00:15:28.443 02:35:00 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:15:28.443 02:35:00 -- nvmf/common.sh@295 -- # net_devs=() 00:15:28.443 02:35:00 -- nvmf/common.sh@295 -- # local -ga net_devs 00:15:28.443 02:35:00 -- nvmf/common.sh@296 -- # e810=() 00:15:28.443 02:35:00 -- nvmf/common.sh@296 -- # local -ga e810 00:15:28.443 02:35:00 -- nvmf/common.sh@297 -- # x722=() 00:15:28.443 02:35:00 -- nvmf/common.sh@297 -- # local -ga x722 00:15:28.443 02:35:00 -- nvmf/common.sh@298 -- # mlx=() 00:15:28.443 02:35:00 -- nvmf/common.sh@298 -- # local -ga mlx 00:15:28.443 02:35:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:28.443 02:35:00 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:28.443 02:35:00 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:28.443 02:35:00 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:28.443 02:35:00 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:28.443 02:35:00 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:28.443 02:35:00 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:28.443 02:35:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:28.443 02:35:00 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:28.443 02:35:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:28.443 02:35:00 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:28.443 02:35:00 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:15:28.443 02:35:00 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:15:28.443 02:35:00 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:15:28.443 02:35:00 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:15:28.443 02:35:00 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:15:28.443 02:35:00 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:15:28.443 02:35:00 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:15:28.444 02:35:00 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:15:28.444 02:35:00 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:15:28.444 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:15:28.444 02:35:00 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:15:28.444 02:35:00 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:15:28.444 02:35:00 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:15:28.444 02:35:00 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:15:28.444 02:35:00 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:15:28.444 02:35:00 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:15:28.444 02:35:00 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:15:28.444 02:35:00 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:15:28.444 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:15:28.444 02:35:00 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:15:28.444 02:35:00 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:15:28.444 02:35:00 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:15:28.444 02:35:00 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:15:28.444 02:35:00 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:15:28.444 02:35:00 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:15:28.444 02:35:00 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:15:28.444 02:35:00 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:15:28.444 02:35:00 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:15:28.444 02:35:00 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:28.444 02:35:00 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:15:28.444 02:35:00 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:28.444 02:35:00 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:15:28.444 Found net devices under 0000:18:00.0: mlx_0_0 00:15:28.444 02:35:00 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:15:28.444 02:35:00 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:15:28.444 02:35:00 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:28.444 02:35:00 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:15:28.444 02:35:00 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:28.444 02:35:00 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:15:28.444 Found net devices under 0000:18:00.1: mlx_0_1 00:15:28.444 02:35:00 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:15:28.444 02:35:00 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:15:28.444 02:35:00 -- nvmf/common.sh@403 -- # is_hw=yes 00:15:28.444 02:35:00 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:15:28.444 02:35:00 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:15:28.444 02:35:00 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:15:28.444 02:35:00 -- nvmf/common.sh@409 -- # rdma_device_init 00:15:28.444 02:35:00 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:15:28.444 02:35:00 -- nvmf/common.sh@58 -- # uname 00:15:28.444 02:35:00 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:15:28.444 02:35:00 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:15:28.444 02:35:00 -- nvmf/common.sh@63 -- # modprobe ib_core 00:15:28.444 02:35:00 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:15:28.444 02:35:00 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:15:28.444 02:35:00 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:15:28.444 02:35:00 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:15:28.444 02:35:00 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:15:28.444 02:35:00 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:15:28.444 02:35:00 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:15:28.444 02:35:00 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:15:28.444 02:35:00 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:15:28.444 02:35:00 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:15:28.444 02:35:00 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:15:28.444 02:35:00 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:15:28.444 02:35:00 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:15:28.444 02:35:00 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:28.444 02:35:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:28.444 02:35:00 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:15:28.444 02:35:00 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:15:28.444 02:35:00 -- nvmf/common.sh@105 -- # continue 2 00:15:28.444 02:35:00 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:28.444 02:35:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:28.444 02:35:00 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:15:28.444 02:35:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:28.444 02:35:00 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:15:28.444 02:35:00 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:15:28.444 02:35:00 -- nvmf/common.sh@105 -- # continue 2 00:15:28.444 02:35:00 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:15:28.444 02:35:00 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:15:28.444 02:35:00 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:15:28.444 02:35:00 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:15:28.444 02:35:00 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:28.444 02:35:00 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:28.444 02:35:00 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:15:28.444 02:35:00 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:15:28.444 02:35:00 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:15:28.444 60: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:15:28.444 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:15:28.444 altname enp24s0f0np0 00:15:28.444 altname ens785f0np0 00:15:28.444 inet 192.168.100.8/24 scope global mlx_0_0 00:15:28.444 valid_lft forever preferred_lft forever 00:15:28.444 02:35:00 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:15:28.444 02:35:00 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:15:28.444 02:35:00 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:15:28.444 02:35:00 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:15:28.444 02:35:00 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:28.444 02:35:00 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:28.444 02:35:00 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:15:28.444 02:35:00 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:15:28.444 02:35:00 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:15:28.444 61: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:15:28.444 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:15:28.444 altname enp24s0f1np1 00:15:28.444 altname ens785f1np1 00:15:28.444 inet 192.168.100.9/24 scope global mlx_0_1 00:15:28.444 valid_lft forever preferred_lft forever 00:15:28.444 02:35:00 -- nvmf/common.sh@411 -- # return 0 00:15:28.444 02:35:00 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:15:28.444 02:35:00 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:15:28.444 02:35:00 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:15:28.444 02:35:00 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:15:28.444 02:35:00 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:15:28.444 02:35:00 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:15:28.444 02:35:00 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:15:28.444 02:35:00 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:15:28.444 02:35:00 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:15:28.444 02:35:01 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:15:28.444 02:35:01 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:28.444 02:35:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:28.444 02:35:01 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:15:28.444 02:35:01 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:15:28.444 02:35:01 -- nvmf/common.sh@105 -- # continue 2 00:15:28.444 02:35:01 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:28.444 02:35:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:28.444 02:35:01 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:15:28.444 02:35:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:28.444 02:35:01 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:15:28.444 02:35:01 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:15:28.444 02:35:01 -- nvmf/common.sh@105 -- # continue 2 00:15:28.444 02:35:01 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:15:28.444 02:35:01 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:15:28.444 02:35:01 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:15:28.444 02:35:01 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:28.444 02:35:01 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:15:28.444 02:35:01 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:28.444 02:35:01 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:15:28.444 02:35:01 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:15:28.444 02:35:01 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:15:28.444 02:35:01 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:28.444 02:35:01 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:15:28.444 02:35:01 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:28.444 02:35:01 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:15:28.444 192.168.100.9' 00:15:28.444 02:35:01 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:15:28.444 192.168.100.9' 00:15:28.444 02:35:01 -- nvmf/common.sh@446 -- # head -n 1 00:15:28.444 02:35:01 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:15:28.444 02:35:01 -- nvmf/common.sh@447 -- # tail -n +2 00:15:28.444 02:35:01 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:15:28.444 192.168.100.9' 00:15:28.444 02:35:01 -- nvmf/common.sh@447 -- # head -n 1 00:15:28.444 02:35:01 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:15:28.444 02:35:01 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:15:28.444 02:35:01 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:15:28.444 02:35:01 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:15:28.444 02:35:01 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:15:28.444 02:35:01 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:15:28.444 02:35:01 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:15:28.444 02:35:01 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:15:28.444 02:35:01 -- common/autotest_common.sh@710 -- # xtrace_disable 00:15:28.444 02:35:01 -- common/autotest_common.sh@10 -- # set +x 00:15:28.444 02:35:01 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:15:28.444 02:35:01 -- nvmf/common.sh@470 -- # nvmfpid=1544458 00:15:28.444 02:35:01 -- nvmf/common.sh@471 -- # waitforlisten 1544458 00:15:28.445 02:35:01 -- common/autotest_common.sh@817 -- # '[' -z 1544458 ']' 00:15:28.445 02:35:01 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:28.445 02:35:01 -- common/autotest_common.sh@822 -- # local max_retries=100 00:15:28.445 02:35:01 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:28.445 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:28.445 02:35:01 -- common/autotest_common.sh@826 -- # xtrace_disable 00:15:28.445 02:35:01 -- common/autotest_common.sh@10 -- # set +x 00:15:28.445 [2024-04-27 02:35:01.120236] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:15:28.445 [2024-04-27 02:35:01.120289] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:28.445 EAL: No free 2048 kB hugepages reported on node 1 00:15:28.445 [2024-04-27 02:35:01.192127] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:28.445 [2024-04-27 02:35:01.280734] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:28.445 [2024-04-27 02:35:01.280773] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:28.445 [2024-04-27 02:35:01.280783] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:15:28.445 [2024-04-27 02:35:01.280792] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:15:28.445 [2024-04-27 02:35:01.280800] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:28.445 [2024-04-27 02:35:01.280847] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:28.445 [2024-04-27 02:35:01.280931] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:28.445 [2024-04-27 02:35:01.280953] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:28.445 [2024-04-27 02:35:01.280955] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:28.445 02:35:01 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:15:28.445 02:35:01 -- common/autotest_common.sh@850 -- # return 0 00:15:28.445 02:35:01 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:15:28.445 02:35:01 -- common/autotest_common.sh@716 -- # xtrace_disable 00:15:28.445 02:35:01 -- common/autotest_common.sh@10 -- # set +x 00:15:28.445 02:35:02 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:28.445 02:35:02 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:15:28.445 02:35:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:28.445 02:35:02 -- common/autotest_common.sh@10 -- # set +x 00:15:28.445 [2024-04-27 02:35:02.041691] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x89a4d0/0x89e9c0) succeed. 00:15:28.445 [2024-04-27 02:35:02.052190] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x89bb10/0x8e0050) succeed. 00:15:28.704 02:35:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:28.704 02:35:02 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:28.704 02:35:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:28.704 02:35:02 -- common/autotest_common.sh@10 -- # set +x 00:15:28.704 Malloc0 00:15:28.704 02:35:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:28.704 02:35:02 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:15:28.704 02:35:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:28.704 02:35:02 -- common/autotest_common.sh@10 -- # set +x 00:15:28.704 02:35:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:28.704 02:35:02 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:28.704 02:35:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:28.704 02:35:02 -- common/autotest_common.sh@10 -- # set +x 00:15:28.704 02:35:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:28.704 02:35:02 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:15:28.704 02:35:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:28.704 02:35:02 -- common/autotest_common.sh@10 -- # set +x 00:15:28.704 [2024-04-27 02:35:02.230701] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:15:28.704 02:35:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:28.704 02:35:02 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:15:28.704 test case1: single bdev can't be used in multiple subsystems 00:15:28.704 02:35:02 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:15:28.704 02:35:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:28.704 02:35:02 -- common/autotest_common.sh@10 -- # set +x 00:15:28.704 02:35:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:28.704 02:35:02 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t rdma -a 192.168.100.8 -s 4420 00:15:28.704 02:35:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:28.704 02:35:02 -- common/autotest_common.sh@10 -- # set +x 00:15:28.704 02:35:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:28.704 02:35:02 -- target/nmic.sh@28 -- # nmic_status=0 00:15:28.704 02:35:02 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:15:28.704 02:35:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:28.704 02:35:02 -- common/autotest_common.sh@10 -- # set +x 00:15:28.704 [2024-04-27 02:35:02.254494] bdev.c:8005:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:15:28.704 [2024-04-27 02:35:02.254516] subsystem.c:1940:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:15:28.704 [2024-04-27 02:35:02.254527] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:28.704 request: 00:15:28.704 { 00:15:28.704 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:15:28.704 "namespace": { 00:15:28.704 "bdev_name": "Malloc0", 00:15:28.704 "no_auto_visible": false 00:15:28.704 }, 00:15:28.704 "method": "nvmf_subsystem_add_ns", 00:15:28.704 "req_id": 1 00:15:28.704 } 00:15:28.704 Got JSON-RPC error response 00:15:28.704 response: 00:15:28.704 { 00:15:28.704 "code": -32602, 00:15:28.704 "message": "Invalid parameters" 00:15:28.704 } 00:15:28.704 02:35:02 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:15:28.704 02:35:02 -- target/nmic.sh@29 -- # nmic_status=1 00:15:28.704 02:35:02 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:15:28.704 02:35:02 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:15:28.704 Adding namespace failed - expected result. 00:15:28.704 02:35:02 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:15:28.704 test case2: host connect to nvmf target in multiple paths 00:15:28.704 02:35:02 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4421 00:15:28.704 02:35:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:28.704 02:35:02 -- common/autotest_common.sh@10 -- # set +x 00:15:28.704 [2024-04-27 02:35:02.266563] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4421 *** 00:15:28.704 02:35:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:28.704 02:35:02 -- target/nmic.sh@41 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:15:29.639 02:35:03 -- target/nmic.sh@42 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4421 00:15:31.016 02:35:04 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:15:31.016 02:35:04 -- common/autotest_common.sh@1184 -- # local i=0 00:15:31.016 02:35:04 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:15:31.016 02:35:04 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:15:31.016 02:35:04 -- common/autotest_common.sh@1191 -- # sleep 2 00:15:32.924 02:35:06 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:15:32.924 02:35:06 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:15:32.924 02:35:06 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:15:32.924 02:35:06 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:15:32.924 02:35:06 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:15:32.924 02:35:06 -- common/autotest_common.sh@1194 -- # return 0 00:15:32.924 02:35:06 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:15:32.924 [global] 00:15:32.924 thread=1 00:15:32.924 invalidate=1 00:15:32.924 rw=write 00:15:32.924 time_based=1 00:15:32.924 runtime=1 00:15:32.924 ioengine=libaio 00:15:32.924 direct=1 00:15:32.924 bs=4096 00:15:32.924 iodepth=1 00:15:32.924 norandommap=0 00:15:32.924 numjobs=1 00:15:32.924 00:15:32.924 verify_dump=1 00:15:32.924 verify_backlog=512 00:15:32.924 verify_state_save=0 00:15:32.924 do_verify=1 00:15:32.924 verify=crc32c-intel 00:15:32.924 [job0] 00:15:32.924 filename=/dev/nvme0n1 00:15:32.924 Could not set queue depth (nvme0n1) 00:15:32.924 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:15:32.924 fio-3.35 00:15:32.924 Starting 1 thread 00:15:34.304 00:15:34.304 job0: (groupid=0, jobs=1): err= 0: pid=1545316: Sat Apr 27 02:35:07 2024 00:15:34.304 read: IOPS=6649, BW=26.0MiB/s (27.2MB/s)(26.0MiB/1001msec) 00:15:34.304 slat (nsec): min=8416, max=30507, avg=8948.28, stdev=872.60 00:15:34.304 clat (usec): min=45, max=104, avg=62.09, stdev= 3.72 00:15:34.304 lat (usec): min=61, max=113, avg=71.04, stdev= 3.80 00:15:34.304 clat percentiles (usec): 00:15:34.304 | 1.00th=[ 56], 5.00th=[ 57], 10.00th=[ 58], 20.00th=[ 60], 00:15:34.304 | 30.00th=[ 60], 40.00th=[ 61], 50.00th=[ 62], 60.00th=[ 63], 00:15:34.304 | 70.00th=[ 64], 80.00th=[ 66], 90.00th=[ 68], 95.00th=[ 69], 00:15:34.304 | 99.00th=[ 73], 99.50th=[ 75], 99.90th=[ 78], 99.95th=[ 80], 00:15:34.304 | 99.99th=[ 105] 00:15:34.304 write: IOPS=7056, BW=27.6MiB/s (28.9MB/s)(27.6MiB/1001msec); 0 zone resets 00:15:34.304 slat (nsec): min=9125, max=44767, avg=11118.31, stdev=1141.44 00:15:34.304 clat (usec): min=38, max=424, avg=59.63, stdev= 6.35 00:15:34.304 lat (usec): min=61, max=435, avg=70.75, stdev= 6.51 00:15:34.304 clat percentiles (usec): 00:15:34.304 | 1.00th=[ 53], 5.00th=[ 55], 10.00th=[ 56], 20.00th=[ 57], 00:15:34.304 | 30.00th=[ 58], 40.00th=[ 59], 50.00th=[ 60], 60.00th=[ 61], 00:15:34.304 | 70.00th=[ 62], 80.00th=[ 63], 90.00th=[ 65], 95.00th=[ 67], 00:15:34.304 | 99.00th=[ 71], 99.50th=[ 72], 99.90th=[ 103], 99.95th=[ 159], 00:15:34.304 | 99.99th=[ 424] 00:15:34.304 bw ( KiB/s): min=28672, max=28672, per=100.00%, avg=28672.00, stdev= 0.00, samples=1 00:15:34.304 iops : min= 7168, max= 7168, avg=7168.00, stdev= 0.00, samples=1 00:15:34.304 lat (usec) : 50=0.06%, 100=99.88%, 250=0.06%, 500=0.01% 00:15:34.304 cpu : usr=8.20%, sys=13.80%, ctx=13720, majf=0, minf=1 00:15:34.304 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:15:34.304 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:34.304 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:34.304 issued rwts: total=6656,7064,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:34.304 latency : target=0, window=0, percentile=100.00%, depth=1 00:15:34.304 00:15:34.304 Run status group 0 (all jobs): 00:15:34.304 READ: bw=26.0MiB/s (27.2MB/s), 26.0MiB/s-26.0MiB/s (27.2MB/s-27.2MB/s), io=26.0MiB (27.3MB), run=1001-1001msec 00:15:34.304 WRITE: bw=27.6MiB/s (28.9MB/s), 27.6MiB/s-27.6MiB/s (28.9MB/s-28.9MB/s), io=27.6MiB (28.9MB), run=1001-1001msec 00:15:34.304 00:15:34.304 Disk stats (read/write): 00:15:34.304 nvme0n1: ios=6194/6182, merge=0/0, ticks=349/333, in_queue=682, util=90.68% 00:15:34.304 02:35:07 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:15:36.212 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:15:36.212 02:35:09 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:15:36.212 02:35:09 -- common/autotest_common.sh@1205 -- # local i=0 00:15:36.212 02:35:09 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:15:36.212 02:35:09 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:36.212 02:35:09 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:15:36.212 02:35:09 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:36.212 02:35:09 -- common/autotest_common.sh@1217 -- # return 0 00:15:36.212 02:35:09 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:15:36.212 02:35:09 -- target/nmic.sh@53 -- # nvmftestfini 00:15:36.212 02:35:09 -- nvmf/common.sh@477 -- # nvmfcleanup 00:15:36.212 02:35:09 -- nvmf/common.sh@117 -- # sync 00:15:36.212 02:35:09 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:15:36.212 02:35:09 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:15:36.212 02:35:09 -- nvmf/common.sh@120 -- # set +e 00:15:36.212 02:35:09 -- nvmf/common.sh@121 -- # for i in {1..20} 00:15:36.212 02:35:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:15:36.212 rmmod nvme_rdma 00:15:36.212 rmmod nvme_fabrics 00:15:36.212 02:35:09 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:15:36.212 02:35:09 -- nvmf/common.sh@124 -- # set -e 00:15:36.212 02:35:09 -- nvmf/common.sh@125 -- # return 0 00:15:36.212 02:35:09 -- nvmf/common.sh@478 -- # '[' -n 1544458 ']' 00:15:36.212 02:35:09 -- nvmf/common.sh@479 -- # killprocess 1544458 00:15:36.212 02:35:09 -- common/autotest_common.sh@936 -- # '[' -z 1544458 ']' 00:15:36.212 02:35:09 -- common/autotest_common.sh@940 -- # kill -0 1544458 00:15:36.212 02:35:09 -- common/autotest_common.sh@941 -- # uname 00:15:36.212 02:35:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:36.212 02:35:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1544458 00:15:36.212 02:35:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:36.212 02:35:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:36.213 02:35:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1544458' 00:15:36.213 killing process with pid 1544458 00:15:36.213 02:35:09 -- common/autotest_common.sh@955 -- # kill 1544458 00:15:36.213 02:35:09 -- common/autotest_common.sh@960 -- # wait 1544458 00:15:36.213 [2024-04-27 02:35:09.785096] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:15:36.472 02:35:10 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:15:36.472 02:35:10 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:15:36.472 00:15:36.472 real 0m14.753s 00:15:36.472 user 0m39.037s 00:15:36.472 sys 0m5.294s 00:15:36.472 02:35:10 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:15:36.472 02:35:10 -- common/autotest_common.sh@10 -- # set +x 00:15:36.472 ************************************ 00:15:36.472 END TEST nvmf_nmic 00:15:36.472 ************************************ 00:15:36.472 02:35:10 -- nvmf/nvmf.sh@55 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=rdma 00:15:36.472 02:35:10 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:36.472 02:35:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:36.472 02:35:10 -- common/autotest_common.sh@10 -- # set +x 00:15:36.731 ************************************ 00:15:36.731 START TEST nvmf_fio_target 00:15:36.731 ************************************ 00:15:36.731 02:35:10 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=rdma 00:15:36.731 * Looking for test storage... 00:15:36.731 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:15:36.731 02:35:10 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:15:36.731 02:35:10 -- nvmf/common.sh@7 -- # uname -s 00:15:36.731 02:35:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:36.731 02:35:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:36.731 02:35:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:36.731 02:35:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:36.731 02:35:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:36.731 02:35:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:36.731 02:35:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:36.731 02:35:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:36.731 02:35:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:36.731 02:35:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:36.731 02:35:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:15:36.731 02:35:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:15:36.731 02:35:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:36.731 02:35:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:36.731 02:35:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:36.731 02:35:10 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:15:36.731 02:35:10 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:15:36.731 02:35:10 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:36.731 02:35:10 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:36.731 02:35:10 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:36.731 02:35:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:36.731 02:35:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:36.731 02:35:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:36.731 02:35:10 -- paths/export.sh@5 -- # export PATH 00:15:36.731 02:35:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:36.731 02:35:10 -- nvmf/common.sh@47 -- # : 0 00:15:36.731 02:35:10 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:15:36.731 02:35:10 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:15:36.731 02:35:10 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:15:36.731 02:35:10 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:36.731 02:35:10 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:36.731 02:35:10 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:15:36.731 02:35:10 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:15:36.731 02:35:10 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:15:36.990 02:35:10 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:36.990 02:35:10 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:36.990 02:35:10 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:15:36.990 02:35:10 -- target/fio.sh@16 -- # nvmftestinit 00:15:36.990 02:35:10 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:15:36.990 02:35:10 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:36.990 02:35:10 -- nvmf/common.sh@437 -- # prepare_net_devs 00:15:36.990 02:35:10 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:15:36.990 02:35:10 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:15:36.990 02:35:10 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:36.990 02:35:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:36.990 02:35:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:36.990 02:35:10 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:15:36.990 02:35:10 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:15:36.990 02:35:10 -- nvmf/common.sh@285 -- # xtrace_disable 00:15:36.990 02:35:10 -- common/autotest_common.sh@10 -- # set +x 00:15:42.268 02:35:15 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:42.268 02:35:15 -- nvmf/common.sh@291 -- # pci_devs=() 00:15:42.268 02:35:15 -- nvmf/common.sh@291 -- # local -a pci_devs 00:15:42.268 02:35:15 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:15:42.268 02:35:15 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:15:42.268 02:35:15 -- nvmf/common.sh@293 -- # pci_drivers=() 00:15:42.268 02:35:15 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:15:42.268 02:35:15 -- nvmf/common.sh@295 -- # net_devs=() 00:15:42.268 02:35:15 -- nvmf/common.sh@295 -- # local -ga net_devs 00:15:42.268 02:35:15 -- nvmf/common.sh@296 -- # e810=() 00:15:42.268 02:35:15 -- nvmf/common.sh@296 -- # local -ga e810 00:15:42.268 02:35:15 -- nvmf/common.sh@297 -- # x722=() 00:15:42.268 02:35:15 -- nvmf/common.sh@297 -- # local -ga x722 00:15:42.268 02:35:15 -- nvmf/common.sh@298 -- # mlx=() 00:15:42.268 02:35:15 -- nvmf/common.sh@298 -- # local -ga mlx 00:15:42.268 02:35:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:42.268 02:35:15 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:42.268 02:35:15 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:42.268 02:35:15 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:42.268 02:35:15 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:42.268 02:35:15 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:42.268 02:35:15 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:42.268 02:35:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:42.268 02:35:15 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:42.268 02:35:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:42.268 02:35:15 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:42.268 02:35:15 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:15:42.268 02:35:15 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:15:42.268 02:35:15 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:15:42.268 02:35:15 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:15:42.268 02:35:15 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:15:42.268 02:35:15 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:15:42.268 02:35:15 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:15:42.268 02:35:15 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:15:42.268 02:35:15 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:15:42.268 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:15:42.268 02:35:15 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:15:42.268 02:35:15 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:15:42.268 02:35:15 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:15:42.268 02:35:15 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:15:42.268 02:35:15 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:15:42.268 02:35:15 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:15:42.268 02:35:15 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:15:42.268 02:35:15 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:15:42.269 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:15:42.269 02:35:15 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:15:42.269 02:35:15 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:15:42.269 02:35:15 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:15:42.269 02:35:15 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:15:42.269 02:35:15 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:15:42.269 02:35:15 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:15:42.269 02:35:15 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:15:42.269 02:35:15 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:15:42.269 02:35:15 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:15:42.269 02:35:15 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:42.269 02:35:15 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:15:42.269 02:35:15 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:42.269 02:35:15 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:15:42.269 Found net devices under 0000:18:00.0: mlx_0_0 00:15:42.269 02:35:15 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:15:42.269 02:35:15 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:15:42.269 02:35:15 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:42.269 02:35:15 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:15:42.269 02:35:15 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:42.269 02:35:15 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:15:42.269 Found net devices under 0000:18:00.1: mlx_0_1 00:15:42.269 02:35:15 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:15:42.269 02:35:15 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:15:42.269 02:35:15 -- nvmf/common.sh@403 -- # is_hw=yes 00:15:42.269 02:35:15 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:15:42.269 02:35:15 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:15:42.269 02:35:15 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:15:42.269 02:35:15 -- nvmf/common.sh@409 -- # rdma_device_init 00:15:42.269 02:35:15 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:15:42.269 02:35:15 -- nvmf/common.sh@58 -- # uname 00:15:42.269 02:35:15 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:15:42.269 02:35:15 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:15:42.269 02:35:15 -- nvmf/common.sh@63 -- # modprobe ib_core 00:15:42.269 02:35:15 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:15:42.269 02:35:15 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:15:42.269 02:35:15 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:15:42.269 02:35:15 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:15:42.269 02:35:15 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:15:42.269 02:35:15 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:15:42.269 02:35:15 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:15:42.269 02:35:15 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:15:42.269 02:35:15 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:15:42.269 02:35:15 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:15:42.269 02:35:15 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:15:42.269 02:35:15 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:15:42.529 02:35:15 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:15:42.529 02:35:15 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:42.529 02:35:15 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:42.529 02:35:15 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:15:42.529 02:35:15 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:15:42.529 02:35:15 -- nvmf/common.sh@105 -- # continue 2 00:15:42.529 02:35:15 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:42.529 02:35:15 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:42.529 02:35:15 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:15:42.529 02:35:15 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:42.529 02:35:15 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:15:42.529 02:35:15 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:15:42.529 02:35:15 -- nvmf/common.sh@105 -- # continue 2 00:15:42.529 02:35:15 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:15:42.529 02:35:15 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:15:42.529 02:35:15 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:15:42.529 02:35:15 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:15:42.529 02:35:15 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:42.529 02:35:15 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:42.529 02:35:15 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:15:42.529 02:35:15 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:15:42.529 02:35:15 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:15:42.529 60: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:15:42.529 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:15:42.529 altname enp24s0f0np0 00:15:42.529 altname ens785f0np0 00:15:42.529 inet 192.168.100.8/24 scope global mlx_0_0 00:15:42.529 valid_lft forever preferred_lft forever 00:15:42.529 02:35:15 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:15:42.529 02:35:15 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:15:42.529 02:35:15 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:15:42.529 02:35:15 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:15:42.529 02:35:15 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:42.529 02:35:15 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:42.529 02:35:15 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:15:42.529 02:35:15 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:15:42.529 02:35:15 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:15:42.529 61: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:15:42.529 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:15:42.529 altname enp24s0f1np1 00:15:42.529 altname ens785f1np1 00:15:42.529 inet 192.168.100.9/24 scope global mlx_0_1 00:15:42.529 valid_lft forever preferred_lft forever 00:15:42.529 02:35:15 -- nvmf/common.sh@411 -- # return 0 00:15:42.529 02:35:15 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:15:42.529 02:35:15 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:15:42.529 02:35:15 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:15:42.529 02:35:15 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:15:42.529 02:35:15 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:15:42.529 02:35:15 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:15:42.529 02:35:15 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:15:42.529 02:35:15 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:15:42.529 02:35:15 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:15:42.529 02:35:15 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:15:42.529 02:35:15 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:42.529 02:35:15 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:42.529 02:35:15 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:15:42.529 02:35:15 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:15:42.529 02:35:15 -- nvmf/common.sh@105 -- # continue 2 00:15:42.529 02:35:15 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:42.529 02:35:15 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:42.529 02:35:15 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:15:42.529 02:35:15 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:42.529 02:35:15 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:15:42.529 02:35:15 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:15:42.529 02:35:15 -- nvmf/common.sh@105 -- # continue 2 00:15:42.529 02:35:15 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:15:42.529 02:35:15 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:15:42.529 02:35:15 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:15:42.529 02:35:15 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:15:42.529 02:35:15 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:42.529 02:35:15 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:42.529 02:35:15 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:15:42.529 02:35:15 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:15:42.529 02:35:15 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:15:42.529 02:35:15 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:15:42.529 02:35:15 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:42.529 02:35:15 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:42.529 02:35:15 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:15:42.529 192.168.100.9' 00:15:42.529 02:35:15 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:15:42.529 192.168.100.9' 00:15:42.529 02:35:15 -- nvmf/common.sh@446 -- # head -n 1 00:15:42.529 02:35:16 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:15:42.529 02:35:16 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:15:42.529 192.168.100.9' 00:15:42.529 02:35:16 -- nvmf/common.sh@447 -- # head -n 1 00:15:42.529 02:35:16 -- nvmf/common.sh@447 -- # tail -n +2 00:15:42.529 02:35:16 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:15:42.529 02:35:16 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:15:42.529 02:35:16 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:15:42.529 02:35:16 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:15:42.529 02:35:16 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:15:42.529 02:35:16 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:15:42.529 02:35:16 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:15:42.529 02:35:16 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:15:42.529 02:35:16 -- common/autotest_common.sh@710 -- # xtrace_disable 00:15:42.529 02:35:16 -- common/autotest_common.sh@10 -- # set +x 00:15:42.529 02:35:16 -- nvmf/common.sh@470 -- # nvmfpid=1548596 00:15:42.529 02:35:16 -- nvmf/common.sh@471 -- # waitforlisten 1548596 00:15:42.529 02:35:16 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:15:42.529 02:35:16 -- common/autotest_common.sh@817 -- # '[' -z 1548596 ']' 00:15:42.529 02:35:16 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:42.529 02:35:16 -- common/autotest_common.sh@822 -- # local max_retries=100 00:15:42.529 02:35:16 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:42.529 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:42.529 02:35:16 -- common/autotest_common.sh@826 -- # xtrace_disable 00:15:42.529 02:35:16 -- common/autotest_common.sh@10 -- # set +x 00:15:42.529 [2024-04-27 02:35:16.098571] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:15:42.529 [2024-04-27 02:35:16.098631] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:42.529 EAL: No free 2048 kB hugepages reported on node 1 00:15:42.789 [2024-04-27 02:35:16.171681] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:42.789 [2024-04-27 02:35:16.257034] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:42.789 [2024-04-27 02:35:16.257079] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:42.789 [2024-04-27 02:35:16.257088] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:15:42.789 [2024-04-27 02:35:16.257097] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:15:42.789 [2024-04-27 02:35:16.257104] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:42.789 [2024-04-27 02:35:16.257157] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:42.789 [2024-04-27 02:35:16.257244] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:42.789 [2024-04-27 02:35:16.257309] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:42.789 [2024-04-27 02:35:16.257311] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:43.358 02:35:16 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:15:43.358 02:35:16 -- common/autotest_common.sh@850 -- # return 0 00:15:43.358 02:35:16 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:15:43.358 02:35:16 -- common/autotest_common.sh@716 -- # xtrace_disable 00:15:43.358 02:35:16 -- common/autotest_common.sh@10 -- # set +x 00:15:43.358 02:35:16 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:43.358 02:35:16 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:15:43.618 [2024-04-27 02:35:17.159887] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x245b4d0/0x245f9c0) succeed. 00:15:43.618 [2024-04-27 02:35:17.170364] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x245cb10/0x24a1050) succeed. 00:15:43.878 02:35:17 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:15:44.139 02:35:17 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:15:44.139 02:35:17 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:15:44.139 02:35:17 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:15:44.139 02:35:17 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:15:44.399 02:35:17 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:15:44.399 02:35:17 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:15:44.658 02:35:18 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:15:44.658 02:35:18 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:15:44.917 02:35:18 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:15:44.917 02:35:18 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:15:44.917 02:35:18 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:15:45.206 02:35:18 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:15:45.206 02:35:18 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:15:45.466 02:35:18 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:15:45.466 02:35:18 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:15:45.725 02:35:19 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:15:45.725 02:35:19 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:15:45.725 02:35:19 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:45.985 02:35:19 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:15:45.985 02:35:19 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:15:46.246 02:35:19 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:15:46.246 [2024-04-27 02:35:19.848444] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:15:46.509 02:35:19 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:15:46.509 02:35:20 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:15:46.771 02:35:20 -- target/fio.sh@46 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:15:47.709 02:35:21 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:15:47.709 02:35:21 -- common/autotest_common.sh@1184 -- # local i=0 00:15:47.709 02:35:21 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:15:47.709 02:35:21 -- common/autotest_common.sh@1186 -- # [[ -n 4 ]] 00:15:47.709 02:35:21 -- common/autotest_common.sh@1187 -- # nvme_device_counter=4 00:15:47.709 02:35:21 -- common/autotest_common.sh@1191 -- # sleep 2 00:15:49.616 02:35:23 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:15:49.616 02:35:23 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:15:49.616 02:35:23 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:15:49.874 02:35:23 -- common/autotest_common.sh@1193 -- # nvme_devices=4 00:15:49.874 02:35:23 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:15:49.874 02:35:23 -- common/autotest_common.sh@1194 -- # return 0 00:15:49.874 02:35:23 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:15:49.874 [global] 00:15:49.874 thread=1 00:15:49.874 invalidate=1 00:15:49.874 rw=write 00:15:49.874 time_based=1 00:15:49.874 runtime=1 00:15:49.874 ioengine=libaio 00:15:49.874 direct=1 00:15:49.874 bs=4096 00:15:49.874 iodepth=1 00:15:49.874 norandommap=0 00:15:49.874 numjobs=1 00:15:49.874 00:15:49.874 verify_dump=1 00:15:49.874 verify_backlog=512 00:15:49.874 verify_state_save=0 00:15:49.874 do_verify=1 00:15:49.874 verify=crc32c-intel 00:15:49.875 [job0] 00:15:49.875 filename=/dev/nvme0n1 00:15:49.875 [job1] 00:15:49.875 filename=/dev/nvme0n2 00:15:49.875 [job2] 00:15:49.875 filename=/dev/nvme0n3 00:15:49.875 [job3] 00:15:49.875 filename=/dev/nvme0n4 00:15:49.875 Could not set queue depth (nvme0n1) 00:15:49.875 Could not set queue depth (nvme0n2) 00:15:49.875 Could not set queue depth (nvme0n3) 00:15:49.875 Could not set queue depth (nvme0n4) 00:15:50.134 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:15:50.134 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:15:50.134 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:15:50.134 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:15:50.134 fio-3.35 00:15:50.134 Starting 4 threads 00:15:51.513 00:15:51.513 job0: (groupid=0, jobs=1): err= 0: pid=1549690: Sat Apr 27 02:35:24 2024 00:15:51.513 read: IOPS=4799, BW=18.7MiB/s (19.7MB/s)(18.8MiB/1001msec) 00:15:51.513 slat (nsec): min=8397, max=32324, avg=9073.56, stdev=861.20 00:15:51.513 clat (usec): min=64, max=319, avg=88.92, stdev=12.81 00:15:51.513 lat (usec): min=73, max=327, avg=98.00, stdev=12.88 00:15:51.513 clat percentiles (usec): 00:15:51.513 | 1.00th=[ 73], 5.00th=[ 77], 10.00th=[ 78], 20.00th=[ 81], 00:15:51.513 | 30.00th=[ 83], 40.00th=[ 84], 50.00th=[ 86], 60.00th=[ 88], 00:15:51.513 | 70.00th=[ 91], 80.00th=[ 95], 90.00th=[ 109], 95.00th=[ 115], 00:15:51.513 | 99.00th=[ 125], 99.50th=[ 133], 99.90th=[ 188], 99.95th=[ 192], 00:15:51.513 | 99.99th=[ 318] 00:15:51.513 write: IOPS=5114, BW=20.0MiB/s (20.9MB/s)(20.0MiB/1001msec); 0 zone resets 00:15:51.513 slat (nsec): min=10464, max=41720, avg=11203.96, stdev=1098.32 00:15:51.513 clat (usec): min=63, max=253, avg=88.27, stdev=15.53 00:15:51.513 lat (usec): min=74, max=264, avg=99.47, stdev=15.74 00:15:51.513 clat percentiles (usec): 00:15:51.513 | 1.00th=[ 70], 5.00th=[ 73], 10.00th=[ 75], 20.00th=[ 78], 00:15:51.513 | 30.00th=[ 80], 40.00th=[ 82], 50.00th=[ 84], 60.00th=[ 86], 00:15:51.513 | 70.00th=[ 90], 80.00th=[ 101], 90.00th=[ 110], 95.00th=[ 118], 00:15:51.513 | 99.00th=[ 135], 99.50th=[ 149], 99.90th=[ 204], 99.95th=[ 225], 00:15:51.513 | 99.99th=[ 253] 00:15:51.513 bw ( KiB/s): min=20480, max=20480, per=33.75%, avg=20480.00, stdev= 0.00, samples=1 00:15:51.513 iops : min= 5120, max= 5120, avg=5120.00, stdev= 0.00, samples=1 00:15:51.513 lat (usec) : 100=81.29%, 250=18.68%, 500=0.03% 00:15:51.513 cpu : usr=5.50%, sys=10.90%, ctx=9924, majf=0, minf=1 00:15:51.513 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:15:51.513 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:51.513 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:51.513 issued rwts: total=4804,5120,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:51.513 latency : target=0, window=0, percentile=100.00%, depth=1 00:15:51.513 job1: (groupid=0, jobs=1): err= 0: pid=1549691: Sat Apr 27 02:35:24 2024 00:15:51.513 read: IOPS=3090, BW=12.1MiB/s (12.7MB/s)(12.1MiB/1001msec) 00:15:51.513 slat (nsec): min=8362, max=29752, avg=9417.75, stdev=986.25 00:15:51.513 clat (usec): min=71, max=301, avg=135.18, stdev=36.44 00:15:51.513 lat (usec): min=80, max=310, avg=144.60, stdev=36.57 00:15:51.513 clat percentiles (usec): 00:15:51.513 | 1.00th=[ 77], 5.00th=[ 81], 10.00th=[ 84], 20.00th=[ 100], 00:15:51.513 | 30.00th=[ 110], 40.00th=[ 116], 50.00th=[ 135], 60.00th=[ 159], 00:15:51.513 | 70.00th=[ 165], 80.00th=[ 172], 90.00th=[ 178], 95.00th=[ 184], 00:15:51.513 | 99.00th=[ 206], 99.50th=[ 219], 99.90th=[ 237], 99.95th=[ 251], 00:15:51.513 | 99.99th=[ 302] 00:15:51.513 write: IOPS=3580, BW=14.0MiB/s (14.7MB/s)(14.0MiB/1001msec); 0 zone resets 00:15:51.513 slat (nsec): min=10620, max=47864, avg=11715.34, stdev=1540.69 00:15:51.513 clat (usec): min=65, max=619, avg=138.73, stdev=38.00 00:15:51.513 lat (usec): min=78, max=631, avg=150.44, stdev=38.18 00:15:51.513 clat percentiles (usec): 00:15:51.513 | 1.00th=[ 74], 5.00th=[ 80], 10.00th=[ 89], 20.00th=[ 101], 00:15:51.513 | 30.00th=[ 109], 40.00th=[ 119], 50.00th=[ 153], 60.00th=[ 161], 00:15:51.513 | 70.00th=[ 167], 80.00th=[ 172], 90.00th=[ 178], 95.00th=[ 186], 00:15:51.513 | 99.00th=[ 223], 99.50th=[ 229], 99.90th=[ 235], 99.95th=[ 245], 00:15:51.513 | 99.99th=[ 619] 00:15:51.513 bw ( KiB/s): min=16384, max=16384, per=27.00%, avg=16384.00, stdev= 0.00, samples=1 00:15:51.513 iops : min= 4096, max= 4096, avg=4096.00, stdev= 0.00, samples=1 00:15:51.513 lat (usec) : 100=19.05%, 250=80.91%, 500=0.03%, 750=0.01% 00:15:51.513 cpu : usr=3.70%, sys=7.70%, ctx=6679, majf=0, minf=1 00:15:51.513 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:15:51.513 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:51.513 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:51.513 issued rwts: total=3094,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:51.513 latency : target=0, window=0, percentile=100.00%, depth=1 00:15:51.513 job2: (groupid=0, jobs=1): err= 0: pid=1549698: Sat Apr 27 02:35:24 2024 00:15:51.513 read: IOPS=3068, BW=12.0MiB/s (12.6MB/s)(12.0MiB/1001msec) 00:15:51.513 slat (nsec): min=8239, max=26454, avg=9497.10, stdev=1110.61 00:15:51.513 clat (usec): min=84, max=247, avg=152.80, stdev=27.80 00:15:51.513 lat (usec): min=93, max=256, avg=162.30, stdev=27.96 00:15:51.513 clat percentiles (usec): 00:15:51.513 | 1.00th=[ 90], 5.00th=[ 100], 10.00th=[ 116], 20.00th=[ 125], 00:15:51.513 | 30.00th=[ 135], 40.00th=[ 153], 50.00th=[ 163], 60.00th=[ 167], 00:15:51.513 | 70.00th=[ 172], 80.00th=[ 176], 90.00th=[ 182], 95.00th=[ 186], 00:15:51.513 | 99.00th=[ 215], 99.50th=[ 229], 99.90th=[ 241], 99.95th=[ 243], 00:15:51.513 | 99.99th=[ 247] 00:15:51.513 write: IOPS=3203, BW=12.5MiB/s (13.1MB/s)(12.5MiB/1001msec); 0 zone resets 00:15:51.513 slat (nsec): min=10616, max=48530, avg=11874.31, stdev=1652.83 00:15:51.513 clat (usec): min=74, max=239, avg=140.36, stdev=31.48 00:15:51.513 lat (usec): min=86, max=251, avg=152.23, stdev=31.73 00:15:51.513 clat percentiles (usec): 00:15:51.513 | 1.00th=[ 84], 5.00th=[ 90], 10.00th=[ 96], 20.00th=[ 114], 00:15:51.513 | 30.00th=[ 119], 40.00th=[ 125], 50.00th=[ 147], 60.00th=[ 157], 00:15:51.513 | 70.00th=[ 161], 80.00th=[ 167], 90.00th=[ 174], 95.00th=[ 186], 00:15:51.513 | 99.00th=[ 219], 99.50th=[ 225], 99.90th=[ 235], 99.95th=[ 239], 00:15:51.513 | 99.99th=[ 239] 00:15:51.513 bw ( KiB/s): min=16048, max=16048, per=26.45%, avg=16048.00, stdev= 0.00, samples=1 00:15:51.513 iops : min= 4012, max= 4012, avg=4012.00, stdev= 0.00, samples=1 00:15:51.513 lat (usec) : 100=8.60%, 250=91.40% 00:15:51.513 cpu : usr=3.70%, sys=7.10%, ctx=6280, majf=0, minf=1 00:15:51.513 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:15:51.513 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:51.513 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:51.513 issued rwts: total=3072,3207,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:51.513 latency : target=0, window=0, percentile=100.00%, depth=1 00:15:51.513 job3: (groupid=0, jobs=1): err= 0: pid=1549702: Sat Apr 27 02:35:24 2024 00:15:51.513 read: IOPS=3068, BW=12.0MiB/s (12.6MB/s)(12.0MiB/1001msec) 00:15:51.513 slat (nsec): min=8145, max=29609, avg=9473.27, stdev=1071.09 00:15:51.513 clat (usec): min=80, max=229, avg=153.65, stdev=25.88 00:15:51.513 lat (usec): min=90, max=238, avg=163.13, stdev=26.02 00:15:51.513 clat percentiles (usec): 00:15:51.513 | 1.00th=[ 91], 5.00th=[ 110], 10.00th=[ 120], 20.00th=[ 127], 00:15:51.513 | 30.00th=[ 137], 40.00th=[ 151], 50.00th=[ 161], 60.00th=[ 167], 00:15:51.513 | 70.00th=[ 172], 80.00th=[ 176], 90.00th=[ 182], 95.00th=[ 186], 00:15:51.513 | 99.00th=[ 206], 99.50th=[ 215], 99.90th=[ 227], 99.95th=[ 229], 00:15:51.513 | 99.99th=[ 229] 00:15:51.513 write: IOPS=3269, BW=12.8MiB/s (13.4MB/s)(12.8MiB/1001msec); 0 zone resets 00:15:51.513 slat (nsec): min=10777, max=46241, avg=11796.82, stdev=1409.80 00:15:51.513 clat (usec): min=75, max=231, avg=136.59, stdev=31.12 00:15:51.513 lat (usec): min=87, max=243, avg=148.39, stdev=31.21 00:15:51.513 clat percentiles (usec): 00:15:51.513 | 1.00th=[ 81], 5.00th=[ 86], 10.00th=[ 90], 20.00th=[ 111], 00:15:51.513 | 30.00th=[ 118], 40.00th=[ 123], 50.00th=[ 139], 60.00th=[ 155], 00:15:51.513 | 70.00th=[ 161], 80.00th=[ 165], 90.00th=[ 172], 95.00th=[ 178], 00:15:51.513 | 99.00th=[ 204], 99.50th=[ 215], 99.90th=[ 225], 99.95th=[ 231], 00:15:51.513 | 99.99th=[ 233] 00:15:51.513 bw ( KiB/s): min=16032, max=16032, per=26.42%, avg=16032.00, stdev= 0.00, samples=1 00:15:51.513 iops : min= 4008, max= 4008, avg=4008.00, stdev= 0.00, samples=1 00:15:51.513 lat (usec) : 100=9.50%, 250=90.50% 00:15:51.513 cpu : usr=2.80%, sys=8.10%, ctx=6345, majf=0, minf=1 00:15:51.513 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:15:51.513 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:51.513 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:51.513 issued rwts: total=3072,3273,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:51.513 latency : target=0, window=0, percentile=100.00%, depth=1 00:15:51.513 00:15:51.513 Run status group 0 (all jobs): 00:15:51.513 READ: bw=54.8MiB/s (57.5MB/s), 12.0MiB/s-18.7MiB/s (12.6MB/s-19.7MB/s), io=54.9MiB (57.5MB), run=1001-1001msec 00:15:51.513 WRITE: bw=59.3MiB/s (62.1MB/s), 12.5MiB/s-20.0MiB/s (13.1MB/s-20.9MB/s), io=59.3MiB (62.2MB), run=1001-1001msec 00:15:51.513 00:15:51.513 Disk stats (read/write): 00:15:51.513 nvme0n1: ios=4041/4096, merge=0/0, ticks=333/347, in_queue=680, util=83.77% 00:15:51.513 nvme0n2: ios=2643/3072, merge=0/0, ticks=323/380, in_queue=703, util=84.56% 00:15:51.513 nvme0n3: ios=2560/2763, merge=0/0, ticks=367/365, in_queue=732, util=88.17% 00:15:51.513 nvme0n4: ios=2560/2810, merge=0/0, ticks=359/346, in_queue=705, util=89.41% 00:15:51.513 02:35:24 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:15:51.513 [global] 00:15:51.513 thread=1 00:15:51.513 invalidate=1 00:15:51.514 rw=randwrite 00:15:51.514 time_based=1 00:15:51.514 runtime=1 00:15:51.514 ioengine=libaio 00:15:51.514 direct=1 00:15:51.514 bs=4096 00:15:51.514 iodepth=1 00:15:51.514 norandommap=0 00:15:51.514 numjobs=1 00:15:51.514 00:15:51.514 verify_dump=1 00:15:51.514 verify_backlog=512 00:15:51.514 verify_state_save=0 00:15:51.514 do_verify=1 00:15:51.514 verify=crc32c-intel 00:15:51.514 [job0] 00:15:51.514 filename=/dev/nvme0n1 00:15:51.514 [job1] 00:15:51.514 filename=/dev/nvme0n2 00:15:51.514 [job2] 00:15:51.514 filename=/dev/nvme0n3 00:15:51.514 [job3] 00:15:51.514 filename=/dev/nvme0n4 00:15:51.514 Could not set queue depth (nvme0n1) 00:15:51.514 Could not set queue depth (nvme0n2) 00:15:51.514 Could not set queue depth (nvme0n3) 00:15:51.514 Could not set queue depth (nvme0n4) 00:15:51.773 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:15:51.773 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:15:51.773 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:15:51.773 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:15:51.773 fio-3.35 00:15:51.773 Starting 4 threads 00:15:53.150 00:15:53.150 job0: (groupid=0, jobs=1): err= 0: pid=1550076: Sat Apr 27 02:35:26 2024 00:15:53.150 read: IOPS=5114, BW=20.0MiB/s (20.9MB/s)(20.0MiB/1001msec) 00:15:53.150 slat (nsec): min=8418, max=25296, avg=8967.47, stdev=805.49 00:15:53.150 clat (usec): min=69, max=126, avg=83.22, stdev= 5.60 00:15:53.150 lat (usec): min=78, max=135, avg=92.18, stdev= 5.68 00:15:53.150 clat percentiles (usec): 00:15:53.150 | 1.00th=[ 74], 5.00th=[ 76], 10.00th=[ 78], 20.00th=[ 79], 00:15:53.150 | 30.00th=[ 81], 40.00th=[ 82], 50.00th=[ 83], 60.00th=[ 84], 00:15:53.150 | 70.00th=[ 86], 80.00th=[ 88], 90.00th=[ 91], 95.00th=[ 94], 00:15:53.150 | 99.00th=[ 100], 99.50th=[ 104], 99.90th=[ 111], 99.95th=[ 114], 00:15:53.150 | 99.99th=[ 127] 00:15:53.150 write: IOPS=5458, BW=21.3MiB/s (22.4MB/s)(21.3MiB/1001msec); 0 zone resets 00:15:53.150 slat (nsec): min=10485, max=50795, avg=11173.11, stdev=1079.77 00:15:53.150 clat (usec): min=57, max=130, avg=81.63, stdev=10.83 00:15:53.150 lat (usec): min=68, max=180, avg=92.80, stdev=10.95 00:15:53.150 clat percentiles (usec): 00:15:53.150 | 1.00th=[ 70], 5.00th=[ 72], 10.00th=[ 74], 20.00th=[ 75], 00:15:53.150 | 30.00th=[ 77], 40.00th=[ 78], 50.00th=[ 80], 60.00th=[ 81], 00:15:53.150 | 70.00th=[ 83], 80.00th=[ 85], 90.00th=[ 92], 95.00th=[ 112], 00:15:53.150 | 99.00th=[ 121], 99.50th=[ 123], 99.90th=[ 129], 99.95th=[ 130], 00:15:53.150 | 99.99th=[ 131] 00:15:53.150 bw ( KiB/s): min=22168, max=22168, per=30.06%, avg=22168.00, stdev= 0.00, samples=1 00:15:53.150 iops : min= 5542, max= 5542, avg=5542.00, stdev= 0.00, samples=1 00:15:53.150 lat (usec) : 100=95.29%, 250=4.71% 00:15:53.150 cpu : usr=4.90%, sys=12.20%, ctx=10584, majf=0, minf=1 00:15:53.150 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:15:53.150 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:53.150 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:53.150 issued rwts: total=5120,5464,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:53.150 latency : target=0, window=0, percentile=100.00%, depth=1 00:15:53.150 job1: (groupid=0, jobs=1): err= 0: pid=1550090: Sat Apr 27 02:35:26 2024 00:15:53.150 read: IOPS=3580, BW=14.0MiB/s (14.7MB/s)(14.0MiB/1001msec) 00:15:53.150 slat (nsec): min=8410, max=23856, avg=9177.00, stdev=885.63 00:15:53.150 clat (usec): min=71, max=188, avg=124.51, stdev=10.64 00:15:53.150 lat (usec): min=80, max=197, avg=133.69, stdev=10.64 00:15:53.150 clat percentiles (usec): 00:15:53.150 | 1.00th=[ 101], 5.00th=[ 108], 10.00th=[ 112], 20.00th=[ 117], 00:15:53.150 | 30.00th=[ 121], 40.00th=[ 123], 50.00th=[ 125], 60.00th=[ 128], 00:15:53.150 | 70.00th=[ 130], 80.00th=[ 133], 90.00th=[ 137], 95.00th=[ 141], 00:15:53.150 | 99.00th=[ 151], 99.50th=[ 163], 99.90th=[ 178], 99.95th=[ 182], 00:15:53.150 | 99.99th=[ 190] 00:15:53.150 write: IOPS=3979, BW=15.5MiB/s (16.3MB/s)(15.6MiB/1001msec); 0 zone resets 00:15:53.150 slat (nsec): min=10510, max=39002, avg=11365.50, stdev=1173.82 00:15:53.150 clat (usec): min=68, max=408, avg=115.66, stdev=12.29 00:15:53.150 lat (usec): min=79, max=420, avg=127.02, stdev=12.31 00:15:53.150 clat percentiles (usec): 00:15:53.150 | 1.00th=[ 86], 5.00th=[ 99], 10.00th=[ 103], 20.00th=[ 108], 00:15:53.150 | 30.00th=[ 111], 40.00th=[ 114], 50.00th=[ 116], 60.00th=[ 118], 00:15:53.150 | 70.00th=[ 121], 80.00th=[ 124], 90.00th=[ 129], 95.00th=[ 135], 00:15:53.150 | 99.00th=[ 153], 99.50th=[ 161], 99.90th=[ 184], 99.95th=[ 192], 00:15:53.150 | 99.99th=[ 408] 00:15:53.150 bw ( KiB/s): min=16384, max=16384, per=22.22%, avg=16384.00, stdev= 0.00, samples=1 00:15:53.150 iops : min= 4096, max= 4096, avg=4096.00, stdev= 0.00, samples=1 00:15:53.150 lat (usec) : 100=3.73%, 250=96.26%, 500=0.01% 00:15:53.150 cpu : usr=4.00%, sys=8.60%, ctx=7567, majf=0, minf=1 00:15:53.150 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:15:53.150 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:53.150 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:53.150 issued rwts: total=3584,3983,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:53.150 latency : target=0, window=0, percentile=100.00%, depth=1 00:15:53.150 job2: (groupid=0, jobs=1): err= 0: pid=1550104: Sat Apr 27 02:35:26 2024 00:15:53.150 read: IOPS=3580, BW=14.0MiB/s (14.7MB/s)(14.0MiB/1001msec) 00:15:53.150 slat (nsec): min=9230, max=27255, avg=9879.08, stdev=946.27 00:15:53.150 clat (usec): min=82, max=171, avg=122.80, stdev= 9.00 00:15:53.150 lat (usec): min=95, max=181, avg=132.68, stdev= 9.05 00:15:53.150 clat percentiles (usec): 00:15:53.150 | 1.00th=[ 102], 5.00th=[ 109], 10.00th=[ 112], 20.00th=[ 116], 00:15:53.150 | 30.00th=[ 119], 40.00th=[ 122], 50.00th=[ 124], 60.00th=[ 125], 00:15:53.150 | 70.00th=[ 128], 80.00th=[ 130], 90.00th=[ 135], 95.00th=[ 139], 00:15:53.150 | 99.00th=[ 147], 99.50th=[ 151], 99.90th=[ 167], 99.95th=[ 169], 00:15:53.150 | 99.99th=[ 172] 00:15:53.150 write: IOPS=3987, BW=15.6MiB/s (16.3MB/s)(15.6MiB/1001msec); 0 zone resets 00:15:53.150 slat (nsec): min=10971, max=57219, avg=12378.77, stdev=1509.89 00:15:53.150 clat (usec): min=72, max=421, avg=113.72, stdev=11.04 00:15:53.150 lat (usec): min=84, max=433, avg=126.10, stdev=11.17 00:15:53.150 clat percentiles (usec): 00:15:53.150 | 1.00th=[ 88], 5.00th=[ 98], 10.00th=[ 102], 20.00th=[ 108], 00:15:53.150 | 30.00th=[ 111], 40.00th=[ 113], 50.00th=[ 114], 60.00th=[ 116], 00:15:53.150 | 70.00th=[ 118], 80.00th=[ 121], 90.00th=[ 125], 95.00th=[ 130], 00:15:53.150 | 99.00th=[ 143], 99.50th=[ 149], 99.90th=[ 169], 99.95th=[ 206], 00:15:53.150 | 99.99th=[ 420] 00:15:53.150 bw ( KiB/s): min=16384, max=16384, per=22.22%, avg=16384.00, stdev= 0.00, samples=1 00:15:53.150 iops : min= 4096, max= 4096, avg=4096.00, stdev= 0.00, samples=1 00:15:53.150 lat (usec) : 100=4.01%, 250=95.97%, 500=0.01% 00:15:53.150 cpu : usr=5.40%, sys=8.40%, ctx=7575, majf=0, minf=1 00:15:53.150 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:15:53.150 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:53.150 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:53.150 issued rwts: total=3584,3991,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:53.150 latency : target=0, window=0, percentile=100.00%, depth=1 00:15:53.150 job3: (groupid=0, jobs=1): err= 0: pid=1550110: Sat Apr 27 02:35:26 2024 00:15:53.150 read: IOPS=4608, BW=18.0MiB/s (18.9MB/s)(18.0MiB/1000msec) 00:15:53.150 slat (nsec): min=8773, max=26091, avg=9592.39, stdev=810.74 00:15:53.150 clat (usec): min=77, max=127, avg=92.28, stdev= 6.23 00:15:53.150 lat (usec): min=86, max=137, avg=101.87, stdev= 6.26 00:15:53.150 clat percentiles (usec): 00:15:53.150 | 1.00th=[ 82], 5.00th=[ 84], 10.00th=[ 86], 20.00th=[ 88], 00:15:53.150 | 30.00th=[ 89], 40.00th=[ 90], 50.00th=[ 92], 60.00th=[ 93], 00:15:53.150 | 70.00th=[ 95], 80.00th=[ 97], 90.00th=[ 101], 95.00th=[ 104], 00:15:53.150 | 99.00th=[ 111], 99.50th=[ 113], 99.90th=[ 121], 99.95th=[ 122], 00:15:53.150 | 99.99th=[ 128] 00:15:53.150 write: IOPS=5017, BW=19.6MiB/s (20.5MB/s)(19.6MiB/1000msec); 0 zone resets 00:15:53.150 slat (nsec): min=10544, max=39007, avg=11678.30, stdev=1045.59 00:15:53.150 clat (usec): min=71, max=427, avg=90.16, stdev=11.22 00:15:53.150 lat (usec): min=84, max=440, avg=101.83, stdev=11.43 00:15:53.150 clat percentiles (usec): 00:15:53.150 | 1.00th=[ 77], 5.00th=[ 80], 10.00th=[ 82], 20.00th=[ 83], 00:15:53.150 | 30.00th=[ 85], 40.00th=[ 86], 50.00th=[ 88], 60.00th=[ 90], 00:15:53.150 | 70.00th=[ 92], 80.00th=[ 95], 90.00th=[ 105], 95.00th=[ 114], 00:15:53.150 | 99.00th=[ 124], 99.50th=[ 133], 99.90th=[ 151], 99.95th=[ 163], 00:15:53.150 | 99.99th=[ 429] 00:15:53.151 bw ( KiB/s): min=20480, max=20480, per=27.77%, avg=20480.00, stdev= 0.00, samples=1 00:15:53.151 iops : min= 5120, max= 5120, avg=5120.00, stdev= 0.00, samples=1 00:15:53.151 lat (usec) : 100=88.18%, 250=11.81%, 500=0.01% 00:15:53.151 cpu : usr=4.70%, sys=11.60%, ctx=9625, majf=0, minf=1 00:15:53.151 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:15:53.151 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:53.151 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:53.151 issued rwts: total=4608,5017,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:53.151 latency : target=0, window=0, percentile=100.00%, depth=1 00:15:53.151 00:15:53.151 Run status group 0 (all jobs): 00:15:53.151 READ: bw=65.9MiB/s (69.1MB/s), 14.0MiB/s-20.0MiB/s (14.7MB/s-20.9MB/s), io=66.0MiB (69.2MB), run=1000-1001msec 00:15:53.151 WRITE: bw=72.0MiB/s (75.5MB/s), 15.5MiB/s-21.3MiB/s (16.3MB/s-22.4MB/s), io=72.1MiB (75.6MB), run=1000-1001msec 00:15:53.151 00:15:53.151 Disk stats (read/write): 00:15:53.151 nvme0n1: ios=4475/4608, merge=0/0, ticks=351/357, in_queue=708, util=85.67% 00:15:53.151 nvme0n2: ios=3072/3353, merge=0/0, ticks=359/351, in_queue=710, util=86.28% 00:15:53.151 nvme0n3: ios=3072/3362, merge=0/0, ticks=362/351, in_queue=713, util=88.81% 00:15:53.151 nvme0n4: ios=4096/4117, merge=0/0, ticks=363/363, in_queue=726, util=89.65% 00:15:53.151 02:35:26 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:15:53.151 [global] 00:15:53.151 thread=1 00:15:53.151 invalidate=1 00:15:53.151 rw=write 00:15:53.151 time_based=1 00:15:53.151 runtime=1 00:15:53.151 ioengine=libaio 00:15:53.151 direct=1 00:15:53.151 bs=4096 00:15:53.151 iodepth=128 00:15:53.151 norandommap=0 00:15:53.151 numjobs=1 00:15:53.151 00:15:53.151 verify_dump=1 00:15:53.151 verify_backlog=512 00:15:53.151 verify_state_save=0 00:15:53.151 do_verify=1 00:15:53.151 verify=crc32c-intel 00:15:53.151 [job0] 00:15:53.151 filename=/dev/nvme0n1 00:15:53.151 [job1] 00:15:53.151 filename=/dev/nvme0n2 00:15:53.151 [job2] 00:15:53.151 filename=/dev/nvme0n3 00:15:53.151 [job3] 00:15:53.151 filename=/dev/nvme0n4 00:15:53.151 Could not set queue depth (nvme0n1) 00:15:53.151 Could not set queue depth (nvme0n2) 00:15:53.151 Could not set queue depth (nvme0n3) 00:15:53.151 Could not set queue depth (nvme0n4) 00:15:53.409 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:15:53.409 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:15:53.409 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:15:53.409 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:15:53.409 fio-3.35 00:15:53.409 Starting 4 threads 00:15:54.789 00:15:54.789 job0: (groupid=0, jobs=1): err= 0: pid=1550461: Sat Apr 27 02:35:28 2024 00:15:54.789 read: IOPS=3160, BW=12.3MiB/s (12.9MB/s)(12.4MiB/1004msec) 00:15:54.789 slat (usec): min=2, max=9432, avg=136.50, stdev=724.16 00:15:54.789 clat (usec): min=3393, max=39736, avg=17459.19, stdev=10083.59 00:15:54.789 lat (usec): min=3635, max=39748, avg=17595.68, stdev=10142.63 00:15:54.789 clat percentiles (usec): 00:15:54.789 | 1.00th=[ 4015], 5.00th=[ 5080], 10.00th=[ 6063], 20.00th=[ 8586], 00:15:54.789 | 30.00th=[10814], 40.00th=[13042], 50.00th=[14484], 60.00th=[17171], 00:15:54.789 | 70.00th=[19792], 80.00th=[27395], 90.00th=[35914], 95.00th=[38011], 00:15:54.789 | 99.00th=[39584], 99.50th=[39584], 99.90th=[39584], 99.95th=[39584], 00:15:54.789 | 99.99th=[39584] 00:15:54.789 write: IOPS=3569, BW=13.9MiB/s (14.6MB/s)(14.0MiB/1004msec); 0 zone resets 00:15:54.789 slat (usec): min=2, max=10234, avg=154.01, stdev=809.83 00:15:54.789 clat (usec): min=3320, max=47209, avg=19941.40, stdev=11433.58 00:15:54.789 lat (usec): min=3324, max=47212, avg=20095.41, stdev=11499.75 00:15:54.789 clat percentiles (usec): 00:15:54.789 | 1.00th=[ 3884], 5.00th=[ 5997], 10.00th=[ 7439], 20.00th=[ 9896], 00:15:54.789 | 30.00th=[11338], 40.00th=[13698], 50.00th=[16057], 60.00th=[18482], 00:15:54.789 | 70.00th=[25560], 80.00th=[34866], 90.00th=[37487], 95.00th=[39584], 00:15:54.789 | 99.00th=[41157], 99.50th=[42206], 99.90th=[43254], 99.95th=[43254], 00:15:54.789 | 99.99th=[47449] 00:15:54.789 bw ( KiB/s): min=14048, max=14416, per=14.67%, avg=14232.00, stdev=260.22, samples=2 00:15:54.789 iops : min= 3512, max= 3604, avg=3558.00, stdev=65.05, samples=2 00:15:54.789 lat (msec) : 4=1.14%, 10=21.02%, 20=43.55%, 50=34.29% 00:15:54.789 cpu : usr=1.69%, sys=3.49%, ctx=932, majf=0, minf=1 00:15:54.789 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:15:54.789 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:54.789 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:15:54.789 issued rwts: total=3173,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:54.789 latency : target=0, window=0, percentile=100.00%, depth=128 00:15:54.789 job1: (groupid=0, jobs=1): err= 0: pid=1550462: Sat Apr 27 02:35:28 2024 00:15:54.789 read: IOPS=7165, BW=28.0MiB/s (29.3MB/s)(28.1MiB/1004msec) 00:15:54.789 slat (nsec): min=1960, max=10628k, avg=64261.81, stdev=358547.68 00:15:54.789 clat (usec): min=2962, max=41640, avg=8954.34, stdev=5552.72 00:15:54.789 lat (usec): min=3915, max=41643, avg=9018.60, stdev=5583.28 00:15:54.789 clat percentiles (usec): 00:15:54.789 | 1.00th=[ 4490], 5.00th=[ 5145], 10.00th=[ 5538], 20.00th=[ 6194], 00:15:54.789 | 30.00th=[ 6587], 40.00th=[ 6718], 50.00th=[ 6783], 60.00th=[ 7046], 00:15:54.789 | 70.00th=[ 8291], 80.00th=[10683], 90.00th=[14222], 95.00th=[20055], 00:15:54.789 | 99.00th=[34866], 99.50th=[35914], 99.90th=[41157], 99.95th=[41681], 00:15:54.789 | 99.99th=[41681] 00:15:54.789 write: IOPS=7649, BW=29.9MiB/s (31.3MB/s)(30.0MiB/1004msec); 0 zone resets 00:15:54.789 slat (usec): min=2, max=8952, avg=61.94, stdev=324.31 00:15:54.789 clat (usec): min=2602, max=24792, avg=8145.36, stdev=3671.87 00:15:54.789 lat (usec): min=2606, max=24953, avg=8207.30, stdev=3688.21 00:15:54.789 clat percentiles (usec): 00:15:54.789 | 1.00th=[ 3458], 5.00th=[ 4359], 10.00th=[ 5276], 20.00th=[ 5997], 00:15:54.789 | 30.00th=[ 6194], 40.00th=[ 6325], 50.00th=[ 6456], 60.00th=[ 6915], 00:15:54.789 | 70.00th=[ 8848], 80.00th=[10814], 90.00th=[12911], 95.00th=[15664], 00:15:54.789 | 99.00th=[22414], 99.50th=[23725], 99.90th=[24773], 99.95th=[24773], 00:15:54.789 | 99.99th=[24773] 00:15:54.789 bw ( KiB/s): min=28672, max=31960, per=31.25%, avg=30316.00, stdev=2324.97, samples=2 00:15:54.789 iops : min= 7168, max= 7990, avg=7579.00, stdev=581.24, samples=2 00:15:54.789 lat (msec) : 4=1.50%, 10=75.08%, 20=19.86%, 50=3.56% 00:15:54.789 cpu : usr=3.69%, sys=8.57%, ctx=1357, majf=0, minf=1 00:15:54.789 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.6% 00:15:54.789 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:54.789 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:15:54.789 issued rwts: total=7194,7680,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:54.789 latency : target=0, window=0, percentile=100.00%, depth=128 00:15:54.789 job2: (groupid=0, jobs=1): err= 0: pid=1550467: Sat Apr 27 02:35:28 2024 00:15:54.789 read: IOPS=6616, BW=25.8MiB/s (27.1MB/s)(26.0MiB/1006msec) 00:15:54.789 slat (usec): min=2, max=5660, avg=70.43, stdev=313.19 00:15:54.789 clat (usec): min=331, max=16879, avg=9498.01, stdev=1920.27 00:15:54.789 lat (usec): min=753, max=16891, avg=9568.43, stdev=1948.46 00:15:54.789 clat percentiles (usec): 00:15:54.789 | 1.00th=[ 2638], 5.00th=[ 6390], 10.00th=[ 7767], 20.00th=[ 8455], 00:15:54.789 | 30.00th=[ 8848], 40.00th=[ 9372], 50.00th=[ 9634], 60.00th=[ 9896], 00:15:54.789 | 70.00th=[10159], 80.00th=[10814], 90.00th=[11863], 95.00th=[12649], 00:15:54.789 | 99.00th=[13173], 99.50th=[13566], 99.90th=[14484], 99.95th=[15926], 00:15:54.789 | 99.99th=[16909] 00:15:54.789 write: IOPS=6889, BW=26.9MiB/s (28.2MB/s)(27.1MiB/1006msec); 0 zone resets 00:15:54.789 slat (usec): min=2, max=4857, avg=71.42, stdev=308.16 00:15:54.789 clat (usec): min=1555, max=17619, avg=9264.69, stdev=1608.52 00:15:54.789 lat (usec): min=2258, max=17624, avg=9336.11, stdev=1630.72 00:15:54.789 clat percentiles (usec): 00:15:54.789 | 1.00th=[ 3523], 5.00th=[ 6325], 10.00th=[ 7373], 20.00th=[ 8225], 00:15:54.789 | 30.00th=[ 8848], 40.00th=[ 9241], 50.00th=[ 9372], 60.00th=[ 9503], 00:15:54.789 | 70.00th=[ 9765], 80.00th=[10421], 90.00th=[11207], 95.00th=[11731], 00:15:54.789 | 99.00th=[13042], 99.50th=[13173], 99.90th=[15533], 99.95th=[15533], 00:15:54.789 | 99.99th=[17695] 00:15:54.789 bw ( KiB/s): min=26304, max=28128, per=28.05%, avg=27216.00, stdev=1289.76, samples=2 00:15:54.789 iops : min= 6576, max= 7032, avg=6804.00, stdev=322.44, samples=2 00:15:54.789 lat (usec) : 500=0.01%, 750=0.04%, 1000=0.20% 00:15:54.789 lat (msec) : 2=0.21%, 4=1.41%, 10=68.96%, 20=29.17% 00:15:54.789 cpu : usr=2.39%, sys=5.17%, ctx=954, majf=0, minf=1 00:15:54.789 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.5% 00:15:54.789 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:54.789 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:15:54.789 issued rwts: total=6656,6931,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:54.789 latency : target=0, window=0, percentile=100.00%, depth=128 00:15:54.789 job3: (groupid=0, jobs=1): err= 0: pid=1550468: Sat Apr 27 02:35:28 2024 00:15:54.789 read: IOPS=6113, BW=23.9MiB/s (25.0MB/s)(24.0MiB/1005msec) 00:15:54.789 slat (usec): min=2, max=11837, avg=77.10, stdev=436.16 00:15:54.789 clat (usec): min=2900, max=37579, avg=10224.81, stdev=5100.50 00:15:54.789 lat (usec): min=3416, max=37776, avg=10301.91, stdev=5130.09 00:15:54.789 clat percentiles (usec): 00:15:54.789 | 1.00th=[ 4621], 5.00th=[ 5866], 10.00th=[ 6259], 20.00th=[ 7111], 00:15:54.789 | 30.00th=[ 8029], 40.00th=[ 8586], 50.00th=[ 8979], 60.00th=[ 9110], 00:15:54.789 | 70.00th=[ 9634], 80.00th=[11207], 90.00th=[16712], 95.00th=[20841], 00:15:54.789 | 99.00th=[33424], 99.50th=[35914], 99.90th=[37487], 99.95th=[37487], 00:15:54.789 | 99.99th=[37487] 00:15:54.789 write: IOPS=6173, BW=24.1MiB/s (25.3MB/s)(24.2MiB/1005msec); 0 zone resets 00:15:54.789 slat (usec): min=2, max=9005, avg=80.02, stdev=425.40 00:15:54.789 clat (usec): min=3649, max=42343, avg=10352.72, stdev=5655.00 00:15:54.789 lat (usec): min=4397, max=42355, avg=10432.73, stdev=5690.36 00:15:54.789 clat percentiles (usec): 00:15:54.789 | 1.00th=[ 4948], 5.00th=[ 5800], 10.00th=[ 6456], 20.00th=[ 7177], 00:15:54.789 | 30.00th=[ 7832], 40.00th=[ 8160], 50.00th=[ 8455], 60.00th=[ 8848], 00:15:54.789 | 70.00th=[ 9241], 80.00th=[11731], 90.00th=[17957], 95.00th=[21365], 00:15:54.789 | 99.00th=[35914], 99.50th=[38011], 99.90th=[38536], 99.95th=[38536], 00:15:54.789 | 99.99th=[42206] 00:15:54.789 bw ( KiB/s): min=24576, max=24576, per=25.33%, avg=24576.00, stdev= 0.00, samples=2 00:15:54.789 iops : min= 6144, max= 6144, avg=6144.00, stdev= 0.00, samples=2 00:15:54.789 lat (msec) : 4=0.23%, 10=74.08%, 20=19.22%, 50=6.48% 00:15:54.789 cpu : usr=3.88%, sys=5.98%, ctx=1065, majf=0, minf=1 00:15:54.790 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:15:54.790 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:54.790 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:15:54.790 issued rwts: total=6144,6204,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:54.790 latency : target=0, window=0, percentile=100.00%, depth=128 00:15:54.790 00:15:54.790 Run status group 0 (all jobs): 00:15:54.790 READ: bw=90.0MiB/s (94.3MB/s), 12.3MiB/s-28.0MiB/s (12.9MB/s-29.3MB/s), io=90.5MiB (94.9MB), run=1004-1006msec 00:15:54.790 WRITE: bw=94.7MiB/s (99.3MB/s), 13.9MiB/s-29.9MiB/s (14.6MB/s-31.3MB/s), io=95.3MiB (99.9MB), run=1004-1006msec 00:15:54.790 00:15:54.790 Disk stats (read/write): 00:15:54.790 nvme0n1: ios=2388/2560, merge=0/0, ticks=13068/16046, in_queue=29114, util=82.16% 00:15:54.790 nvme0n2: ios=6144/6587, merge=0/0, ticks=16025/16438, in_queue=32463, util=83.66% 00:15:54.790 nvme0n3: ios=5520/5632, merge=0/0, ticks=51941/50826, in_queue=102767, util=88.20% 00:15:54.790 nvme0n4: ios=5120/5358, merge=0/0, ticks=13370/15164, in_queue=28534, util=85.99% 00:15:54.790 02:35:28 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:15:54.790 [global] 00:15:54.790 thread=1 00:15:54.790 invalidate=1 00:15:54.790 rw=randwrite 00:15:54.790 time_based=1 00:15:54.790 runtime=1 00:15:54.790 ioengine=libaio 00:15:54.790 direct=1 00:15:54.790 bs=4096 00:15:54.790 iodepth=128 00:15:54.790 norandommap=0 00:15:54.790 numjobs=1 00:15:54.790 00:15:54.790 verify_dump=1 00:15:54.790 verify_backlog=512 00:15:54.790 verify_state_save=0 00:15:54.790 do_verify=1 00:15:54.790 verify=crc32c-intel 00:15:54.790 [job0] 00:15:54.790 filename=/dev/nvme0n1 00:15:54.790 [job1] 00:15:54.790 filename=/dev/nvme0n2 00:15:54.790 [job2] 00:15:54.790 filename=/dev/nvme0n3 00:15:54.790 [job3] 00:15:54.790 filename=/dev/nvme0n4 00:15:54.790 Could not set queue depth (nvme0n1) 00:15:54.790 Could not set queue depth (nvme0n2) 00:15:54.790 Could not set queue depth (nvme0n3) 00:15:54.790 Could not set queue depth (nvme0n4) 00:15:54.790 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:15:54.790 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:15:54.790 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:15:54.790 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:15:54.790 fio-3.35 00:15:54.790 Starting 4 threads 00:15:56.170 00:15:56.170 job0: (groupid=0, jobs=1): err= 0: pid=1550771: Sat Apr 27 02:35:29 2024 00:15:56.170 read: IOPS=5109, BW=20.0MiB/s (20.9MB/s)(20.0MiB/1002msec) 00:15:56.170 slat (usec): min=2, max=5995, avg=92.93, stdev=433.44 00:15:56.170 clat (usec): min=3530, max=22142, avg=11999.87, stdev=3537.85 00:15:56.170 lat (usec): min=4723, max=22149, avg=12092.80, stdev=3550.98 00:15:56.170 clat percentiles (usec): 00:15:56.170 | 1.00th=[ 5014], 5.00th=[ 6456], 10.00th=[ 7635], 20.00th=[ 8848], 00:15:56.170 | 30.00th=[ 9765], 40.00th=[10683], 50.00th=[11600], 60.00th=[12649], 00:15:56.170 | 70.00th=[14222], 80.00th=[15401], 90.00th=[16712], 95.00th=[17957], 00:15:56.170 | 99.00th=[20841], 99.50th=[21890], 99.90th=[22152], 99.95th=[22152], 00:15:56.170 | 99.99th=[22152] 00:15:56.170 write: IOPS=5537, BW=21.6MiB/s (22.7MB/s)(21.7MiB/1002msec); 0 zone resets 00:15:56.170 slat (usec): min=2, max=4663, avg=90.24, stdev=384.68 00:15:56.170 clat (usec): min=1084, max=21242, avg=11736.42, stdev=3445.83 00:15:56.170 lat (usec): min=1905, max=21583, avg=11826.66, stdev=3456.50 00:15:56.170 clat percentiles (usec): 00:15:56.170 | 1.00th=[ 4752], 5.00th=[ 6390], 10.00th=[ 7308], 20.00th=[ 8586], 00:15:56.170 | 30.00th=[ 9634], 40.00th=[10683], 50.00th=[11863], 60.00th=[12780], 00:15:56.170 | 70.00th=[13435], 80.00th=[14484], 90.00th=[16319], 95.00th=[17695], 00:15:56.170 | 99.00th=[19792], 99.50th=[20055], 99.90th=[21103], 99.95th=[21103], 00:15:56.170 | 99.99th=[21365] 00:15:56.170 bw ( KiB/s): min=20480, max=22896, per=21.24%, avg=21688.00, stdev=1708.37, samples=2 00:15:56.170 iops : min= 5120, max= 5724, avg=5422.00, stdev=427.09, samples=2 00:15:56.170 lat (msec) : 2=0.02%, 4=0.50%, 10=31.82%, 20=66.42%, 50=1.25% 00:15:56.170 cpu : usr=3.20%, sys=4.70%, ctx=1010, majf=0, minf=1 00:15:56.170 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:15:56.170 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:56.170 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:15:56.170 issued rwts: total=5120,5549,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:56.170 latency : target=0, window=0, percentile=100.00%, depth=128 00:15:56.170 job1: (groupid=0, jobs=1): err= 0: pid=1550772: Sat Apr 27 02:35:29 2024 00:15:56.170 read: IOPS=6642, BW=25.9MiB/s (27.2MB/s)(26.0MiB/1002msec) 00:15:56.170 slat (usec): min=2, max=6458, avg=76.92, stdev=359.25 00:15:56.170 clat (usec): min=2949, max=23883, avg=9883.65, stdev=3700.70 00:15:56.170 lat (usec): min=2953, max=24375, avg=9960.57, stdev=3720.53 00:15:56.170 clat percentiles (usec): 00:15:56.170 | 1.00th=[ 3752], 5.00th=[ 4752], 10.00th=[ 5407], 20.00th=[ 6325], 00:15:56.170 | 30.00th=[ 7570], 40.00th=[ 8717], 50.00th=[ 9896], 60.00th=[10552], 00:15:56.170 | 70.00th=[11469], 80.00th=[12518], 90.00th=[14091], 95.00th=[16712], 00:15:56.170 | 99.00th=[21890], 99.50th=[22414], 99.90th=[23462], 99.95th=[23725], 00:15:56.170 | 99.99th=[23987] 00:15:56.170 write: IOPS=6725, BW=26.3MiB/s (27.5MB/s)(26.3MiB/1002msec); 0 zone resets 00:15:56.170 slat (usec): min=2, max=5694, avg=68.42, stdev=317.48 00:15:56.170 clat (usec): min=1503, max=20992, avg=9091.05, stdev=3234.93 00:15:56.170 lat (usec): min=2359, max=21908, avg=9159.47, stdev=3246.34 00:15:56.170 clat percentiles (usec): 00:15:56.170 | 1.00th=[ 3851], 5.00th=[ 4752], 10.00th=[ 5211], 20.00th=[ 6259], 00:15:56.170 | 30.00th=[ 7111], 40.00th=[ 7898], 50.00th=[ 8848], 60.00th=[ 9503], 00:15:56.170 | 70.00th=[10290], 80.00th=[11469], 90.00th=[13435], 95.00th=[15533], 00:15:56.170 | 99.00th=[18744], 99.50th=[19530], 99.90th=[20579], 99.95th=[20579], 00:15:56.170 | 99.99th=[21103] 00:15:56.170 bw ( KiB/s): min=25752, max=27496, per=26.08%, avg=26624.00, stdev=1233.19, samples=2 00:15:56.170 iops : min= 6438, max= 6874, avg=6656.00, stdev=308.30, samples=2 00:15:56.170 lat (msec) : 2=0.01%, 4=1.61%, 10=57.25%, 20=40.10%, 50=1.05% 00:15:56.170 cpu : usr=3.00%, sys=5.79%, ctx=1316, majf=0, minf=1 00:15:56.170 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.5% 00:15:56.170 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:56.170 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:15:56.170 issued rwts: total=6656,6739,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:56.170 latency : target=0, window=0, percentile=100.00%, depth=128 00:15:56.170 job2: (groupid=0, jobs=1): err= 0: pid=1550773: Sat Apr 27 02:35:29 2024 00:15:56.170 read: IOPS=6451, BW=25.2MiB/s (26.4MB/s)(25.3MiB/1003msec) 00:15:56.170 slat (usec): min=2, max=5451, avg=72.03, stdev=332.28 00:15:56.170 clat (usec): min=504, max=20955, avg=9549.15, stdev=2910.64 00:15:56.170 lat (usec): min=3141, max=21911, avg=9621.19, stdev=2922.84 00:15:56.170 clat percentiles (usec): 00:15:56.170 | 1.00th=[ 4621], 5.00th=[ 5800], 10.00th=[ 6456], 20.00th=[ 7242], 00:15:56.170 | 30.00th=[ 7767], 40.00th=[ 8291], 50.00th=[ 9110], 60.00th=[ 9765], 00:15:56.170 | 70.00th=[10421], 80.00th=[11600], 90.00th=[13566], 95.00th=[15401], 00:15:56.170 | 99.00th=[18744], 99.50th=[20055], 99.90th=[20841], 99.95th=[20841], 00:15:56.170 | 99.99th=[20841] 00:15:56.170 write: IOPS=6636, BW=25.9MiB/s (27.2MB/s)(26.0MiB/1003msec); 0 zone resets 00:15:56.170 slat (usec): min=2, max=5472, avg=76.23, stdev=342.77 00:15:56.170 clat (usec): min=3136, max=20601, avg=9757.17, stdev=3821.05 00:15:56.170 lat (usec): min=3237, max=22534, avg=9833.40, stdev=3845.47 00:15:56.170 clat percentiles (usec): 00:15:56.170 | 1.00th=[ 5014], 5.00th=[ 5604], 10.00th=[ 6063], 20.00th=[ 6980], 00:15:56.170 | 30.00th=[ 7373], 40.00th=[ 7832], 50.00th=[ 8455], 60.00th=[ 9241], 00:15:56.170 | 70.00th=[10421], 80.00th=[12125], 90.00th=[16712], 95.00th=[18744], 00:15:56.170 | 99.00th=[19530], 99.50th=[19792], 99.90th=[20055], 99.95th=[20317], 00:15:56.170 | 99.99th=[20579] 00:15:56.170 bw ( KiB/s): min=23336, max=29912, per=26.08%, avg=26624.00, stdev=4649.93, samples=2 00:15:56.170 iops : min= 5834, max= 7478, avg=6656.00, stdev=1162.48, samples=2 00:15:56.170 lat (usec) : 750=0.01% 00:15:56.170 lat (msec) : 4=0.47%, 10=65.01%, 20=34.10%, 50=0.41% 00:15:56.170 cpu : usr=3.49%, sys=5.69%, ctx=1307, majf=0, minf=1 00:15:56.170 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.5% 00:15:56.170 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:56.170 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:15:56.170 issued rwts: total=6471,6656,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:56.170 latency : target=0, window=0, percentile=100.00%, depth=128 00:15:56.170 job3: (groupid=0, jobs=1): err= 0: pid=1550776: Sat Apr 27 02:35:29 2024 00:15:56.170 read: IOPS=6207, BW=24.2MiB/s (25.4MB/s)(24.3MiB/1003msec) 00:15:56.170 slat (usec): min=2, max=4959, avg=80.36, stdev=392.52 00:15:56.170 clat (usec): min=1493, max=18159, avg=10292.91, stdev=3090.76 00:15:56.170 lat (usec): min=2838, max=19031, avg=10373.26, stdev=3099.92 00:15:56.170 clat percentiles (usec): 00:15:56.170 | 1.00th=[ 5407], 5.00th=[ 6652], 10.00th=[ 7111], 20.00th=[ 7767], 00:15:56.170 | 30.00th=[ 8029], 40.00th=[ 8455], 50.00th=[ 9241], 60.00th=[10290], 00:15:56.170 | 70.00th=[11863], 80.00th=[13566], 90.00th=[15270], 95.00th=[16057], 00:15:56.170 | 99.00th=[17171], 99.50th=[17433], 99.90th=[18220], 99.95th=[18220], 00:15:56.170 | 99.99th=[18220] 00:15:56.170 write: IOPS=6636, BW=25.9MiB/s (27.2MB/s)(26.0MiB/1003msec); 0 zone resets 00:15:56.170 slat (usec): min=2, max=4258, avg=70.48, stdev=310.92 00:15:56.170 clat (usec): min=2699, max=17078, avg=9370.23, stdev=2756.91 00:15:56.170 lat (usec): min=2709, max=19215, avg=9440.72, stdev=2766.03 00:15:56.170 clat percentiles (usec): 00:15:56.170 | 1.00th=[ 4817], 5.00th=[ 5866], 10.00th=[ 6325], 20.00th=[ 7046], 00:15:56.171 | 30.00th=[ 7439], 40.00th=[ 7898], 50.00th=[ 8586], 60.00th=[ 9634], 00:15:56.171 | 70.00th=[10945], 80.00th=[12256], 90.00th=[13304], 95.00th=[14484], 00:15:56.171 | 99.00th=[16057], 99.50th=[16450], 99.90th=[16581], 99.95th=[16581], 00:15:56.171 | 99.99th=[17171] 00:15:56.171 bw ( KiB/s): min=24576, max=28312, per=25.90%, avg=26444.00, stdev=2641.75, samples=2 00:15:56.171 iops : min= 6144, max= 7078, avg=6611.00, stdev=660.44, samples=2 00:15:56.171 lat (msec) : 2=0.01%, 4=0.43%, 10=60.29%, 20=39.28% 00:15:56.171 cpu : usr=3.19%, sys=6.69%, ctx=1059, majf=0, minf=1 00:15:56.171 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.5% 00:15:56.171 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:56.171 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:15:56.171 issued rwts: total=6226,6656,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:56.171 latency : target=0, window=0, percentile=100.00%, depth=128 00:15:56.171 00:15:56.171 Run status group 0 (all jobs): 00:15:56.171 READ: bw=95.3MiB/s (99.9MB/s), 20.0MiB/s-25.9MiB/s (20.9MB/s-27.2MB/s), io=95.6MiB (100MB), run=1002-1003msec 00:15:56.171 WRITE: bw=99.7MiB/s (105MB/s), 21.6MiB/s-26.3MiB/s (22.7MB/s-27.5MB/s), io=100MiB (105MB), run=1002-1003msec 00:15:56.171 00:15:56.171 Disk stats (read/write): 00:15:56.171 nvme0n1: ios=4163/4608, merge=0/0, ticks=14426/15839, in_queue=30265, util=83.77% 00:15:56.171 nvme0n2: ios=5632/5817, merge=0/0, ticks=16730/15513, in_queue=32243, util=83.55% 00:15:56.171 nvme0n3: ios=5153/5601, merge=0/0, ticks=13321/15482, in_queue=28803, util=87.78% 00:15:56.171 nvme0n4: ios=5120/5456, merge=0/0, ticks=14946/14104, in_queue=29050, util=88.48% 00:15:56.171 02:35:29 -- target/fio.sh@55 -- # sync 00:15:56.171 02:35:29 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:15:56.171 02:35:29 -- target/fio.sh@59 -- # fio_pid=1550955 00:15:56.171 02:35:29 -- target/fio.sh@61 -- # sleep 3 00:15:56.171 [global] 00:15:56.171 thread=1 00:15:56.171 invalidate=1 00:15:56.171 rw=read 00:15:56.171 time_based=1 00:15:56.171 runtime=10 00:15:56.171 ioengine=libaio 00:15:56.171 direct=1 00:15:56.171 bs=4096 00:15:56.171 iodepth=1 00:15:56.171 norandommap=1 00:15:56.171 numjobs=1 00:15:56.171 00:15:56.171 [job0] 00:15:56.171 filename=/dev/nvme0n1 00:15:56.171 [job1] 00:15:56.171 filename=/dev/nvme0n2 00:15:56.171 [job2] 00:15:56.171 filename=/dev/nvme0n3 00:15:56.171 [job3] 00:15:56.171 filename=/dev/nvme0n4 00:15:56.171 Could not set queue depth (nvme0n1) 00:15:56.171 Could not set queue depth (nvme0n2) 00:15:56.171 Could not set queue depth (nvme0n3) 00:15:56.171 Could not set queue depth (nvme0n4) 00:15:56.430 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:15:56.430 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:15:56.430 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:15:56.430 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:15:56.430 fio-3.35 00:15:56.430 Starting 4 threads 00:15:59.721 02:35:32 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:15:59.721 fio: io_u error on file /dev/nvme0n4: Remote I/O error: read offset=89165824, buflen=4096 00:15:59.721 fio: pid=1551074, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:15:59.721 02:35:32 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:15:59.721 fio: io_u error on file /dev/nvme0n3: Remote I/O error: read offset=116654080, buflen=4096 00:15:59.721 fio: pid=1551073, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:15:59.721 02:35:32 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:15:59.721 02:35:32 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:15:59.721 fio: io_u error on file /dev/nvme0n1: Remote I/O error: read offset=18227200, buflen=4096 00:15:59.721 fio: pid=1551071, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:15:59.721 02:35:33 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:15:59.722 02:35:33 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:15:59.981 fio: io_u error on file /dev/nvme0n2: Remote I/O error: read offset=35430400, buflen=4096 00:15:59.981 fio: pid=1551072, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:15:59.981 02:35:33 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:15:59.981 02:35:33 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:15:59.981 00:15:59.981 job0: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=1551071: Sat Apr 27 02:35:33 2024 00:15:59.981 read: IOPS=6755, BW=26.4MiB/s (27.7MB/s)(81.4MiB/3084msec) 00:15:59.981 slat (usec): min=8, max=28303, avg=12.31, stdev=241.40 00:15:59.981 clat (usec): min=53, max=386, avg=133.36, stdev=31.74 00:15:59.981 lat (usec): min=62, max=28393, avg=145.67, stdev=243.18 00:15:59.981 clat percentiles (usec): 00:15:59.981 | 1.00th=[ 67], 5.00th=[ 80], 10.00th=[ 86], 20.00th=[ 100], 00:15:59.981 | 30.00th=[ 123], 40.00th=[ 135], 50.00th=[ 139], 60.00th=[ 145], 00:15:59.981 | 70.00th=[ 149], 80.00th=[ 155], 90.00th=[ 172], 95.00th=[ 186], 00:15:59.981 | 99.00th=[ 206], 99.50th=[ 212], 99.90th=[ 227], 99.95th=[ 237], 00:15:59.981 | 99.99th=[ 334] 00:15:59.981 bw ( KiB/s): min=24112, max=31979, per=23.02%, avg=26979.17, stdev=2627.11, samples=6 00:15:59.981 iops : min= 6028, max= 7994, avg=6744.67, stdev=656.49, samples=6 00:15:59.981 lat (usec) : 100=20.40%, 250=79.56%, 500=0.03% 00:15:59.981 cpu : usr=2.37%, sys=7.53%, ctx=20839, majf=0, minf=1 00:15:59.981 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:15:59.981 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:59.981 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:59.981 issued rwts: total=20835,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:59.981 latency : target=0, window=0, percentile=100.00%, depth=1 00:15:59.981 job1: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=1551072: Sat Apr 27 02:35:33 2024 00:15:59.981 read: IOPS=7632, BW=29.8MiB/s (31.3MB/s)(97.8MiB/3280msec) 00:15:59.981 slat (usec): min=5, max=31514, avg=12.51, stdev=252.52 00:15:59.981 clat (usec): min=2, max=400, avg=116.43, stdev=34.49 00:15:59.981 lat (usec): min=62, max=31630, avg=128.94, stdev=254.69 00:15:59.981 clat percentiles (usec): 00:15:59.981 | 1.00th=[ 58], 5.00th=[ 62], 10.00th=[ 70], 20.00th=[ 87], 00:15:59.981 | 30.00th=[ 92], 40.00th=[ 97], 50.00th=[ 116], 60.00th=[ 135], 00:15:59.981 | 70.00th=[ 141], 80.00th=[ 147], 90.00th=[ 157], 95.00th=[ 178], 00:15:59.981 | 99.00th=[ 192], 99.50th=[ 196], 99.90th=[ 208], 99.95th=[ 225], 00:15:59.981 | 99.99th=[ 330] 00:15:59.981 bw ( KiB/s): min=26416, max=37752, per=25.49%, avg=29873.50, stdev=4702.20, samples=6 00:15:59.981 iops : min= 6604, max= 9438, avg=7468.33, stdev=1175.51, samples=6 00:15:59.981 lat (usec) : 4=0.01%, 100=43.38%, 250=56.59%, 500=0.02% 00:15:59.981 cpu : usr=2.74%, sys=8.26%, ctx=25042, majf=0, minf=1 00:15:59.981 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:15:59.981 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:59.981 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:59.981 issued rwts: total=25035,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:59.981 latency : target=0, window=0, percentile=100.00%, depth=1 00:15:59.981 job2: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=1551073: Sat Apr 27 02:35:33 2024 00:15:59.981 read: IOPS=9837, BW=38.4MiB/s (40.3MB/s)(111MiB/2895msec) 00:15:59.981 slat (usec): min=8, max=8899, avg= 9.77, stdev=70.28 00:15:59.981 clat (usec): min=63, max=576, avg=89.88, stdev= 9.44 00:15:59.981 lat (usec): min=75, max=8995, avg=99.66, stdev=70.99 00:15:59.981 clat percentiles (usec): 00:15:59.981 | 1.00th=[ 79], 5.00th=[ 81], 10.00th=[ 83], 20.00th=[ 85], 00:15:59.981 | 30.00th=[ 86], 40.00th=[ 87], 50.00th=[ 89], 60.00th=[ 90], 00:15:59.981 | 70.00th=[ 92], 80.00th=[ 94], 90.00th=[ 98], 95.00th=[ 103], 00:15:59.981 | 99.00th=[ 125], 99.50th=[ 133], 99.90th=[ 159], 99.95th=[ 167], 00:15:59.981 | 99.99th=[ 388] 00:15:59.981 bw ( KiB/s): min=40000, max=40704, per=34.45%, avg=40382.40, stdev=314.06, samples=5 00:15:59.981 iops : min=10000, max=10176, avg=10095.60, stdev=78.52, samples=5 00:15:59.981 lat (usec) : 100=92.67%, 250=7.31%, 500=0.01%, 750=0.01% 00:15:59.981 cpu : usr=4.01%, sys=10.16%, ctx=28483, majf=0, minf=1 00:15:59.981 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:15:59.981 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:59.981 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:59.981 issued rwts: total=28481,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:59.981 latency : target=0, window=0, percentile=100.00%, depth=1 00:15:59.981 job3: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=1551074: Sat Apr 27 02:35:33 2024 00:15:59.981 read: IOPS=8071, BW=31.5MiB/s (33.1MB/s)(85.0MiB/2697msec) 00:15:59.981 slat (nsec): min=8382, max=56310, avg=9301.46, stdev=1080.88 00:15:59.981 clat (usec): min=78, max=299, avg=113.05, stdev=22.82 00:15:59.981 lat (usec): min=87, max=355, avg=122.35, stdev=22.98 00:15:59.981 clat percentiles (usec): 00:15:59.981 | 1.00th=[ 86], 5.00th=[ 91], 10.00th=[ 94], 20.00th=[ 97], 00:15:59.981 | 30.00th=[ 100], 40.00th=[ 103], 50.00th=[ 106], 60.00th=[ 110], 00:15:59.981 | 70.00th=[ 114], 80.00th=[ 123], 90.00th=[ 153], 95.00th=[ 161], 00:15:59.981 | 99.00th=[ 192], 99.50th=[ 200], 99.90th=[ 215], 99.95th=[ 219], 00:15:59.981 | 99.99th=[ 235] 00:15:59.981 bw ( KiB/s): min=24120, max=36104, per=27.82%, avg=32604.80, stdev=4810.26, samples=5 00:15:59.981 iops : min= 6030, max= 9026, avg=8151.20, stdev=1202.57, samples=5 00:15:59.981 lat (usec) : 100=29.86%, 250=70.13%, 500=0.01% 00:15:59.981 cpu : usr=2.89%, sys=8.90%, ctx=21772, majf=0, minf=2 00:15:59.981 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:15:59.981 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:59.981 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:59.981 issued rwts: total=21770,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:59.981 latency : target=0, window=0, percentile=100.00%, depth=1 00:15:59.981 00:15:59.981 Run status group 0 (all jobs): 00:15:59.981 READ: bw=114MiB/s (120MB/s), 26.4MiB/s-38.4MiB/s (27.7MB/s-40.3MB/s), io=375MiB (394MB), run=2697-3280msec 00:15:59.981 00:15:59.981 Disk stats (read/write): 00:15:59.981 nvme0n1: ios=20835/0, merge=0/0, ticks=2660/0, in_queue=2660, util=92.85% 00:15:59.981 nvme0n2: ios=23033/0, merge=0/0, ticks=2662/0, in_queue=2662, util=93.96% 00:15:59.981 nvme0n3: ios=28183/0, merge=0/0, ticks=2352/0, in_queue=2352, util=95.85% 00:15:59.981 nvme0n4: ios=21058/0, merge=0/0, ticks=2285/0, in_queue=2285, util=96.41% 00:15:59.981 02:35:33 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:15:59.981 02:35:33 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:16:00.240 02:35:33 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:00.240 02:35:33 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:16:00.499 02:35:33 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:00.499 02:35:33 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:16:00.759 02:35:34 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:00.759 02:35:34 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:16:01.018 02:35:34 -- target/fio.sh@69 -- # fio_status=0 00:16:01.018 02:35:34 -- target/fio.sh@70 -- # wait 1550955 00:16:01.018 02:35:34 -- target/fio.sh@70 -- # fio_status=4 00:16:01.018 02:35:34 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:01.955 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:16:01.955 02:35:35 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:16:01.955 02:35:35 -- common/autotest_common.sh@1205 -- # local i=0 00:16:01.955 02:35:35 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:16:01.955 02:35:35 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:01.955 02:35:35 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:16:01.955 02:35:35 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:01.955 02:35:35 -- common/autotest_common.sh@1217 -- # return 0 00:16:01.955 02:35:35 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:16:01.955 02:35:35 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:16:01.955 nvmf hotplug test: fio failed as expected 00:16:01.955 02:35:35 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:01.955 02:35:35 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:16:01.955 02:35:35 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:16:01.955 02:35:35 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:16:01.955 02:35:35 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:16:01.955 02:35:35 -- target/fio.sh@91 -- # nvmftestfini 00:16:01.955 02:35:35 -- nvmf/common.sh@477 -- # nvmfcleanup 00:16:01.955 02:35:35 -- nvmf/common.sh@117 -- # sync 00:16:01.955 02:35:35 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:16:01.955 02:35:35 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:16:01.955 02:35:35 -- nvmf/common.sh@120 -- # set +e 00:16:01.955 02:35:35 -- nvmf/common.sh@121 -- # for i in {1..20} 00:16:01.955 02:35:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:16:01.955 rmmod nvme_rdma 00:16:01.955 rmmod nvme_fabrics 00:16:01.955 02:35:35 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:16:01.955 02:35:35 -- nvmf/common.sh@124 -- # set -e 00:16:01.955 02:35:35 -- nvmf/common.sh@125 -- # return 0 00:16:01.955 02:35:35 -- nvmf/common.sh@478 -- # '[' -n 1548596 ']' 00:16:01.955 02:35:35 -- nvmf/common.sh@479 -- # killprocess 1548596 00:16:01.955 02:35:35 -- common/autotest_common.sh@936 -- # '[' -z 1548596 ']' 00:16:01.955 02:35:35 -- common/autotest_common.sh@940 -- # kill -0 1548596 00:16:02.214 02:35:35 -- common/autotest_common.sh@941 -- # uname 00:16:02.214 02:35:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:02.214 02:35:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1548596 00:16:02.214 02:35:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:02.214 02:35:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:02.214 02:35:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1548596' 00:16:02.214 killing process with pid 1548596 00:16:02.214 02:35:35 -- common/autotest_common.sh@955 -- # kill 1548596 00:16:02.214 02:35:35 -- common/autotest_common.sh@960 -- # wait 1548596 00:16:02.214 [2024-04-27 02:35:35.714787] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:16:02.473 02:35:35 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:16:02.473 02:35:35 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:16:02.473 00:16:02.473 real 0m25.740s 00:16:02.473 user 1m37.083s 00:16:02.473 sys 0m10.015s 00:16:02.473 02:35:35 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:16:02.473 02:35:35 -- common/autotest_common.sh@10 -- # set +x 00:16:02.473 ************************************ 00:16:02.473 END TEST nvmf_fio_target 00:16:02.473 ************************************ 00:16:02.473 02:35:35 -- nvmf/nvmf.sh@56 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=rdma 00:16:02.473 02:35:35 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:02.473 02:35:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:02.473 02:35:35 -- common/autotest_common.sh@10 -- # set +x 00:16:02.733 ************************************ 00:16:02.733 START TEST nvmf_bdevio 00:16:02.733 ************************************ 00:16:02.733 02:35:36 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=rdma 00:16:02.733 * Looking for test storage... 00:16:02.733 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:16:02.733 02:35:36 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:16:02.733 02:35:36 -- nvmf/common.sh@7 -- # uname -s 00:16:02.733 02:35:36 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:02.733 02:35:36 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:02.733 02:35:36 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:02.733 02:35:36 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:02.733 02:35:36 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:02.733 02:35:36 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:02.733 02:35:36 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:02.733 02:35:36 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:02.733 02:35:36 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:02.733 02:35:36 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:02.733 02:35:36 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:16:02.733 02:35:36 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:16:02.733 02:35:36 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:02.733 02:35:36 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:02.733 02:35:36 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:02.733 02:35:36 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:16:02.733 02:35:36 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:16:02.733 02:35:36 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:02.733 02:35:36 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:02.733 02:35:36 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:02.733 02:35:36 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:02.733 02:35:36 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:02.733 02:35:36 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:02.733 02:35:36 -- paths/export.sh@5 -- # export PATH 00:16:02.733 02:35:36 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:02.733 02:35:36 -- nvmf/common.sh@47 -- # : 0 00:16:02.733 02:35:36 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:16:02.733 02:35:36 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:16:02.733 02:35:36 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:16:02.733 02:35:36 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:02.733 02:35:36 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:02.733 02:35:36 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:16:02.733 02:35:36 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:16:02.733 02:35:36 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:16:02.733 02:35:36 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:02.733 02:35:36 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:02.733 02:35:36 -- target/bdevio.sh@14 -- # nvmftestinit 00:16:02.733 02:35:36 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:16:02.733 02:35:36 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:02.733 02:35:36 -- nvmf/common.sh@437 -- # prepare_net_devs 00:16:02.733 02:35:36 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:16:02.733 02:35:36 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:16:02.733 02:35:36 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:02.733 02:35:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:02.733 02:35:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:02.733 02:35:36 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:16:02.733 02:35:36 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:16:02.733 02:35:36 -- nvmf/common.sh@285 -- # xtrace_disable 00:16:02.733 02:35:36 -- common/autotest_common.sh@10 -- # set +x 00:16:09.306 02:35:41 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:09.306 02:35:41 -- nvmf/common.sh@291 -- # pci_devs=() 00:16:09.306 02:35:41 -- nvmf/common.sh@291 -- # local -a pci_devs 00:16:09.306 02:35:41 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:16:09.306 02:35:41 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:16:09.306 02:35:41 -- nvmf/common.sh@293 -- # pci_drivers=() 00:16:09.306 02:35:41 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:16:09.306 02:35:41 -- nvmf/common.sh@295 -- # net_devs=() 00:16:09.306 02:35:41 -- nvmf/common.sh@295 -- # local -ga net_devs 00:16:09.306 02:35:41 -- nvmf/common.sh@296 -- # e810=() 00:16:09.306 02:35:41 -- nvmf/common.sh@296 -- # local -ga e810 00:16:09.306 02:35:41 -- nvmf/common.sh@297 -- # x722=() 00:16:09.306 02:35:41 -- nvmf/common.sh@297 -- # local -ga x722 00:16:09.306 02:35:41 -- nvmf/common.sh@298 -- # mlx=() 00:16:09.306 02:35:41 -- nvmf/common.sh@298 -- # local -ga mlx 00:16:09.306 02:35:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:09.306 02:35:41 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:09.306 02:35:41 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:09.306 02:35:41 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:09.306 02:35:41 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:09.306 02:35:41 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:09.306 02:35:41 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:09.306 02:35:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:09.306 02:35:41 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:09.306 02:35:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:09.306 02:35:41 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:09.306 02:35:41 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:16:09.306 02:35:41 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:16:09.306 02:35:41 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:16:09.306 02:35:41 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:16:09.306 02:35:41 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:16:09.306 02:35:41 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:16:09.306 02:35:41 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:16:09.306 02:35:41 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:09.306 02:35:41 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:16:09.306 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:16:09.306 02:35:41 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:16:09.306 02:35:41 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:16:09.306 02:35:41 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:16:09.306 02:35:41 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:16:09.306 02:35:41 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:16:09.306 02:35:41 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:09.306 02:35:41 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:09.306 02:35:41 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:16:09.306 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:16:09.306 02:35:41 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:16:09.306 02:35:41 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:16:09.306 02:35:41 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:16:09.306 02:35:41 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:16:09.306 02:35:41 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:16:09.306 02:35:41 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:09.306 02:35:41 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:16:09.306 02:35:41 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:16:09.306 02:35:41 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:09.306 02:35:41 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:09.306 02:35:41 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:09.306 02:35:41 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:09.306 02:35:41 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:16:09.306 Found net devices under 0000:18:00.0: mlx_0_0 00:16:09.306 02:35:41 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:09.306 02:35:41 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:09.306 02:35:41 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:09.306 02:35:41 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:09.306 02:35:41 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:09.306 02:35:41 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:16:09.306 Found net devices under 0000:18:00.1: mlx_0_1 00:16:09.306 02:35:41 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:09.306 02:35:41 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:16:09.306 02:35:41 -- nvmf/common.sh@403 -- # is_hw=yes 00:16:09.306 02:35:41 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:16:09.306 02:35:41 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:16:09.306 02:35:41 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:16:09.306 02:35:41 -- nvmf/common.sh@409 -- # rdma_device_init 00:16:09.306 02:35:41 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:16:09.306 02:35:41 -- nvmf/common.sh@58 -- # uname 00:16:09.306 02:35:41 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:16:09.306 02:35:41 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:16:09.306 02:35:41 -- nvmf/common.sh@63 -- # modprobe ib_core 00:16:09.306 02:35:41 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:16:09.306 02:35:41 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:16:09.306 02:35:41 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:16:09.306 02:35:41 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:16:09.306 02:35:41 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:16:09.306 02:35:41 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:16:09.306 02:35:41 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:16:09.306 02:35:41 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:16:09.306 02:35:41 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:09.306 02:35:41 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:09.306 02:35:41 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:09.306 02:35:41 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:09.306 02:35:41 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:09.306 02:35:41 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:09.306 02:35:41 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:09.306 02:35:41 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:16:09.306 02:35:41 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:16:09.306 02:35:41 -- nvmf/common.sh@105 -- # continue 2 00:16:09.306 02:35:41 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:09.306 02:35:41 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:09.306 02:35:41 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:16:09.306 02:35:41 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:09.306 02:35:41 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:16:09.306 02:35:41 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:16:09.306 02:35:41 -- nvmf/common.sh@105 -- # continue 2 00:16:09.306 02:35:41 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:09.307 02:35:41 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:16:09.307 02:35:41 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:16:09.307 02:35:41 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:16:09.307 02:35:41 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:09.307 02:35:41 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:09.307 02:35:41 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:16:09.307 02:35:41 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:16:09.307 02:35:41 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:16:09.307 60: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:16:09.307 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:16:09.307 altname enp24s0f0np0 00:16:09.307 altname ens785f0np0 00:16:09.307 inet 192.168.100.8/24 scope global mlx_0_0 00:16:09.307 valid_lft forever preferred_lft forever 00:16:09.307 02:35:41 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:09.307 02:35:41 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:16:09.307 02:35:41 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:16:09.307 02:35:41 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:16:09.307 02:35:41 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:09.307 02:35:41 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:09.307 02:35:41 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:16:09.307 02:35:41 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:16:09.307 02:35:41 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:16:09.307 61: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:16:09.307 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:16:09.307 altname enp24s0f1np1 00:16:09.307 altname ens785f1np1 00:16:09.307 inet 192.168.100.9/24 scope global mlx_0_1 00:16:09.307 valid_lft forever preferred_lft forever 00:16:09.307 02:35:41 -- nvmf/common.sh@411 -- # return 0 00:16:09.307 02:35:41 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:16:09.307 02:35:41 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:16:09.307 02:35:41 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:16:09.307 02:35:41 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:16:09.307 02:35:41 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:16:09.307 02:35:41 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:09.307 02:35:41 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:09.307 02:35:41 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:09.307 02:35:41 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:09.307 02:35:41 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:09.307 02:35:41 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:09.307 02:35:41 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:09.307 02:35:41 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:16:09.307 02:35:41 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:16:09.307 02:35:41 -- nvmf/common.sh@105 -- # continue 2 00:16:09.307 02:35:41 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:09.307 02:35:41 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:09.307 02:35:41 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:16:09.307 02:35:41 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:09.307 02:35:41 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:16:09.307 02:35:41 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:16:09.307 02:35:41 -- nvmf/common.sh@105 -- # continue 2 00:16:09.307 02:35:41 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:09.307 02:35:41 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:16:09.307 02:35:41 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:16:09.307 02:35:41 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:16:09.307 02:35:41 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:09.307 02:35:41 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:09.307 02:35:41 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:09.307 02:35:41 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:16:09.307 02:35:41 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:16:09.307 02:35:41 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:16:09.307 02:35:41 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:09.307 02:35:41 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:09.307 02:35:41 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:16:09.307 192.168.100.9' 00:16:09.307 02:35:41 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:16:09.307 192.168.100.9' 00:16:09.307 02:35:41 -- nvmf/common.sh@446 -- # head -n 1 00:16:09.307 02:35:41 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:16:09.307 02:35:41 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:16:09.307 192.168.100.9' 00:16:09.307 02:35:41 -- nvmf/common.sh@447 -- # tail -n +2 00:16:09.307 02:35:41 -- nvmf/common.sh@447 -- # head -n 1 00:16:09.307 02:35:41 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:16:09.307 02:35:41 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:16:09.307 02:35:41 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:16:09.307 02:35:41 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:16:09.307 02:35:41 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:16:09.307 02:35:41 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:16:09.307 02:35:42 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:16:09.307 02:35:42 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:16:09.307 02:35:42 -- common/autotest_common.sh@710 -- # xtrace_disable 00:16:09.307 02:35:42 -- common/autotest_common.sh@10 -- # set +x 00:16:09.307 02:35:42 -- nvmf/common.sh@470 -- # nvmfpid=1554728 00:16:09.307 02:35:42 -- nvmf/common.sh@471 -- # waitforlisten 1554728 00:16:09.307 02:35:42 -- common/autotest_common.sh@817 -- # '[' -z 1554728 ']' 00:16:09.307 02:35:42 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:09.307 02:35:42 -- common/autotest_common.sh@822 -- # local max_retries=100 00:16:09.307 02:35:42 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:09.307 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:09.307 02:35:42 -- common/autotest_common.sh@826 -- # xtrace_disable 00:16:09.307 02:35:42 -- common/autotest_common.sh@10 -- # set +x 00:16:09.307 02:35:42 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:16:09.307 [2024-04-27 02:35:42.059912] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:16:09.307 [2024-04-27 02:35:42.059970] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:09.307 EAL: No free 2048 kB hugepages reported on node 1 00:16:09.307 [2024-04-27 02:35:42.130771] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:09.307 [2024-04-27 02:35:42.211408] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:09.307 [2024-04-27 02:35:42.211456] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:09.307 [2024-04-27 02:35:42.211465] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:16:09.307 [2024-04-27 02:35:42.211474] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:16:09.307 [2024-04-27 02:35:42.211481] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:09.307 [2024-04-27 02:35:42.211604] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:16:09.307 [2024-04-27 02:35:42.211705] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:16:09.307 [2024-04-27 02:35:42.211807] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:09.307 [2024-04-27 02:35:42.211808] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:16:09.307 02:35:42 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:16:09.307 02:35:42 -- common/autotest_common.sh@850 -- # return 0 00:16:09.307 02:35:42 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:16:09.307 02:35:42 -- common/autotest_common.sh@716 -- # xtrace_disable 00:16:09.307 02:35:42 -- common/autotest_common.sh@10 -- # set +x 00:16:09.307 02:35:42 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:09.307 02:35:42 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:16:09.307 02:35:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:09.307 02:35:42 -- common/autotest_common.sh@10 -- # set +x 00:16:09.567 [2024-04-27 02:35:42.938602] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1c47db0/0x1c4c2a0) succeed. 00:16:09.567 [2024-04-27 02:35:42.949021] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1c493f0/0x1c8d930) succeed. 00:16:09.567 02:35:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:09.567 02:35:43 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:09.567 02:35:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:09.567 02:35:43 -- common/autotest_common.sh@10 -- # set +x 00:16:09.567 Malloc0 00:16:09.567 02:35:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:09.567 02:35:43 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:16:09.567 02:35:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:09.567 02:35:43 -- common/autotest_common.sh@10 -- # set +x 00:16:09.567 02:35:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:09.567 02:35:43 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:09.567 02:35:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:09.567 02:35:43 -- common/autotest_common.sh@10 -- # set +x 00:16:09.567 02:35:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:09.567 02:35:43 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:16:09.567 02:35:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:09.567 02:35:43 -- common/autotest_common.sh@10 -- # set +x 00:16:09.567 [2024-04-27 02:35:43.112295] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:16:09.567 02:35:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:09.567 02:35:43 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:16:09.567 02:35:43 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:16:09.567 02:35:43 -- nvmf/common.sh@521 -- # config=() 00:16:09.567 02:35:43 -- nvmf/common.sh@521 -- # local subsystem config 00:16:09.567 02:35:43 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:16:09.567 02:35:43 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:16:09.567 { 00:16:09.567 "params": { 00:16:09.567 "name": "Nvme$subsystem", 00:16:09.567 "trtype": "$TEST_TRANSPORT", 00:16:09.567 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:09.567 "adrfam": "ipv4", 00:16:09.567 "trsvcid": "$NVMF_PORT", 00:16:09.567 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:09.567 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:09.567 "hdgst": ${hdgst:-false}, 00:16:09.567 "ddgst": ${ddgst:-false} 00:16:09.567 }, 00:16:09.567 "method": "bdev_nvme_attach_controller" 00:16:09.567 } 00:16:09.567 EOF 00:16:09.567 )") 00:16:09.567 02:35:43 -- nvmf/common.sh@543 -- # cat 00:16:09.567 02:35:43 -- nvmf/common.sh@545 -- # jq . 00:16:09.567 02:35:43 -- nvmf/common.sh@546 -- # IFS=, 00:16:09.567 02:35:43 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:16:09.567 "params": { 00:16:09.567 "name": "Nvme1", 00:16:09.567 "trtype": "rdma", 00:16:09.567 "traddr": "192.168.100.8", 00:16:09.567 "adrfam": "ipv4", 00:16:09.567 "trsvcid": "4420", 00:16:09.567 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:09.567 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:09.567 "hdgst": false, 00:16:09.567 "ddgst": false 00:16:09.567 }, 00:16:09.567 "method": "bdev_nvme_attach_controller" 00:16:09.567 }' 00:16:09.567 [2024-04-27 02:35:43.161330] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:16:09.567 [2024-04-27 02:35:43.161391] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1554875 ] 00:16:09.829 EAL: No free 2048 kB hugepages reported on node 1 00:16:09.829 [2024-04-27 02:35:43.236507] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:09.829 [2024-04-27 02:35:43.318598] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:09.829 [2024-04-27 02:35:43.318682] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:09.829 [2024-04-27 02:35:43.318684] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:10.126 I/O targets: 00:16:10.126 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:16:10.126 00:16:10.126 00:16:10.126 CUnit - A unit testing framework for C - Version 2.1-3 00:16:10.126 http://cunit.sourceforge.net/ 00:16:10.126 00:16:10.126 00:16:10.126 Suite: bdevio tests on: Nvme1n1 00:16:10.126 Test: blockdev write read block ...passed 00:16:10.126 Test: blockdev write zeroes read block ...passed 00:16:10.126 Test: blockdev write zeroes read no split ...passed 00:16:10.126 Test: blockdev write zeroes read split ...passed 00:16:10.126 Test: blockdev write zeroes read split partial ...passed 00:16:10.126 Test: blockdev reset ...[2024-04-27 02:35:43.531582] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:16:10.127 [2024-04-27 02:35:43.554651] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:10.127 [2024-04-27 02:35:43.581195] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:16:10.127 passed 00:16:10.127 Test: blockdev write read 8 blocks ...passed 00:16:10.127 Test: blockdev write read size > 128k ...passed 00:16:10.127 Test: blockdev write read invalid size ...passed 00:16:10.127 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:16:10.127 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:16:10.127 Test: blockdev write read max offset ...passed 00:16:10.127 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:16:10.127 Test: blockdev writev readv 8 blocks ...passed 00:16:10.127 Test: blockdev writev readv 30 x 1block ...passed 00:16:10.127 Test: blockdev writev readv block ...passed 00:16:10.127 Test: blockdev writev readv size > 128k ...passed 00:16:10.127 Test: blockdev writev readv size > 128k in two iovs ...passed 00:16:10.127 Test: blockdev comparev and writev ...[2024-04-27 02:35:43.584213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:10.127 [2024-04-27 02:35:43.584243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:16:10.127 [2024-04-27 02:35:43.584257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:10.127 [2024-04-27 02:35:43.584267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:16:10.127 [2024-04-27 02:35:43.584437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:10.127 [2024-04-27 02:35:43.584451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:16:10.127 [2024-04-27 02:35:43.584463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:10.127 [2024-04-27 02:35:43.584473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:16:10.127 [2024-04-27 02:35:43.584645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:10.127 [2024-04-27 02:35:43.584657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:16:10.127 [2024-04-27 02:35:43.584668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:10.127 [2024-04-27 02:35:43.584679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:16:10.127 [2024-04-27 02:35:43.584840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:10.127 [2024-04-27 02:35:43.584853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:16:10.127 [2024-04-27 02:35:43.584864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:10.127 [2024-04-27 02:35:43.584875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:16:10.127 passed 00:16:10.127 Test: blockdev nvme passthru rw ...passed 00:16:10.127 Test: blockdev nvme passthru vendor specific ...[2024-04-27 02:35:43.585130] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:16:10.127 [2024-04-27 02:35:43.585147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:16:10.127 [2024-04-27 02:35:43.585190] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:16:10.127 [2024-04-27 02:35:43.585201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:16:10.127 [2024-04-27 02:35:43.585245] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:16:10.127 [2024-04-27 02:35:43.585257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:16:10.127 [2024-04-27 02:35:43.585296] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:16:10.127 [2024-04-27 02:35:43.585308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:16:10.127 passed 00:16:10.127 Test: blockdev nvme admin passthru ...passed 00:16:10.127 Test: blockdev copy ...passed 00:16:10.127 00:16:10.127 Run Summary: Type Total Ran Passed Failed Inactive 00:16:10.127 suites 1 1 n/a 0 0 00:16:10.127 tests 23 23 23 0 0 00:16:10.127 asserts 152 152 152 0 n/a 00:16:10.127 00:16:10.127 Elapsed time = 0.174 seconds 00:16:10.386 02:35:43 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:10.386 02:35:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:10.386 02:35:43 -- common/autotest_common.sh@10 -- # set +x 00:16:10.386 02:35:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:10.386 02:35:43 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:16:10.386 02:35:43 -- target/bdevio.sh@30 -- # nvmftestfini 00:16:10.386 02:35:43 -- nvmf/common.sh@477 -- # nvmfcleanup 00:16:10.386 02:35:43 -- nvmf/common.sh@117 -- # sync 00:16:10.386 02:35:43 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:16:10.386 02:35:43 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:16:10.386 02:35:43 -- nvmf/common.sh@120 -- # set +e 00:16:10.386 02:35:43 -- nvmf/common.sh@121 -- # for i in {1..20} 00:16:10.386 02:35:43 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:16:10.386 rmmod nvme_rdma 00:16:10.386 rmmod nvme_fabrics 00:16:10.386 02:35:43 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:16:10.386 02:35:43 -- nvmf/common.sh@124 -- # set -e 00:16:10.386 02:35:43 -- nvmf/common.sh@125 -- # return 0 00:16:10.386 02:35:43 -- nvmf/common.sh@478 -- # '[' -n 1554728 ']' 00:16:10.386 02:35:43 -- nvmf/common.sh@479 -- # killprocess 1554728 00:16:10.386 02:35:43 -- common/autotest_common.sh@936 -- # '[' -z 1554728 ']' 00:16:10.386 02:35:43 -- common/autotest_common.sh@940 -- # kill -0 1554728 00:16:10.386 02:35:43 -- common/autotest_common.sh@941 -- # uname 00:16:10.386 02:35:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:10.386 02:35:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1554728 00:16:10.386 02:35:43 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:16:10.386 02:35:43 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:16:10.386 02:35:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1554728' 00:16:10.386 killing process with pid 1554728 00:16:10.386 02:35:43 -- common/autotest_common.sh@955 -- # kill 1554728 00:16:10.386 02:35:43 -- common/autotest_common.sh@960 -- # wait 1554728 00:16:10.646 [2024-04-27 02:35:44.033319] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:16:10.905 02:35:44 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:16:10.905 02:35:44 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:16:10.905 00:16:10.905 real 0m8.158s 00:16:10.905 user 0m10.959s 00:16:10.905 sys 0m4.974s 00:16:10.905 02:35:44 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:16:10.905 02:35:44 -- common/autotest_common.sh@10 -- # set +x 00:16:10.905 ************************************ 00:16:10.905 END TEST nvmf_bdevio 00:16:10.905 ************************************ 00:16:10.905 02:35:44 -- nvmf/nvmf.sh@58 -- # '[' rdma = tcp ']' 00:16:10.905 02:35:44 -- nvmf/nvmf.sh@64 -- # '[' 0 -eq 1 ']' 00:16:10.905 02:35:44 -- nvmf/nvmf.sh@70 -- # [[ phy == phy ]] 00:16:10.905 02:35:44 -- nvmf/nvmf.sh@71 -- # '[' rdma = tcp ']' 00:16:10.905 02:35:44 -- nvmf/nvmf.sh@77 -- # [[ rdma == \r\d\m\a ]] 00:16:10.905 02:35:44 -- nvmf/nvmf.sh@78 -- # run_test nvmf_device_removal test/nvmf/target/device_removal.sh --transport=rdma 00:16:10.905 02:35:44 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:10.905 02:35:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:10.905 02:35:44 -- common/autotest_common.sh@10 -- # set +x 00:16:10.905 ************************************ 00:16:10.905 START TEST nvmf_device_removal 00:16:10.905 ************************************ 00:16:10.905 02:35:44 -- common/autotest_common.sh@1111 -- # test/nvmf/target/device_removal.sh --transport=rdma 00:16:11.166 * Looking for test storage... 00:16:11.167 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:16:11.167 02:35:44 -- target/device_removal.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh 00:16:11.167 02:35:44 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:16:11.167 02:35:44 -- common/autotest_common.sh@34 -- # set -e 00:16:11.167 02:35:44 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:16:11.167 02:35:44 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:16:11.167 02:35:44 -- common/autotest_common.sh@38 -- # '[' -z /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output ']' 00:16:11.167 02:35:44 -- common/autotest_common.sh@43 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/build_config.sh ]] 00:16:11.167 02:35:44 -- common/autotest_common.sh@44 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/build_config.sh 00:16:11.167 02:35:44 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:16:11.167 02:35:44 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:16:11.167 02:35:44 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:16:11.167 02:35:44 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:16:11.167 02:35:44 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:16:11.167 02:35:44 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:16:11.167 02:35:44 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:16:11.167 02:35:44 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:16:11.167 02:35:44 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:16:11.167 02:35:44 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:16:11.167 02:35:44 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:16:11.167 02:35:44 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:16:11.167 02:35:44 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:16:11.167 02:35:44 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:16:11.167 02:35:44 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:16:11.167 02:35:44 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:16:11.167 02:35:44 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:16:11.167 02:35:44 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:16:11.167 02:35:44 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk 00:16:11.167 02:35:44 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:16:11.167 02:35:44 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:16:11.167 02:35:44 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:16:11.167 02:35:44 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:16:11.167 02:35:44 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:16:11.167 02:35:44 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:16:11.167 02:35:44 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:16:11.167 02:35:44 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:16:11.167 02:35:44 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:16:11.167 02:35:44 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:16:11.167 02:35:44 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:16:11.167 02:35:44 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:16:11.167 02:35:44 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:16:11.167 02:35:44 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:16:11.167 02:35:44 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:16:11.167 02:35:44 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:16:11.167 02:35:44 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build 00:16:11.167 02:35:44 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:16:11.167 02:35:44 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:16:11.167 02:35:44 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:16:11.167 02:35:44 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:16:11.167 02:35:44 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:16:11.167 02:35:44 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:16:11.167 02:35:44 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:16:11.167 02:35:44 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:16:11.167 02:35:44 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:16:11.167 02:35:44 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:16:11.167 02:35:44 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:16:11.167 02:35:44 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:16:11.167 02:35:44 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:16:11.167 02:35:44 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:16:11.167 02:35:44 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:16:11.167 02:35:44 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:16:11.167 02:35:44 -- common/build_config.sh@53 -- # CONFIG_HAVE_EVP_MAC=y 00:16:11.167 02:35:44 -- common/build_config.sh@54 -- # CONFIG_URING_ZNS=n 00:16:11.167 02:35:44 -- common/build_config.sh@55 -- # CONFIG_WERROR=y 00:16:11.167 02:35:44 -- common/build_config.sh@56 -- # CONFIG_HAVE_LIBBSD=n 00:16:11.167 02:35:44 -- common/build_config.sh@57 -- # CONFIG_UBSAN=y 00:16:11.167 02:35:44 -- common/build_config.sh@58 -- # CONFIG_IPSEC_MB_DIR= 00:16:11.167 02:35:44 -- common/build_config.sh@59 -- # CONFIG_GOLANG=n 00:16:11.167 02:35:44 -- common/build_config.sh@60 -- # CONFIG_ISAL=y 00:16:11.167 02:35:44 -- common/build_config.sh@61 -- # CONFIG_IDXD_KERNEL=n 00:16:11.167 02:35:44 -- common/build_config.sh@62 -- # CONFIG_DPDK_LIB_DIR= 00:16:11.167 02:35:44 -- common/build_config.sh@63 -- # CONFIG_RDMA_PROV=verbs 00:16:11.167 02:35:44 -- common/build_config.sh@64 -- # CONFIG_APPS=y 00:16:11.167 02:35:44 -- common/build_config.sh@65 -- # CONFIG_SHARED=y 00:16:11.167 02:35:44 -- common/build_config.sh@66 -- # CONFIG_HAVE_KEYUTILS=n 00:16:11.167 02:35:44 -- common/build_config.sh@67 -- # CONFIG_FC_PATH= 00:16:11.167 02:35:44 -- common/build_config.sh@68 -- # CONFIG_DPDK_PKG_CONFIG=n 00:16:11.167 02:35:44 -- common/build_config.sh@69 -- # CONFIG_FC=n 00:16:11.167 02:35:44 -- common/build_config.sh@70 -- # CONFIG_AVAHI=n 00:16:11.167 02:35:44 -- common/build_config.sh@71 -- # CONFIG_FIO_PLUGIN=y 00:16:11.167 02:35:44 -- common/build_config.sh@72 -- # CONFIG_RAID5F=n 00:16:11.167 02:35:44 -- common/build_config.sh@73 -- # CONFIG_EXAMPLES=y 00:16:11.167 02:35:44 -- common/build_config.sh@74 -- # CONFIG_TESTS=y 00:16:11.167 02:35:44 -- common/build_config.sh@75 -- # CONFIG_CRYPTO_MLX5=n 00:16:11.167 02:35:44 -- common/build_config.sh@76 -- # CONFIG_MAX_LCORES= 00:16:11.167 02:35:44 -- common/build_config.sh@77 -- # CONFIG_IPSEC_MB=n 00:16:11.167 02:35:44 -- common/build_config.sh@78 -- # CONFIG_PGO_DIR= 00:16:11.167 02:35:44 -- common/build_config.sh@79 -- # CONFIG_DEBUG=y 00:16:11.167 02:35:44 -- common/build_config.sh@80 -- # CONFIG_DPDK_COMPRESSDEV=n 00:16:11.167 02:35:44 -- common/build_config.sh@81 -- # CONFIG_CROSS_PREFIX= 00:16:11.167 02:35:44 -- common/build_config.sh@82 -- # CONFIG_URING=n 00:16:11.167 02:35:44 -- common/autotest_common.sh@53 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/applications.sh 00:16:11.167 02:35:44 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/applications.sh 00:16:11.167 02:35:44 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common 00:16:11.167 02:35:44 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common 00:16:11.167 02:35:44 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:16:11.167 02:35:44 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin 00:16:11.167 02:35:44 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app 00:16:11.167 02:35:44 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples 00:16:11.167 02:35:44 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:16:11.167 02:35:44 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:16:11.167 02:35:44 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:16:11.167 02:35:44 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:16:11.167 02:35:44 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:16:11.167 02:35:44 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:16:11.167 02:35:44 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/include/spdk/config.h ]] 00:16:11.167 02:35:44 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:16:11.167 #define SPDK_CONFIG_H 00:16:11.167 #define SPDK_CONFIG_APPS 1 00:16:11.167 #define SPDK_CONFIG_ARCH native 00:16:11.167 #undef SPDK_CONFIG_ASAN 00:16:11.167 #undef SPDK_CONFIG_AVAHI 00:16:11.167 #undef SPDK_CONFIG_CET 00:16:11.167 #define SPDK_CONFIG_COVERAGE 1 00:16:11.167 #define SPDK_CONFIG_CROSS_PREFIX 00:16:11.167 #undef SPDK_CONFIG_CRYPTO 00:16:11.167 #undef SPDK_CONFIG_CRYPTO_MLX5 00:16:11.167 #undef SPDK_CONFIG_CUSTOMOCF 00:16:11.167 #undef SPDK_CONFIG_DAOS 00:16:11.167 #define SPDK_CONFIG_DAOS_DIR 00:16:11.167 #define SPDK_CONFIG_DEBUG 1 00:16:11.167 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:16:11.167 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build 00:16:11.167 #define SPDK_CONFIG_DPDK_INC_DIR 00:16:11.167 #define SPDK_CONFIG_DPDK_LIB_DIR 00:16:11.167 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:16:11.167 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk 00:16:11.167 #define SPDK_CONFIG_EXAMPLES 1 00:16:11.167 #undef SPDK_CONFIG_FC 00:16:11.167 #define SPDK_CONFIG_FC_PATH 00:16:11.167 #define SPDK_CONFIG_FIO_PLUGIN 1 00:16:11.167 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:16:11.167 #undef SPDK_CONFIG_FUSE 00:16:11.167 #undef SPDK_CONFIG_FUZZER 00:16:11.167 #define SPDK_CONFIG_FUZZER_LIB 00:16:11.167 #undef SPDK_CONFIG_GOLANG 00:16:11.167 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:16:11.167 #define SPDK_CONFIG_HAVE_EVP_MAC 1 00:16:11.167 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:16:11.167 #undef SPDK_CONFIG_HAVE_KEYUTILS 00:16:11.167 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:16:11.167 #undef SPDK_CONFIG_HAVE_LIBBSD 00:16:11.167 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:16:11.167 #define SPDK_CONFIG_IDXD 1 00:16:11.167 #undef SPDK_CONFIG_IDXD_KERNEL 00:16:11.167 #undef SPDK_CONFIG_IPSEC_MB 00:16:11.167 #define SPDK_CONFIG_IPSEC_MB_DIR 00:16:11.167 #define SPDK_CONFIG_ISAL 1 00:16:11.167 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:16:11.167 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:16:11.167 #define SPDK_CONFIG_LIBDIR 00:16:11.167 #undef SPDK_CONFIG_LTO 00:16:11.167 #define SPDK_CONFIG_MAX_LCORES 00:16:11.167 #define SPDK_CONFIG_NVME_CUSE 1 00:16:11.167 #undef SPDK_CONFIG_OCF 00:16:11.167 #define SPDK_CONFIG_OCF_PATH 00:16:11.167 #define SPDK_CONFIG_OPENSSL_PATH 00:16:11.167 #undef SPDK_CONFIG_PGO_CAPTURE 00:16:11.168 #define SPDK_CONFIG_PGO_DIR 00:16:11.168 #undef SPDK_CONFIG_PGO_USE 00:16:11.168 #define SPDK_CONFIG_PREFIX /usr/local 00:16:11.168 #undef SPDK_CONFIG_RAID5F 00:16:11.168 #undef SPDK_CONFIG_RBD 00:16:11.168 #define SPDK_CONFIG_RDMA 1 00:16:11.168 #define SPDK_CONFIG_RDMA_PROV verbs 00:16:11.168 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:16:11.168 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:16:11.168 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:16:11.168 #define SPDK_CONFIG_SHARED 1 00:16:11.168 #undef SPDK_CONFIG_SMA 00:16:11.168 #define SPDK_CONFIG_TESTS 1 00:16:11.168 #undef SPDK_CONFIG_TSAN 00:16:11.168 #define SPDK_CONFIG_UBLK 1 00:16:11.168 #define SPDK_CONFIG_UBSAN 1 00:16:11.168 #undef SPDK_CONFIG_UNIT_TESTS 00:16:11.168 #undef SPDK_CONFIG_URING 00:16:11.168 #define SPDK_CONFIG_URING_PATH 00:16:11.168 #undef SPDK_CONFIG_URING_ZNS 00:16:11.168 #undef SPDK_CONFIG_USDT 00:16:11.168 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:16:11.168 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:16:11.168 #undef SPDK_CONFIG_VFIO_USER 00:16:11.168 #define SPDK_CONFIG_VFIO_USER_DIR 00:16:11.168 #define SPDK_CONFIG_VHOST 1 00:16:11.168 #define SPDK_CONFIG_VIRTIO 1 00:16:11.168 #undef SPDK_CONFIG_VTUNE 00:16:11.168 #define SPDK_CONFIG_VTUNE_DIR 00:16:11.168 #define SPDK_CONFIG_WERROR 1 00:16:11.168 #define SPDK_CONFIG_WPDK_DIR 00:16:11.168 #undef SPDK_CONFIG_XNVME 00:16:11.168 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:16:11.168 02:35:44 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:16:11.168 02:35:44 -- common/autotest_common.sh@54 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:16:11.168 02:35:44 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:11.168 02:35:44 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:11.168 02:35:44 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:11.168 02:35:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:11.168 02:35:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:11.168 02:35:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:11.168 02:35:44 -- paths/export.sh@5 -- # export PATH 00:16:11.168 02:35:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:11.168 02:35:44 -- common/autotest_common.sh@55 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/common 00:16:11.168 02:35:44 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/common 00:16:11.168 02:35:44 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm 00:16:11.168 02:35:44 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm 00:16:11.168 02:35:44 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/../../../ 00:16:11.168 02:35:44 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:16:11.168 02:35:44 -- pm/common@67 -- # TEST_TAG=N/A 00:16:11.168 02:35:44 -- pm/common@68 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-phy-autotest/spdk/.run_test_name 00:16:11.168 02:35:44 -- pm/common@70 -- # PM_OUTPUTDIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power 00:16:11.168 02:35:44 -- pm/common@71 -- # uname -s 00:16:11.168 02:35:44 -- pm/common@71 -- # PM_OS=Linux 00:16:11.168 02:35:44 -- pm/common@73 -- # MONITOR_RESOURCES=(collect-cpu-load collect-vmstat) 00:16:11.168 02:35:44 -- pm/common@74 -- # [[ Linux == FreeBSD ]] 00:16:11.168 02:35:44 -- pm/common@76 -- # [[ Linux == Linux ]] 00:16:11.168 02:35:44 -- pm/common@76 -- # [[ ............................... != QEMU ]] 00:16:11.168 02:35:44 -- pm/common@76 -- # [[ ! -e /.dockerenv ]] 00:16:11.168 02:35:44 -- pm/common@79 -- # MONITOR_RESOURCES+=(collect-cpu-temp) 00:16:11.168 02:35:44 -- pm/common@80 -- # MONITOR_RESOURCES+=(collect-bmc-pm) 00:16:11.168 02:35:44 -- pm/common@83 -- # MONITOR_RESOURCES_PIDS=() 00:16:11.168 02:35:44 -- pm/common@83 -- # declare -A MONITOR_RESOURCES_PIDS 00:16:11.168 02:35:44 -- pm/common@85 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power 00:16:11.168 02:35:44 -- common/autotest_common.sh@57 -- # : 0 00:16:11.168 02:35:44 -- common/autotest_common.sh@58 -- # export RUN_NIGHTLY 00:16:11.168 02:35:44 -- common/autotest_common.sh@61 -- # : 0 00:16:11.168 02:35:44 -- common/autotest_common.sh@62 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:16:11.168 02:35:44 -- common/autotest_common.sh@63 -- # : 0 00:16:11.168 02:35:44 -- common/autotest_common.sh@64 -- # export SPDK_RUN_VALGRIND 00:16:11.168 02:35:44 -- common/autotest_common.sh@65 -- # : 1 00:16:11.168 02:35:44 -- common/autotest_common.sh@66 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:16:11.168 02:35:44 -- common/autotest_common.sh@67 -- # : 0 00:16:11.168 02:35:44 -- common/autotest_common.sh@68 -- # export SPDK_TEST_UNITTEST 00:16:11.168 02:35:44 -- common/autotest_common.sh@69 -- # : 00:16:11.168 02:35:44 -- common/autotest_common.sh@70 -- # export SPDK_TEST_AUTOBUILD 00:16:11.168 02:35:44 -- common/autotest_common.sh@71 -- # : 0 00:16:11.168 02:35:44 -- common/autotest_common.sh@72 -- # export SPDK_TEST_RELEASE_BUILD 00:16:11.168 02:35:44 -- common/autotest_common.sh@73 -- # : 0 00:16:11.168 02:35:44 -- common/autotest_common.sh@74 -- # export SPDK_TEST_ISAL 00:16:11.168 02:35:44 -- common/autotest_common.sh@75 -- # : 0 00:16:11.168 02:35:44 -- common/autotest_common.sh@76 -- # export SPDK_TEST_ISCSI 00:16:11.168 02:35:44 -- common/autotest_common.sh@77 -- # : 0 00:16:11.168 02:35:44 -- common/autotest_common.sh@78 -- # export SPDK_TEST_ISCSI_INITIATOR 00:16:11.168 02:35:44 -- common/autotest_common.sh@79 -- # : 0 00:16:11.168 02:35:44 -- common/autotest_common.sh@80 -- # export SPDK_TEST_NVME 00:16:11.168 02:35:44 -- common/autotest_common.sh@81 -- # : 0 00:16:11.168 02:35:44 -- common/autotest_common.sh@82 -- # export SPDK_TEST_NVME_PMR 00:16:11.168 02:35:44 -- common/autotest_common.sh@83 -- # : 0 00:16:11.168 02:35:44 -- common/autotest_common.sh@84 -- # export SPDK_TEST_NVME_BP 00:16:11.168 02:35:44 -- common/autotest_common.sh@85 -- # : 1 00:16:11.168 02:35:44 -- common/autotest_common.sh@86 -- # export SPDK_TEST_NVME_CLI 00:16:11.168 02:35:44 -- common/autotest_common.sh@87 -- # : 0 00:16:11.168 02:35:44 -- common/autotest_common.sh@88 -- # export SPDK_TEST_NVME_CUSE 00:16:11.168 02:35:44 -- common/autotest_common.sh@89 -- # : 0 00:16:11.168 02:35:44 -- common/autotest_common.sh@90 -- # export SPDK_TEST_NVME_FDP 00:16:11.168 02:35:44 -- common/autotest_common.sh@91 -- # : 1 00:16:11.168 02:35:44 -- common/autotest_common.sh@92 -- # export SPDK_TEST_NVMF 00:16:11.168 02:35:44 -- common/autotest_common.sh@93 -- # : 0 00:16:11.168 02:35:44 -- common/autotest_common.sh@94 -- # export SPDK_TEST_VFIOUSER 00:16:11.168 02:35:44 -- common/autotest_common.sh@95 -- # : 0 00:16:11.168 02:35:44 -- common/autotest_common.sh@96 -- # export SPDK_TEST_VFIOUSER_QEMU 00:16:11.168 02:35:44 -- common/autotest_common.sh@97 -- # : 0 00:16:11.168 02:35:44 -- common/autotest_common.sh@98 -- # export SPDK_TEST_FUZZER 00:16:11.168 02:35:44 -- common/autotest_common.sh@99 -- # : 0 00:16:11.168 02:35:44 -- common/autotest_common.sh@100 -- # export SPDK_TEST_FUZZER_SHORT 00:16:11.168 02:35:44 -- common/autotest_common.sh@101 -- # : rdma 00:16:11.168 02:35:44 -- common/autotest_common.sh@102 -- # export SPDK_TEST_NVMF_TRANSPORT 00:16:11.168 02:35:44 -- common/autotest_common.sh@103 -- # : 0 00:16:11.168 02:35:44 -- common/autotest_common.sh@104 -- # export SPDK_TEST_RBD 00:16:11.168 02:35:44 -- common/autotest_common.sh@105 -- # : 0 00:16:11.168 02:35:44 -- common/autotest_common.sh@106 -- # export SPDK_TEST_VHOST 00:16:11.168 02:35:44 -- common/autotest_common.sh@107 -- # : 0 00:16:11.168 02:35:44 -- common/autotest_common.sh@108 -- # export SPDK_TEST_BLOCKDEV 00:16:11.168 02:35:44 -- common/autotest_common.sh@109 -- # : 0 00:16:11.168 02:35:44 -- common/autotest_common.sh@110 -- # export SPDK_TEST_IOAT 00:16:11.168 02:35:44 -- common/autotest_common.sh@111 -- # : 0 00:16:11.168 02:35:44 -- common/autotest_common.sh@112 -- # export SPDK_TEST_BLOBFS 00:16:11.168 02:35:44 -- common/autotest_common.sh@113 -- # : 0 00:16:11.168 02:35:44 -- common/autotest_common.sh@114 -- # export SPDK_TEST_VHOST_INIT 00:16:11.168 02:35:44 -- common/autotest_common.sh@115 -- # : 0 00:16:11.168 02:35:44 -- common/autotest_common.sh@116 -- # export SPDK_TEST_LVOL 00:16:11.168 02:35:44 -- common/autotest_common.sh@117 -- # : 0 00:16:11.168 02:35:44 -- common/autotest_common.sh@118 -- # export SPDK_TEST_VBDEV_COMPRESS 00:16:11.168 02:35:44 -- common/autotest_common.sh@119 -- # : 0 00:16:11.168 02:35:44 -- common/autotest_common.sh@120 -- # export SPDK_RUN_ASAN 00:16:11.168 02:35:44 -- common/autotest_common.sh@121 -- # : 1 00:16:11.168 02:35:44 -- common/autotest_common.sh@122 -- # export SPDK_RUN_UBSAN 00:16:11.168 02:35:44 -- common/autotest_common.sh@123 -- # : 00:16:11.168 02:35:44 -- common/autotest_common.sh@124 -- # export SPDK_RUN_EXTERNAL_DPDK 00:16:11.168 02:35:44 -- common/autotest_common.sh@125 -- # : 0 00:16:11.168 02:35:44 -- common/autotest_common.sh@126 -- # export SPDK_RUN_NON_ROOT 00:16:11.168 02:35:44 -- common/autotest_common.sh@127 -- # : 0 00:16:11.168 02:35:44 -- common/autotest_common.sh@128 -- # export SPDK_TEST_CRYPTO 00:16:11.168 02:35:44 -- common/autotest_common.sh@129 -- # : 0 00:16:11.168 02:35:44 -- common/autotest_common.sh@130 -- # export SPDK_TEST_FTL 00:16:11.168 02:35:44 -- common/autotest_common.sh@131 -- # : 0 00:16:11.168 02:35:44 -- common/autotest_common.sh@132 -- # export SPDK_TEST_OCF 00:16:11.168 02:35:44 -- common/autotest_common.sh@133 -- # : 0 00:16:11.169 02:35:44 -- common/autotest_common.sh@134 -- # export SPDK_TEST_VMD 00:16:11.169 02:35:44 -- common/autotest_common.sh@135 -- # : 0 00:16:11.169 02:35:44 -- common/autotest_common.sh@136 -- # export SPDK_TEST_OPAL 00:16:11.169 02:35:44 -- common/autotest_common.sh@137 -- # : 00:16:11.169 02:35:44 -- common/autotest_common.sh@138 -- # export SPDK_TEST_NATIVE_DPDK 00:16:11.169 02:35:44 -- common/autotest_common.sh@139 -- # : true 00:16:11.169 02:35:44 -- common/autotest_common.sh@140 -- # export SPDK_AUTOTEST_X 00:16:11.169 02:35:44 -- common/autotest_common.sh@141 -- # : 0 00:16:11.169 02:35:44 -- common/autotest_common.sh@142 -- # export SPDK_TEST_RAID5 00:16:11.169 02:35:44 -- common/autotest_common.sh@143 -- # : 0 00:16:11.169 02:35:44 -- common/autotest_common.sh@144 -- # export SPDK_TEST_URING 00:16:11.169 02:35:44 -- common/autotest_common.sh@145 -- # : 0 00:16:11.169 02:35:44 -- common/autotest_common.sh@146 -- # export SPDK_TEST_USDT 00:16:11.169 02:35:44 -- common/autotest_common.sh@147 -- # : 0 00:16:11.169 02:35:44 -- common/autotest_common.sh@148 -- # export SPDK_TEST_USE_IGB_UIO 00:16:11.169 02:35:44 -- common/autotest_common.sh@149 -- # : 0 00:16:11.169 02:35:44 -- common/autotest_common.sh@150 -- # export SPDK_TEST_SCHEDULER 00:16:11.169 02:35:44 -- common/autotest_common.sh@151 -- # : 0 00:16:11.169 02:35:44 -- common/autotest_common.sh@152 -- # export SPDK_TEST_SCANBUILD 00:16:11.169 02:35:44 -- common/autotest_common.sh@153 -- # : mlx5 00:16:11.169 02:35:44 -- common/autotest_common.sh@154 -- # export SPDK_TEST_NVMF_NICS 00:16:11.169 02:35:44 -- common/autotest_common.sh@155 -- # : 0 00:16:11.169 02:35:44 -- common/autotest_common.sh@156 -- # export SPDK_TEST_SMA 00:16:11.169 02:35:44 -- common/autotest_common.sh@157 -- # : 0 00:16:11.169 02:35:44 -- common/autotest_common.sh@158 -- # export SPDK_TEST_DAOS 00:16:11.169 02:35:44 -- common/autotest_common.sh@159 -- # : 0 00:16:11.169 02:35:44 -- common/autotest_common.sh@160 -- # export SPDK_TEST_XNVME 00:16:11.169 02:35:44 -- common/autotest_common.sh@161 -- # : 0 00:16:11.169 02:35:44 -- common/autotest_common.sh@162 -- # export SPDK_TEST_ACCEL_DSA 00:16:11.169 02:35:44 -- common/autotest_common.sh@163 -- # : 0 00:16:11.169 02:35:44 -- common/autotest_common.sh@164 -- # export SPDK_TEST_ACCEL_IAA 00:16:11.169 02:35:44 -- common/autotest_common.sh@166 -- # : 00:16:11.169 02:35:44 -- common/autotest_common.sh@167 -- # export SPDK_TEST_FUZZER_TARGET 00:16:11.169 02:35:44 -- common/autotest_common.sh@168 -- # : 0 00:16:11.169 02:35:44 -- common/autotest_common.sh@169 -- # export SPDK_TEST_NVMF_MDNS 00:16:11.169 02:35:44 -- common/autotest_common.sh@170 -- # : 0 00:16:11.169 02:35:44 -- common/autotest_common.sh@171 -- # export SPDK_JSONRPC_GO_CLIENT 00:16:11.169 02:35:44 -- common/autotest_common.sh@174 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib 00:16:11.169 02:35:44 -- common/autotest_common.sh@174 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib 00:16:11.169 02:35:44 -- common/autotest_common.sh@175 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib 00:16:11.169 02:35:44 -- common/autotest_common.sh@175 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib 00:16:11.169 02:35:44 -- common/autotest_common.sh@176 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:16:11.169 02:35:44 -- common/autotest_common.sh@176 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:16:11.169 02:35:44 -- common/autotest_common.sh@177 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:16:11.169 02:35:44 -- common/autotest_common.sh@177 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:16:11.169 02:35:44 -- common/autotest_common.sh@180 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:16:11.169 02:35:44 -- common/autotest_common.sh@180 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:16:11.169 02:35:44 -- common/autotest_common.sh@184 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python 00:16:11.169 02:35:44 -- common/autotest_common.sh@184 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python 00:16:11.169 02:35:44 -- common/autotest_common.sh@188 -- # export PYTHONDONTWRITEBYTECODE=1 00:16:11.169 02:35:44 -- common/autotest_common.sh@188 -- # PYTHONDONTWRITEBYTECODE=1 00:16:11.169 02:35:44 -- common/autotest_common.sh@192 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:16:11.169 02:35:44 -- common/autotest_common.sh@192 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:16:11.169 02:35:44 -- common/autotest_common.sh@193 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:16:11.169 02:35:44 -- common/autotest_common.sh@193 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:16:11.169 02:35:44 -- common/autotest_common.sh@197 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:16:11.169 02:35:44 -- common/autotest_common.sh@198 -- # rm -rf /var/tmp/asan_suppression_file 00:16:11.169 02:35:44 -- common/autotest_common.sh@199 -- # cat 00:16:11.169 02:35:44 -- common/autotest_common.sh@225 -- # echo leak:libfuse3.so 00:16:11.169 02:35:44 -- common/autotest_common.sh@227 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:16:11.169 02:35:44 -- common/autotest_common.sh@227 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:16:11.169 02:35:44 -- common/autotest_common.sh@229 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:16:11.169 02:35:44 -- common/autotest_common.sh@229 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:16:11.169 02:35:44 -- common/autotest_common.sh@231 -- # '[' -z /var/spdk/dependencies ']' 00:16:11.169 02:35:44 -- common/autotest_common.sh@234 -- # export DEPENDENCY_DIR 00:16:11.169 02:35:44 -- common/autotest_common.sh@238 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin 00:16:11.169 02:35:44 -- common/autotest_common.sh@238 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin 00:16:11.169 02:35:44 -- common/autotest_common.sh@239 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples 00:16:11.169 02:35:44 -- common/autotest_common.sh@239 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples 00:16:11.169 02:35:44 -- common/autotest_common.sh@242 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:16:11.169 02:35:44 -- common/autotest_common.sh@242 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:16:11.169 02:35:44 -- common/autotest_common.sh@243 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:16:11.169 02:35:44 -- common/autotest_common.sh@243 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:16:11.169 02:35:44 -- common/autotest_common.sh@245 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:16:11.169 02:35:44 -- common/autotest_common.sh@245 -- # AR_TOOL=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:16:11.169 02:35:44 -- common/autotest_common.sh@248 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:16:11.169 02:35:44 -- common/autotest_common.sh@248 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:16:11.169 02:35:44 -- common/autotest_common.sh@251 -- # '[' 0 -eq 0 ']' 00:16:11.169 02:35:44 -- common/autotest_common.sh@252 -- # export valgrind= 00:16:11.169 02:35:44 -- common/autotest_common.sh@252 -- # valgrind= 00:16:11.169 02:35:44 -- common/autotest_common.sh@258 -- # uname -s 00:16:11.169 02:35:44 -- common/autotest_common.sh@258 -- # '[' Linux = Linux ']' 00:16:11.169 02:35:44 -- common/autotest_common.sh@259 -- # HUGEMEM=4096 00:16:11.169 02:35:44 -- common/autotest_common.sh@260 -- # export CLEAR_HUGE=yes 00:16:11.169 02:35:44 -- common/autotest_common.sh@260 -- # CLEAR_HUGE=yes 00:16:11.169 02:35:44 -- common/autotest_common.sh@261 -- # [[ 0 -eq 1 ]] 00:16:11.169 02:35:44 -- common/autotest_common.sh@261 -- # [[ 0 -eq 1 ]] 00:16:11.169 02:35:44 -- common/autotest_common.sh@268 -- # MAKE=make 00:16:11.169 02:35:44 -- common/autotest_common.sh@269 -- # MAKEFLAGS=-j72 00:16:11.169 02:35:44 -- common/autotest_common.sh@285 -- # export HUGEMEM=4096 00:16:11.169 02:35:44 -- common/autotest_common.sh@285 -- # HUGEMEM=4096 00:16:11.169 02:35:44 -- common/autotest_common.sh@287 -- # NO_HUGE=() 00:16:11.169 02:35:44 -- common/autotest_common.sh@288 -- # TEST_MODE= 00:16:11.169 02:35:44 -- common/autotest_common.sh@289 -- # for i in "$@" 00:16:11.169 02:35:44 -- common/autotest_common.sh@290 -- # case "$i" in 00:16:11.169 02:35:44 -- common/autotest_common.sh@295 -- # TEST_TRANSPORT=rdma 00:16:11.169 02:35:44 -- common/autotest_common.sh@307 -- # [[ -z 1555172 ]] 00:16:11.169 02:35:44 -- common/autotest_common.sh@307 -- # kill -0 1555172 00:16:11.169 02:35:44 -- common/autotest_common.sh@1666 -- # set_test_storage 2147483648 00:16:11.169 02:35:44 -- common/autotest_common.sh@317 -- # [[ -v testdir ]] 00:16:11.169 02:35:44 -- common/autotest_common.sh@319 -- # local requested_size=2147483648 00:16:11.169 02:35:44 -- common/autotest_common.sh@320 -- # local mount target_dir 00:16:11.169 02:35:44 -- common/autotest_common.sh@322 -- # local -A mounts fss sizes avails uses 00:16:11.169 02:35:44 -- common/autotest_common.sh@323 -- # local source fs size avail mount use 00:16:11.169 02:35:44 -- common/autotest_common.sh@325 -- # local storage_fallback storage_candidates 00:16:11.169 02:35:44 -- common/autotest_common.sh@327 -- # mktemp -udt spdk.XXXXXX 00:16:11.169 02:35:44 -- common/autotest_common.sh@327 -- # storage_fallback=/tmp/spdk.0mIBzC 00:16:11.169 02:35:44 -- common/autotest_common.sh@332 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:16:11.169 02:35:44 -- common/autotest_common.sh@334 -- # [[ -n '' ]] 00:16:11.169 02:35:44 -- common/autotest_common.sh@339 -- # [[ -n '' ]] 00:16:11.169 02:35:44 -- common/autotest_common.sh@344 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target /tmp/spdk.0mIBzC/tests/target /tmp/spdk.0mIBzC 00:16:11.169 02:35:44 -- common/autotest_common.sh@347 -- # requested_size=2214592512 00:16:11.170 02:35:44 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:16:11.170 02:35:44 -- common/autotest_common.sh@316 -- # df -T 00:16:11.170 02:35:44 -- common/autotest_common.sh@316 -- # grep -v Filesystem 00:16:11.170 02:35:44 -- common/autotest_common.sh@350 -- # mounts["$mount"]=spdk_devtmpfs 00:16:11.170 02:35:44 -- common/autotest_common.sh@350 -- # fss["$mount"]=devtmpfs 00:16:11.170 02:35:44 -- common/autotest_common.sh@351 -- # avails["$mount"]=67108864 00:16:11.170 02:35:44 -- common/autotest_common.sh@351 -- # sizes["$mount"]=67108864 00:16:11.170 02:35:44 -- common/autotest_common.sh@352 -- # uses["$mount"]=0 00:16:11.170 02:35:44 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:16:11.170 02:35:44 -- common/autotest_common.sh@350 -- # mounts["$mount"]=/dev/pmem0 00:16:11.170 02:35:44 -- common/autotest_common.sh@350 -- # fss["$mount"]=ext2 00:16:11.170 02:35:44 -- common/autotest_common.sh@351 -- # avails["$mount"]=988676096 00:16:11.170 02:35:44 -- common/autotest_common.sh@351 -- # sizes["$mount"]=5284429824 00:16:11.170 02:35:44 -- common/autotest_common.sh@352 -- # uses["$mount"]=4295753728 00:16:11.170 02:35:44 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:16:11.170 02:35:44 -- common/autotest_common.sh@350 -- # mounts["$mount"]=spdk_root 00:16:11.170 02:35:44 -- common/autotest_common.sh@350 -- # fss["$mount"]=overlay 00:16:11.170 02:35:44 -- common/autotest_common.sh@351 -- # avails["$mount"]=56094674944 00:16:11.170 02:35:44 -- common/autotest_common.sh@351 -- # sizes["$mount"]=61742698496 00:16:11.170 02:35:44 -- common/autotest_common.sh@352 -- # uses["$mount"]=5648023552 00:16:11.170 02:35:44 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:16:11.170 02:35:44 -- common/autotest_common.sh@350 -- # mounts["$mount"]=/dev/sda1 00:16:11.170 02:35:44 -- common/autotest_common.sh@350 -- # fss["$mount"]=xfs 00:16:11.170 02:35:44 -- common/autotest_common.sh@351 -- # avails["$mount"]=221821267968 00:16:11.170 02:35:44 -- common/autotest_common.sh@351 -- # sizes["$mount"]=239938535424 00:16:11.170 02:35:44 -- common/autotest_common.sh@352 -- # uses["$mount"]=18117267456 00:16:11.170 02:35:44 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:16:11.170 02:35:44 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:16:11.170 02:35:44 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:16:11.170 02:35:44 -- common/autotest_common.sh@351 -- # avails["$mount"]=30864343040 00:16:11.170 02:35:44 -- common/autotest_common.sh@351 -- # sizes["$mount"]=30871347200 00:16:11.170 02:35:44 -- common/autotest_common.sh@352 -- # uses["$mount"]=7004160 00:16:11.170 02:35:44 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:16:11.170 02:35:44 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:16:11.170 02:35:44 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:16:11.170 02:35:44 -- common/autotest_common.sh@351 -- # avails["$mount"]=12325724160 00:16:11.170 02:35:44 -- common/autotest_common.sh@351 -- # sizes["$mount"]=12348542976 00:16:11.170 02:35:44 -- common/autotest_common.sh@352 -- # uses["$mount"]=22818816 00:16:11.170 02:35:44 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:16:11.170 02:35:44 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:16:11.170 02:35:44 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:16:11.170 02:35:44 -- common/autotest_common.sh@351 -- # avails["$mount"]=30870867968 00:16:11.170 02:35:44 -- common/autotest_common.sh@351 -- # sizes["$mount"]=30871351296 00:16:11.170 02:35:44 -- common/autotest_common.sh@352 -- # uses["$mount"]=483328 00:16:11.170 02:35:44 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:16:11.170 02:35:44 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:16:11.170 02:35:44 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:16:11.170 02:35:44 -- common/autotest_common.sh@351 -- # avails["$mount"]=6174265344 00:16:11.170 02:35:44 -- common/autotest_common.sh@351 -- # sizes["$mount"]=6174269440 00:16:11.170 02:35:44 -- common/autotest_common.sh@352 -- # uses["$mount"]=4096 00:16:11.170 02:35:44 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:16:11.170 02:35:44 -- common/autotest_common.sh@355 -- # printf '* Looking for test storage...\n' 00:16:11.170 * Looking for test storage... 00:16:11.170 02:35:44 -- common/autotest_common.sh@357 -- # local target_space new_size 00:16:11.170 02:35:44 -- common/autotest_common.sh@358 -- # for target_dir in "${storage_candidates[@]}" 00:16:11.170 02:35:44 -- common/autotest_common.sh@361 -- # df /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:16:11.170 02:35:44 -- common/autotest_common.sh@361 -- # awk '$1 !~ /Filesystem/{print $6}' 00:16:11.170 02:35:44 -- common/autotest_common.sh@361 -- # mount=/ 00:16:11.170 02:35:44 -- common/autotest_common.sh@363 -- # target_space=56094674944 00:16:11.170 02:35:44 -- common/autotest_common.sh@364 -- # (( target_space == 0 || target_space < requested_size )) 00:16:11.170 02:35:44 -- common/autotest_common.sh@367 -- # (( target_space >= requested_size )) 00:16:11.170 02:35:44 -- common/autotest_common.sh@369 -- # [[ overlay == tmpfs ]] 00:16:11.170 02:35:44 -- common/autotest_common.sh@369 -- # [[ overlay == ramfs ]] 00:16:11.170 02:35:44 -- common/autotest_common.sh@369 -- # [[ / == / ]] 00:16:11.170 02:35:44 -- common/autotest_common.sh@370 -- # new_size=7862616064 00:16:11.170 02:35:44 -- common/autotest_common.sh@371 -- # (( new_size * 100 / sizes[/] > 95 )) 00:16:11.170 02:35:44 -- common/autotest_common.sh@376 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:16:11.170 02:35:44 -- common/autotest_common.sh@376 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:16:11.170 02:35:44 -- common/autotest_common.sh@377 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:16:11.170 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:16:11.170 02:35:44 -- common/autotest_common.sh@378 -- # return 0 00:16:11.170 02:35:44 -- common/autotest_common.sh@1668 -- # set -o errtrace 00:16:11.170 02:35:44 -- common/autotest_common.sh@1669 -- # shopt -s extdebug 00:16:11.170 02:35:44 -- common/autotest_common.sh@1670 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:16:11.170 02:35:44 -- common/autotest_common.sh@1672 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:16:11.170 02:35:44 -- common/autotest_common.sh@1673 -- # true 00:16:11.170 02:35:44 -- common/autotest_common.sh@1675 -- # xtrace_fd 00:16:11.170 02:35:44 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:16:11.170 02:35:44 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:16:11.170 02:35:44 -- common/autotest_common.sh@27 -- # exec 00:16:11.170 02:35:44 -- common/autotest_common.sh@29 -- # exec 00:16:11.170 02:35:44 -- common/autotest_common.sh@31 -- # xtrace_restore 00:16:11.170 02:35:44 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:16:11.170 02:35:44 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:16:11.170 02:35:44 -- common/autotest_common.sh@18 -- # set -x 00:16:11.170 02:35:44 -- target/device_removal.sh@11 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:16:11.170 02:35:44 -- nvmf/common.sh@7 -- # uname -s 00:16:11.430 02:35:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:11.430 02:35:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:11.430 02:35:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:11.430 02:35:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:11.430 02:35:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:11.430 02:35:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:11.430 02:35:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:11.430 02:35:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:11.430 02:35:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:11.430 02:35:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:11.430 02:35:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:16:11.430 02:35:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:16:11.430 02:35:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:11.430 02:35:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:11.430 02:35:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:11.430 02:35:44 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:16:11.430 02:35:44 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:16:11.430 02:35:44 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:11.430 02:35:44 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:11.430 02:35:44 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:11.430 02:35:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:11.430 02:35:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:11.430 02:35:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:11.430 02:35:44 -- paths/export.sh@5 -- # export PATH 00:16:11.430 02:35:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:11.430 02:35:44 -- nvmf/common.sh@47 -- # : 0 00:16:11.430 02:35:44 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:16:11.430 02:35:44 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:16:11.430 02:35:44 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:16:11.430 02:35:44 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:11.430 02:35:44 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:11.430 02:35:44 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:16:11.430 02:35:44 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:16:11.430 02:35:44 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:16:11.430 02:35:44 -- target/device_removal.sh@13 -- # tgt_core_mask=0x3 00:16:11.430 02:35:44 -- target/device_removal.sh@14 -- # bdevperf_core_mask=0x4 00:16:11.430 02:35:44 -- target/device_removal.sh@15 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:16:11.430 02:35:44 -- target/device_removal.sh@16 -- # bdevperf_rpc_pid=-1 00:16:11.430 02:35:44 -- target/device_removal.sh@18 -- # nvmftestinit 00:16:11.430 02:35:44 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:16:11.430 02:35:44 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:11.430 02:35:44 -- nvmf/common.sh@437 -- # prepare_net_devs 00:16:11.430 02:35:44 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:16:11.430 02:35:44 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:16:11.430 02:35:44 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:11.430 02:35:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:11.430 02:35:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:11.430 02:35:44 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:16:11.430 02:35:44 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:16:11.430 02:35:44 -- nvmf/common.sh@285 -- # xtrace_disable 00:16:11.430 02:35:44 -- common/autotest_common.sh@10 -- # set +x 00:16:17.997 02:35:50 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:17.997 02:35:50 -- nvmf/common.sh@291 -- # pci_devs=() 00:16:17.997 02:35:50 -- nvmf/common.sh@291 -- # local -a pci_devs 00:16:17.997 02:35:50 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:16:17.997 02:35:50 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:16:17.997 02:35:50 -- nvmf/common.sh@293 -- # pci_drivers=() 00:16:17.997 02:35:50 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:16:17.997 02:35:50 -- nvmf/common.sh@295 -- # net_devs=() 00:16:17.997 02:35:50 -- nvmf/common.sh@295 -- # local -ga net_devs 00:16:17.997 02:35:50 -- nvmf/common.sh@296 -- # e810=() 00:16:17.997 02:35:50 -- nvmf/common.sh@296 -- # local -ga e810 00:16:17.997 02:35:50 -- nvmf/common.sh@297 -- # x722=() 00:16:17.997 02:35:50 -- nvmf/common.sh@297 -- # local -ga x722 00:16:17.997 02:35:50 -- nvmf/common.sh@298 -- # mlx=() 00:16:17.997 02:35:50 -- nvmf/common.sh@298 -- # local -ga mlx 00:16:17.997 02:35:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:17.997 02:35:50 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:17.997 02:35:50 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:17.997 02:35:50 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:17.997 02:35:50 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:17.997 02:35:50 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:17.997 02:35:50 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:17.997 02:35:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:17.997 02:35:50 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:17.997 02:35:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:17.997 02:35:50 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:17.997 02:35:50 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:16:17.997 02:35:50 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:16:17.997 02:35:50 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:16:17.997 02:35:50 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:16:17.997 02:35:50 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:16:17.997 02:35:50 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:16:17.997 02:35:50 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:16:17.997 02:35:50 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:17.997 02:35:50 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:16:17.997 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:16:17.997 02:35:50 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:16:17.997 02:35:50 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:16:17.997 02:35:50 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:16:17.997 02:35:50 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:16:17.997 02:35:50 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:16:17.997 02:35:50 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:17.997 02:35:50 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:17.997 02:35:50 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:16:17.997 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:16:17.997 02:35:50 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:16:17.997 02:35:50 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:16:17.997 02:35:50 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:16:17.997 02:35:50 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:16:17.997 02:35:50 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:16:17.997 02:35:50 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:17.997 02:35:50 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:16:17.997 02:35:50 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:16:17.997 02:35:50 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:17.998 02:35:50 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:17.998 02:35:50 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:17.998 02:35:50 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:17.998 02:35:50 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:16:17.998 Found net devices under 0000:18:00.0: mlx_0_0 00:16:17.998 02:35:50 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:17.998 02:35:50 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:17.998 02:35:50 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:17.998 02:35:50 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:17.998 02:35:50 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:17.998 02:35:50 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:16:17.998 Found net devices under 0000:18:00.1: mlx_0_1 00:16:17.998 02:35:50 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:17.998 02:35:50 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:16:17.998 02:35:50 -- nvmf/common.sh@403 -- # is_hw=yes 00:16:17.998 02:35:50 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:16:17.998 02:35:50 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:16:17.998 02:35:50 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:16:17.998 02:35:50 -- nvmf/common.sh@409 -- # rdma_device_init 00:16:17.998 02:35:50 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:16:17.998 02:35:50 -- nvmf/common.sh@58 -- # uname 00:16:17.998 02:35:50 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:16:17.998 02:35:50 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:16:17.998 02:35:50 -- nvmf/common.sh@63 -- # modprobe ib_core 00:16:17.998 02:35:50 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:16:17.998 02:35:50 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:16:17.998 02:35:50 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:16:17.998 02:35:50 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:16:17.998 02:35:50 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:16:17.998 02:35:50 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:16:17.998 02:35:50 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:16:17.998 02:35:50 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:16:17.998 02:35:50 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:17.998 02:35:50 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:17.998 02:35:50 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:17.998 02:35:50 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:17.998 02:35:50 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:17.998 02:35:50 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:17.998 02:35:50 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:17.998 02:35:50 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:16:17.998 02:35:50 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:16:17.998 02:35:50 -- nvmf/common.sh@105 -- # continue 2 00:16:17.998 02:35:50 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:17.998 02:35:50 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:17.998 02:35:50 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:16:17.998 02:35:50 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:17.998 02:35:50 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:16:17.998 02:35:50 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:16:17.998 02:35:50 -- nvmf/common.sh@105 -- # continue 2 00:16:17.998 02:35:50 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:17.998 02:35:50 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:16:17.998 02:35:50 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:16:17.998 02:35:50 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:16:17.998 02:35:50 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:17.998 02:35:50 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:17.998 02:35:50 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:16:17.998 02:35:50 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:16:17.998 02:35:50 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:16:17.998 60: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:16:17.998 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:16:17.998 altname enp24s0f0np0 00:16:17.998 altname ens785f0np0 00:16:17.998 inet 192.168.100.8/24 scope global mlx_0_0 00:16:17.998 valid_lft forever preferred_lft forever 00:16:17.998 02:35:50 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:17.998 02:35:50 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:16:17.998 02:35:50 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:16:17.998 02:35:50 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:16:17.998 02:35:50 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:17.998 02:35:50 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:17.998 02:35:50 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:16:17.998 02:35:50 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:16:17.998 02:35:50 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:16:17.998 61: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:16:17.998 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:16:17.998 altname enp24s0f1np1 00:16:17.998 altname ens785f1np1 00:16:17.998 inet 192.168.100.9/24 scope global mlx_0_1 00:16:17.998 valid_lft forever preferred_lft forever 00:16:17.998 02:35:50 -- nvmf/common.sh@411 -- # return 0 00:16:17.998 02:35:50 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:16:17.998 02:35:50 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:16:17.998 02:35:50 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:16:17.998 02:35:50 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:16:17.998 02:35:50 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:16:17.998 02:35:50 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:17.998 02:35:50 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:17.998 02:35:50 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:17.998 02:35:50 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:17.998 02:35:50 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:17.998 02:35:50 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:17.998 02:35:50 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:17.998 02:35:50 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:16:17.998 02:35:50 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:16:17.998 02:35:50 -- nvmf/common.sh@105 -- # continue 2 00:16:17.998 02:35:50 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:17.998 02:35:50 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:17.998 02:35:50 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:16:17.998 02:35:50 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:17.998 02:35:50 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:16:17.998 02:35:50 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:16:17.998 02:35:50 -- nvmf/common.sh@105 -- # continue 2 00:16:17.998 02:35:50 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:17.998 02:35:50 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:16:17.998 02:35:50 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:16:17.998 02:35:50 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:16:17.998 02:35:50 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:17.998 02:35:50 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:17.998 02:35:50 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:17.998 02:35:50 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:16:17.998 02:35:50 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:16:17.998 02:35:50 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:16:17.998 02:35:50 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:17.998 02:35:50 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:17.998 02:35:50 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:16:17.998 192.168.100.9' 00:16:17.998 02:35:50 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:16:17.998 192.168.100.9' 00:16:17.998 02:35:50 -- nvmf/common.sh@446 -- # head -n 1 00:16:17.998 02:35:50 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:16:17.998 02:35:50 -- nvmf/common.sh@447 -- # tail -n +2 00:16:17.998 02:35:50 -- nvmf/common.sh@447 -- # head -n 1 00:16:17.998 02:35:50 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:16:17.998 192.168.100.9' 00:16:17.998 02:35:50 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:16:17.998 02:35:50 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:16:17.998 02:35:50 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:16:17.998 02:35:50 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:16:17.998 02:35:50 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:16:17.998 02:35:50 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:16:17.998 02:35:50 -- target/device_removal.sh@235 -- # BOND_NAME=bond_nvmf 00:16:17.998 02:35:50 -- target/device_removal.sh@236 -- # BOND_IP=10.11.11.26 00:16:17.998 02:35:50 -- target/device_removal.sh@237 -- # BOND_MASK=24 00:16:17.998 02:35:50 -- target/device_removal.sh@311 -- # run_test nvmf_device_removal_pci_remove_no_srq test_remove_and_rescan --no-srq 00:16:17.998 02:35:50 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:17.998 02:35:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:17.998 02:35:50 -- common/autotest_common.sh@10 -- # set +x 00:16:17.998 ************************************ 00:16:17.998 START TEST nvmf_device_removal_pci_remove_no_srq 00:16:17.998 ************************************ 00:16:17.998 02:35:51 -- common/autotest_common.sh@1111 -- # test_remove_and_rescan --no-srq 00:16:17.998 02:35:51 -- target/device_removal.sh@128 -- # nvmfappstart -m 0x3 00:16:17.998 02:35:51 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:16:17.998 02:35:51 -- common/autotest_common.sh@710 -- # xtrace_disable 00:16:17.998 02:35:51 -- common/autotest_common.sh@10 -- # set +x 00:16:17.998 02:35:51 -- nvmf/common.sh@470 -- # nvmfpid=1557906 00:16:17.998 02:35:51 -- nvmf/common.sh@471 -- # waitforlisten 1557906 00:16:17.998 02:35:51 -- common/autotest_common.sh@817 -- # '[' -z 1557906 ']' 00:16:17.998 02:35:51 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:17.998 02:35:51 -- common/autotest_common.sh@822 -- # local max_retries=100 00:16:17.998 02:35:51 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:17.998 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:17.998 02:35:51 -- common/autotest_common.sh@826 -- # xtrace_disable 00:16:17.998 02:35:51 -- common/autotest_common.sh@10 -- # set +x 00:16:17.998 02:35:51 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:16:17.999 [2024-04-27 02:35:51.071681] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:16:17.999 [2024-04-27 02:35:51.071732] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:17.999 EAL: No free 2048 kB hugepages reported on node 1 00:16:17.999 [2024-04-27 02:35:51.145217] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:16:17.999 [2024-04-27 02:35:51.227759] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:17.999 [2024-04-27 02:35:51.227798] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:17.999 [2024-04-27 02:35:51.227808] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:16:17.999 [2024-04-27 02:35:51.227818] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:16:17.999 [2024-04-27 02:35:51.227825] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:17.999 [2024-04-27 02:35:51.227877] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:17.999 [2024-04-27 02:35:51.227881] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:18.258 02:35:51 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:16:18.258 02:35:51 -- common/autotest_common.sh@850 -- # return 0 00:16:18.258 02:35:51 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:16:18.258 02:35:51 -- common/autotest_common.sh@716 -- # xtrace_disable 00:16:18.258 02:35:51 -- common/autotest_common.sh@10 -- # set +x 00:16:18.518 02:35:51 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:18.518 02:35:51 -- target/device_removal.sh@130 -- # create_subsystem_and_connect --no-srq 00:16:18.518 02:35:51 -- target/device_removal.sh@45 -- # local -gA netdev_nvme_dict 00:16:18.518 02:35:51 -- target/device_removal.sh@46 -- # netdev_nvme_dict=() 00:16:18.518 02:35:51 -- target/device_removal.sh@48 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 --no-srq 00:16:18.518 02:35:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:18.518 02:35:51 -- common/autotest_common.sh@10 -- # set +x 00:16:18.518 [2024-04-27 02:35:51.947942] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xed2f40/0xed7430) succeed. 00:16:18.518 [2024-04-27 02:35:51.957013] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xed4440/0xf18ac0) succeed. 00:16:18.518 02:35:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:18.518 02:35:51 -- target/device_removal.sh@49 -- # get_rdma_if_list 00:16:18.518 02:35:51 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:18.518 02:35:51 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:18.518 02:35:51 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:18.518 02:35:51 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:18.518 02:35:51 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:18.518 02:35:51 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:18.518 02:35:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:18.518 02:35:51 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:16:18.518 02:35:51 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:16:18.518 02:35:51 -- nvmf/common.sh@105 -- # continue 2 00:16:18.518 02:35:51 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:18.518 02:35:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:18.518 02:35:51 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:16:18.518 02:35:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:18.518 02:35:51 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:16:18.518 02:35:51 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:16:18.518 02:35:51 -- nvmf/common.sh@105 -- # continue 2 00:16:18.518 02:35:51 -- target/device_removal.sh@49 -- # for net_dev in $(get_rdma_if_list) 00:16:18.518 02:35:52 -- target/device_removal.sh@50 -- # create_subsystem_and_connect_on_netdev mlx_0_0 00:16:18.518 02:35:52 -- target/device_removal.sh@25 -- # local -a dev_name 00:16:18.518 02:35:52 -- target/device_removal.sh@27 -- # dev_name=mlx_0_0 00:16:18.518 02:35:52 -- target/device_removal.sh@28 -- # malloc_name=mlx_0_0 00:16:18.518 02:35:52 -- target/device_removal.sh@29 -- # get_subsystem_nqn mlx_0_0 00:16:18.518 02:35:52 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_0 00:16:18.518 02:35:52 -- target/device_removal.sh@29 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_0 00:16:18.518 02:35:52 -- target/device_removal.sh@30 -- # get_ip_address mlx_0_0 00:16:18.518 02:35:52 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:16:18.518 02:35:52 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:16:18.518 02:35:52 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:18.518 02:35:52 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:18.518 02:35:52 -- target/device_removal.sh@30 -- # ip=192.168.100.8 00:16:18.518 02:35:52 -- target/device_removal.sh@31 -- # serial=SPDK000mlx_0_0 00:16:18.518 02:35:52 -- target/device_removal.sh@33 -- # MALLOC_BDEV_SIZE=128 00:16:18.518 02:35:52 -- target/device_removal.sh@34 -- # MALLOC_BLOCK_SIZE=512 00:16:18.518 02:35:52 -- target/device_removal.sh@36 -- # rpc_cmd bdev_malloc_create 128 512 -b mlx_0_0 00:16:18.518 02:35:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:18.518 02:35:52 -- common/autotest_common.sh@10 -- # set +x 00:16:18.518 02:35:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:18.518 02:35:52 -- target/device_removal.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:system_mlx_0_0 -a -s SPDK000mlx_0_0 00:16:18.518 02:35:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:18.518 02:35:52 -- common/autotest_common.sh@10 -- # set +x 00:16:18.518 02:35:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:18.518 02:35:52 -- target/device_removal.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:system_mlx_0_0 mlx_0_0 00:16:18.518 02:35:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:18.518 02:35:52 -- common/autotest_common.sh@10 -- # set +x 00:16:18.518 02:35:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:18.518 02:35:52 -- target/device_removal.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:system_mlx_0_0 -t rdma -a 192.168.100.8 -s 4420 00:16:18.518 02:35:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:18.518 02:35:52 -- common/autotest_common.sh@10 -- # set +x 00:16:18.518 [2024-04-27 02:35:52.087113] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:16:18.518 02:35:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:18.518 02:35:52 -- target/device_removal.sh@41 -- # return 0 00:16:18.518 02:35:52 -- target/device_removal.sh@50 -- # netdev_nvme_dict[$net_dev]=mlx_0_0 00:16:18.518 02:35:52 -- target/device_removal.sh@49 -- # for net_dev in $(get_rdma_if_list) 00:16:18.518 02:35:52 -- target/device_removal.sh@50 -- # create_subsystem_and_connect_on_netdev mlx_0_1 00:16:18.518 02:35:52 -- target/device_removal.sh@25 -- # local -a dev_name 00:16:18.518 02:35:52 -- target/device_removal.sh@27 -- # dev_name=mlx_0_1 00:16:18.518 02:35:52 -- target/device_removal.sh@28 -- # malloc_name=mlx_0_1 00:16:18.518 02:35:52 -- target/device_removal.sh@29 -- # get_subsystem_nqn mlx_0_1 00:16:18.518 02:35:52 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_1 00:16:18.518 02:35:52 -- target/device_removal.sh@29 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_1 00:16:18.518 02:35:52 -- target/device_removal.sh@30 -- # get_ip_address mlx_0_1 00:16:18.518 02:35:52 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:16:18.518 02:35:52 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:16:18.518 02:35:52 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:18.518 02:35:52 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:18.518 02:35:52 -- target/device_removal.sh@30 -- # ip=192.168.100.9 00:16:18.518 02:35:52 -- target/device_removal.sh@31 -- # serial=SPDK000mlx_0_1 00:16:18.518 02:35:52 -- target/device_removal.sh@33 -- # MALLOC_BDEV_SIZE=128 00:16:18.518 02:35:52 -- target/device_removal.sh@34 -- # MALLOC_BLOCK_SIZE=512 00:16:18.518 02:35:52 -- target/device_removal.sh@36 -- # rpc_cmd bdev_malloc_create 128 512 -b mlx_0_1 00:16:18.518 02:35:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:18.518 02:35:52 -- common/autotest_common.sh@10 -- # set +x 00:16:18.777 02:35:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:18.777 02:35:52 -- target/device_removal.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:system_mlx_0_1 -a -s SPDK000mlx_0_1 00:16:18.777 02:35:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:18.777 02:35:52 -- common/autotest_common.sh@10 -- # set +x 00:16:18.777 02:35:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:18.777 02:35:52 -- target/device_removal.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:system_mlx_0_1 mlx_0_1 00:16:18.778 02:35:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:18.778 02:35:52 -- common/autotest_common.sh@10 -- # set +x 00:16:18.778 02:35:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:18.778 02:35:52 -- target/device_removal.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:system_mlx_0_1 -t rdma -a 192.168.100.9 -s 4420 00:16:18.778 02:35:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:18.778 02:35:52 -- common/autotest_common.sh@10 -- # set +x 00:16:18.778 [2024-04-27 02:35:52.171299] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:16:18.778 02:35:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:18.778 02:35:52 -- target/device_removal.sh@41 -- # return 0 00:16:18.778 02:35:52 -- target/device_removal.sh@50 -- # netdev_nvme_dict[$net_dev]=mlx_0_1 00:16:18.778 02:35:52 -- target/device_removal.sh@53 -- # return 0 00:16:18.778 02:35:52 -- target/device_removal.sh@132 -- # generate_io_traffic_with_bdevperf mlx_0_0 mlx_0_1 00:16:18.778 02:35:52 -- target/device_removal.sh@87 -- # dev_names=('mlx_0_0' 'mlx_0_1') 00:16:18.778 02:35:52 -- target/device_removal.sh@87 -- # local dev_names 00:16:18.778 02:35:52 -- target/device_removal.sh@89 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:16:18.778 02:35:52 -- target/device_removal.sh@91 -- # bdevperf_pid=1558110 00:16:18.778 02:35:52 -- target/device_removal.sh@93 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; kill -9 $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:16:18.778 02:35:52 -- target/device_removal.sh@90 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 90 00:16:18.778 02:35:52 -- target/device_removal.sh@94 -- # waitforlisten 1558110 /var/tmp/bdevperf.sock 00:16:18.778 02:35:52 -- common/autotest_common.sh@817 -- # '[' -z 1558110 ']' 00:16:18.778 02:35:52 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:18.778 02:35:52 -- common/autotest_common.sh@822 -- # local max_retries=100 00:16:18.778 02:35:52 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:18.778 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:18.778 02:35:52 -- common/autotest_common.sh@826 -- # xtrace_disable 00:16:18.778 02:35:52 -- common/autotest_common.sh@10 -- # set +x 00:16:19.716 02:35:53 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:16:19.716 02:35:53 -- common/autotest_common.sh@850 -- # return 0 00:16:19.716 02:35:53 -- target/device_removal.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_set_options -r -1 00:16:19.716 02:35:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:19.716 02:35:53 -- common/autotest_common.sh@10 -- # set +x 00:16:19.716 02:35:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:19.716 02:35:53 -- target/device_removal.sh@100 -- # for dev_name in "${dev_names[@]}" 00:16:19.716 02:35:53 -- target/device_removal.sh@101 -- # get_subsystem_nqn mlx_0_0 00:16:19.716 02:35:53 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_0 00:16:19.716 02:35:53 -- target/device_removal.sh@101 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_0 00:16:19.716 02:35:53 -- target/device_removal.sh@102 -- # get_ip_address mlx_0_0 00:16:19.716 02:35:53 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:16:19.716 02:35:53 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:16:19.716 02:35:53 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:19.716 02:35:53 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:19.716 02:35:53 -- target/device_removal.sh@102 -- # tgt_ip=192.168.100.8 00:16:19.716 02:35:53 -- target/device_removal.sh@106 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme_mlx_0_0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:system_mlx_0_0 -l -1 -o 1 00:16:19.716 02:35:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:19.716 02:35:53 -- common/autotest_common.sh@10 -- # set +x 00:16:19.716 Nvme_mlx_0_0n1 00:16:19.716 02:35:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:19.716 02:35:53 -- target/device_removal.sh@100 -- # for dev_name in "${dev_names[@]}" 00:16:19.716 02:35:53 -- target/device_removal.sh@101 -- # get_subsystem_nqn mlx_0_1 00:16:19.716 02:35:53 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_1 00:16:19.716 02:35:53 -- target/device_removal.sh@101 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_1 00:16:19.716 02:35:53 -- target/device_removal.sh@102 -- # get_ip_address mlx_0_1 00:16:19.716 02:35:53 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:16:19.716 02:35:53 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:16:19.716 02:35:53 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:19.716 02:35:53 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:19.716 02:35:53 -- target/device_removal.sh@102 -- # tgt_ip=192.168.100.9 00:16:19.716 02:35:53 -- target/device_removal.sh@106 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme_mlx_0_1 -t rdma -a 192.168.100.9 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:system_mlx_0_1 -l -1 -o 1 00:16:19.716 02:35:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:19.716 02:35:53 -- common/autotest_common.sh@10 -- # set +x 00:16:19.716 Nvme_mlx_0_1n1 00:16:19.716 02:35:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:19.716 02:35:53 -- target/device_removal.sh@110 -- # bdevperf_rpc_pid=1558298 00:16:19.716 02:35:53 -- target/device_removal.sh@112 -- # sleep 5 00:16:19.716 02:35:53 -- target/device_removal.sh@109 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 120 -s /var/tmp/bdevperf.sock perform_tests 00:16:24.991 02:35:58 -- target/device_removal.sh@134 -- # for net_dev in "${!netdev_nvme_dict[@]}" 00:16:24.992 02:35:58 -- target/device_removal.sh@135 -- # nvme_dev=mlx_0_0 00:16:24.992 02:35:58 -- target/device_removal.sh@136 -- # get_rdma_device_name mlx_0_0 00:16:24.992 02:35:58 -- target/device_removal.sh@71 -- # dev_name=mlx_0_0 00:16:24.992 02:35:58 -- target/device_removal.sh@72 -- # get_pci_dir mlx_0_0 00:16:24.992 02:35:58 -- target/device_removal.sh@61 -- # dev_name=mlx_0_0 00:16:24.992 02:35:58 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.0/net/mlx_0_0/device 00:16:24.992 02:35:58 -- target/device_removal.sh@72 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.0/infiniband 00:16:24.992 02:35:58 -- target/device_removal.sh@136 -- # rdma_dev_name=mlx5_0 00:16:24.992 02:35:58 -- target/device_removal.sh@137 -- # get_ip_address mlx_0_0 00:16:24.992 02:35:58 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:16:24.992 02:35:58 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:16:24.992 02:35:58 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:24.992 02:35:58 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:24.992 02:35:58 -- target/device_removal.sh@137 -- # origin_ip=192.168.100.8 00:16:24.992 02:35:58 -- target/device_removal.sh@138 -- # get_pci_dir mlx_0_0 00:16:24.992 02:35:58 -- target/device_removal.sh@61 -- # dev_name=mlx_0_0 00:16:24.992 02:35:58 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.0/net/mlx_0_0/device 00:16:24.992 02:35:58 -- target/device_removal.sh@138 -- # pci_dir=/sys/devices/pci0000:17/0000:17:00.0/0000:18:00.0 00:16:24.992 02:35:58 -- target/device_removal.sh@140 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_0 00:16:24.992 02:35:58 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_0 00:16:24.992 02:35:58 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:16:24.992 02:35:58 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:16:24.992 02:35:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:24.992 02:35:58 -- target/device_removal.sh@77 -- # grep mlx5_0 00:16:24.992 02:35:58 -- common/autotest_common.sh@10 -- # set +x 00:16:24.992 02:35:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:24.992 mlx5_0 00:16:24.992 02:35:58 -- target/device_removal.sh@78 -- # return 0 00:16:24.992 02:35:58 -- target/device_removal.sh@145 -- # remove_one_nic mlx_0_0 00:16:24.992 02:35:58 -- target/device_removal.sh@66 -- # dev_name=mlx_0_0 00:16:24.992 02:35:58 -- target/device_removal.sh@67 -- # echo 1 00:16:24.992 02:35:58 -- target/device_removal.sh@67 -- # get_pci_dir mlx_0_0 00:16:24.992 02:35:58 -- target/device_removal.sh@61 -- # dev_name=mlx_0_0 00:16:24.992 02:35:58 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.0/net/mlx_0_0/device 00:16:24.992 [2024-04-27 02:35:58.427847] rdma.c:3563:nvmf_rdma_handle_device_removal: *NOTICE*: Port 192.168.100.8:4420 on device mlx5_0 is being removed. 00:16:24.992 [2024-04-27 02:35:58.427940] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:16:24.992 [2024-04-27 02:35:58.428514] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:16:24.992 [2024-04-27 02:35:58.428531] rdma.c: 845:nvmf_rdma_qpair_destroy: *WARNING*: Destroying qpair when queue depth is 94 00:16:24.992 [2024-04-27 02:35:58.428541] rdma.c: 632:nvmf_rdma_dump_qpair_contents: *ERROR*: Dumping contents of queue pair (QID 1) 00:16:24.992 [2024-04-27 02:35:58.428554] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.992 [2024-04-27 02:35:58.428562] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.992 [2024-04-27 02:35:58.428570] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:24.992 [2024-04-27 02:35:58.428577] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:24.992 [2024-04-27 02:35:58.428585] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.992 [2024-04-27 02:35:58.428592] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.992 [2024-04-27 02:35:58.428600] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.992 [2024-04-27 02:35:58.428608] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.992 [2024-04-27 02:35:58.428617] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.992 [2024-04-27 02:35:58.428624] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.992 [2024-04-27 02:35:58.428632] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:24.992 [2024-04-27 02:35:58.428639] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:24.992 [2024-04-27 02:35:58.428646] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.992 [2024-04-27 02:35:58.428653] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.992 [2024-04-27 02:35:58.428660] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:24.992 [2024-04-27 02:35:58.428668] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:24.992 [2024-04-27 02:35:58.428677] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.992 [2024-04-27 02:35:58.428684] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.992 [2024-04-27 02:35:58.428692] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:24.992 [2024-04-27 02:35:58.428699] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:24.992 [2024-04-27 02:35:58.428707] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.992 [2024-04-27 02:35:58.428714] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.992 [2024-04-27 02:35:58.428722] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.992 [2024-04-27 02:35:58.428729] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.992 [2024-04-27 02:35:58.428737] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.992 [2024-04-27 02:35:58.428745] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.992 [2024-04-27 02:35:58.428753] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.992 [2024-04-27 02:35:58.428761] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.992 [2024-04-27 02:35:58.428768] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:24.992 [2024-04-27 02:35:58.428776] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:24.992 [2024-04-27 02:35:58.428783] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:24.992 [2024-04-27 02:35:58.428790] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:24.992 [2024-04-27 02:35:58.428798] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.992 [2024-04-27 02:35:58.428806] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.992 [2024-04-27 02:35:58.428814] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.992 [2024-04-27 02:35:58.428822] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.992 [2024-04-27 02:35:58.428829] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.992 [2024-04-27 02:35:58.428837] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.992 [2024-04-27 02:35:58.428844] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.992 [2024-04-27 02:35:58.428852] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.992 [2024-04-27 02:35:58.428859] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.992 [2024-04-27 02:35:58.428866] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.992 [2024-04-27 02:35:58.428878] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.992 [2024-04-27 02:35:58.428886] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.992 [2024-04-27 02:35:58.428894] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:24.992 [2024-04-27 02:35:58.428902] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:24.992 [2024-04-27 02:35:58.428909] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.992 [2024-04-27 02:35:58.428916] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.992 [2024-04-27 02:35:58.428924] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:24.992 [2024-04-27 02:35:58.428931] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:24.992 [2024-04-27 02:35:58.428938] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.992 [2024-04-27 02:35:58.428946] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.992 [2024-04-27 02:35:58.428954] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:24.992 [2024-04-27 02:35:58.428961] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:24.992 [2024-04-27 02:35:58.428969] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.992 [2024-04-27 02:35:58.428977] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.992 [2024-04-27 02:35:58.428984] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:24.992 [2024-04-27 02:35:58.428992] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:24.992 [2024-04-27 02:35:58.428999] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:24.992 [2024-04-27 02:35:58.429007] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:24.992 [2024-04-27 02:35:58.429015] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.992 [2024-04-27 02:35:58.429022] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.992 [2024-04-27 02:35:58.429029] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.992 [2024-04-27 02:35:58.429036] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.992 [2024-04-27 02:35:58.429044] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.992 [2024-04-27 02:35:58.429055] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.992 [2024-04-27 02:35:58.429062] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:24.992 [2024-04-27 02:35:58.429070] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:24.992 [2024-04-27 02:35:58.429078] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:24.992 [2024-04-27 02:35:58.429085] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:24.992 [2024-04-27 02:35:58.429093] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.992 [2024-04-27 02:35:58.429100] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.992 [2024-04-27 02:35:58.429107] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.992 [2024-04-27 02:35:58.429114] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.992 [2024-04-27 02:35:58.429122] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.992 [2024-04-27 02:35:58.429130] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.992 [2024-04-27 02:35:58.429140] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:24.992 [2024-04-27 02:35:58.429152] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:24.992 [2024-04-27 02:35:58.429162] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.992 [2024-04-27 02:35:58.429170] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.992 [2024-04-27 02:35:58.429178] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:24.992 [2024-04-27 02:35:58.429185] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:24.993 [2024-04-27 02:35:58.429193] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.993 [2024-04-27 02:35:58.429203] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.993 [2024-04-27 02:35:58.429210] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:24.993 [2024-04-27 02:35:58.429217] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:24.993 [2024-04-27 02:35:58.429225] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.993 [2024-04-27 02:35:58.429232] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.993 [2024-04-27 02:35:58.429239] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.993 [2024-04-27 02:35:58.429246] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.993 [2024-04-27 02:35:58.429255] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:24.993 [2024-04-27 02:35:58.429262] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:24.993 [2024-04-27 02:35:58.429269] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.993 [2024-04-27 02:35:58.429276] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.993 [2024-04-27 02:35:58.429283] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:24.993 [2024-04-27 02:35:58.429290] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:24.993 [2024-04-27 02:35:58.429297] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.993 [2024-04-27 02:35:58.429306] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.993 [2024-04-27 02:35:58.429314] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.993 [2024-04-27 02:35:58.429321] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.993 [2024-04-27 02:35:58.429328] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.993 [2024-04-27 02:35:58.429345] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.993 [2024-04-27 02:35:58.429352] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:24.993 [2024-04-27 02:35:58.429360] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:24.993 [2024-04-27 02:35:58.429367] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:24.993 [2024-04-27 02:35:58.429374] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:24.993 [2024-04-27 02:35:58.429382] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.993 [2024-04-27 02:35:58.429389] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.993 [2024-04-27 02:35:58.429397] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.993 [2024-04-27 02:35:58.429404] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.993 [2024-04-27 02:35:58.429411] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.993 [2024-04-27 02:35:58.429418] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.993 [2024-04-27 02:35:58.429427] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.993 [2024-04-27 02:35:58.429437] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.993 [2024-04-27 02:35:58.429444] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:24.993 [2024-04-27 02:35:58.429452] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:24.993 [2024-04-27 02:35:58.429459] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.993 [2024-04-27 02:35:58.429466] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.993 [2024-04-27 02:35:58.429473] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.993 [2024-04-27 02:35:58.429481] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.993 [2024-04-27 02:35:58.429488] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:24.993 [2024-04-27 02:35:58.429496] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:24.993 [2024-04-27 02:35:58.429503] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.993 [2024-04-27 02:35:58.429510] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.993 [2024-04-27 02:35:58.429518] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.993 [2024-04-27 02:35:58.429527] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.993 [2024-04-27 02:35:58.429534] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:24.993 [2024-04-27 02:35:58.429542] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:24.993 [2024-04-27 02:35:58.429549] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:24.993 [2024-04-27 02:35:58.429559] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:24.993 [2024-04-27 02:35:58.429566] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.993 [2024-04-27 02:35:58.429574] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.993 [2024-04-27 02:35:58.429581] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.993 [2024-04-27 02:35:58.429589] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.993 [2024-04-27 02:35:58.429597] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.993 [2024-04-27 02:35:58.429604] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.993 [2024-04-27 02:35:58.429611] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.993 [2024-04-27 02:35:58.429619] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.993 [2024-04-27 02:35:58.429626] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.993 [2024-04-27 02:35:58.429633] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.993 [2024-04-27 02:35:58.429641] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.993 [2024-04-27 02:35:58.429648] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.993 [2024-04-27 02:35:58.429655] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:24.993 [2024-04-27 02:35:58.429662] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:24.993 [2024-04-27 02:35:58.429670] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:24.993 [2024-04-27 02:35:58.429678] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:24.993 [2024-04-27 02:35:58.429685] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:24.993 [2024-04-27 02:35:58.429692] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:24.993 [2024-04-27 02:35:58.429699] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.993 [2024-04-27 02:35:58.429706] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.993 [2024-04-27 02:35:58.429713] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.993 [2024-04-27 02:35:58.429721] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.993 [2024-04-27 02:35:58.429731] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:24.993 [2024-04-27 02:35:58.429742] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:24.993 [2024-04-27 02:35:58.429750] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.993 [2024-04-27 02:35:58.429757] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.993 [2024-04-27 02:35:58.429764] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.993 [2024-04-27 02:35:58.429771] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.993 [2024-04-27 02:35:58.429779] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.993 [2024-04-27 02:35:58.429787] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.993 [2024-04-27 02:35:58.429796] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.993 [2024-04-27 02:35:58.429806] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.993 [2024-04-27 02:35:58.429813] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:24.993 [2024-04-27 02:35:58.429820] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:24.993 [2024-04-27 02:35:58.429827] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.993 [2024-04-27 02:35:58.429834] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.993 [2024-04-27 02:35:58.429841] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:24.993 [2024-04-27 02:35:58.429850] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:24.993 [2024-04-27 02:35:58.429859] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:24.993 [2024-04-27 02:35:58.429866] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:24.993 [2024-04-27 02:35:58.429874] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:24.993 [2024-04-27 02:35:58.429881] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:24.993 [2024-04-27 02:35:58.429888] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.993 [2024-04-27 02:35:58.429896] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.993 [2024-04-27 02:35:58.429904] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.993 [2024-04-27 02:35:58.429911] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.993 [2024-04-27 02:35:58.429918] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:24.993 [2024-04-27 02:35:58.429925] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:24.993 [2024-04-27 02:35:58.429932] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.993 [2024-04-27 02:35:58.429939] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.993 [2024-04-27 02:35:58.429946] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.993 [2024-04-27 02:35:58.429954] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.993 [2024-04-27 02:35:58.429962] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.993 [2024-04-27 02:35:58.429969] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.993 [2024-04-27 02:35:58.429976] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.993 [2024-04-27 02:35:58.429983] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:24.993 [2024-04-27 02:35:58.429990] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:24.993 [2024-04-27 02:35:58.429997] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:31.560 02:36:04 -- target/device_removal.sh@147 -- # seq 1 10 00:16:31.560 02:36:04 -- target/device_removal.sh@147 -- # for i in $(seq 1 10) 00:16:31.560 02:36:04 -- target/device_removal.sh@148 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_0 00:16:31.560 02:36:04 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_0 00:16:31.560 02:36:04 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:16:31.560 02:36:04 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:16:31.560 02:36:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:31.560 02:36:04 -- common/autotest_common.sh@10 -- # set +x 00:16:31.560 02:36:04 -- target/device_removal.sh@77 -- # grep mlx5_0 00:16:31.560 02:36:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:31.560 02:36:04 -- target/device_removal.sh@78 -- # return 1 00:16:31.560 02:36:04 -- target/device_removal.sh@149 -- # break 00:16:31.560 02:36:04 -- target/device_removal.sh@158 -- # get_rdma_dev_count_in_nvmf_tgt 00:16:31.560 02:36:04 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:16:31.560 02:36:04 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:16:31.560 02:36:04 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:16:31.560 02:36:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:31.560 02:36:04 -- common/autotest_common.sh@10 -- # set +x 00:16:31.560 02:36:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:31.561 02:36:04 -- target/device_removal.sh@158 -- # ib_count_after_remove=1 00:16:31.561 02:36:04 -- target/device_removal.sh@160 -- # rescan_pci 00:16:31.561 02:36:04 -- target/device_removal.sh@57 -- # echo 1 00:16:31.820 02:36:05 -- target/device_removal.sh@162 -- # seq 1 10 00:16:31.820 02:36:05 -- target/device_removal.sh@162 -- # for i in $(seq 1 10) 00:16:31.820 02:36:05 -- target/device_removal.sh@163 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.0/net 00:16:31.820 02:36:05 -- target/device_removal.sh@163 -- # new_net_dev=mlx_0_0 00:16:31.820 02:36:05 -- target/device_removal.sh@164 -- # [[ -z mlx_0_0 ]] 00:16:31.820 02:36:05 -- target/device_removal.sh@166 -- # [[ mlx_0_0 != \m\l\x\_\0\_\0 ]] 00:16:31.820 02:36:05 -- target/device_removal.sh@171 -- # break 00:16:31.820 02:36:05 -- target/device_removal.sh@175 -- # [[ -z mlx_0_0 ]] 00:16:31.820 02:36:05 -- target/device_removal.sh@179 -- # ip link set mlx_0_0 up 00:16:31.820 [2024-04-27 02:36:05.430710] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1251ee0/0xed7430) succeed. 00:16:31.820 [2024-04-27 02:36:05.430785] rdma.c:3305:nvmf_rdma_retry_listen_port: *ERROR*: Found new IB device but port 192.168.100.8:4420 is still failed(-1) to listen. 00:16:35.107 02:36:08 -- target/device_removal.sh@180 -- # get_ip_address mlx_0_0 00:16:35.107 02:36:08 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:16:35.107 02:36:08 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:16:35.107 02:36:08 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:35.107 02:36:08 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:35.107 02:36:08 -- target/device_removal.sh@180 -- # [[ -z '' ]] 00:16:35.107 02:36:08 -- target/device_removal.sh@181 -- # ip addr add 192.168.100.8/24 dev mlx_0_0 00:16:35.107 02:36:08 -- target/device_removal.sh@186 -- # seq 1 10 00:16:35.107 02:36:08 -- target/device_removal.sh@186 -- # for i in $(seq 1 10) 00:16:35.107 02:36:08 -- target/device_removal.sh@187 -- # get_rdma_dev_count_in_nvmf_tgt 00:16:35.107 02:36:08 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:16:35.107 02:36:08 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:16:35.107 02:36:08 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:16:35.107 02:36:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:35.107 02:36:08 -- common/autotest_common.sh@10 -- # set +x 00:16:35.107 [2024-04-27 02:36:08.483789] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:16:35.107 [2024-04-27 02:36:08.483824] rdma.c:3311:nvmf_rdma_retry_listen_port: *NOTICE*: Port 192.168.100.8:4420 come back 00:16:35.107 [2024-04-27 02:36:08.483844] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:16:35.107 [2024-04-27 02:36:08.483862] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:16:35.107 02:36:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:35.107 02:36:08 -- target/device_removal.sh@187 -- # ib_count=2 00:16:35.107 02:36:08 -- target/device_removal.sh@188 -- # (( ib_count > ib_count_after_remove )) 00:16:35.107 02:36:08 -- target/device_removal.sh@189 -- # break 00:16:35.107 02:36:08 -- target/device_removal.sh@134 -- # for net_dev in "${!netdev_nvme_dict[@]}" 00:16:35.107 02:36:08 -- target/device_removal.sh@135 -- # nvme_dev=mlx_0_1 00:16:35.107 02:36:08 -- target/device_removal.sh@136 -- # get_rdma_device_name mlx_0_1 00:16:35.107 02:36:08 -- target/device_removal.sh@71 -- # dev_name=mlx_0_1 00:16:35.107 02:36:08 -- target/device_removal.sh@72 -- # get_pci_dir mlx_0_1 00:16:35.107 02:36:08 -- target/device_removal.sh@61 -- # dev_name=mlx_0_1 00:16:35.107 02:36:08 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.1/net/mlx_0_1/device 00:16:35.107 02:36:08 -- target/device_removal.sh@72 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.1/infiniband 00:16:35.107 02:36:08 -- target/device_removal.sh@136 -- # rdma_dev_name=mlx5_1 00:16:35.107 02:36:08 -- target/device_removal.sh@137 -- # get_ip_address mlx_0_1 00:16:35.107 02:36:08 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:16:35.107 02:36:08 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:16:35.107 02:36:08 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:35.107 02:36:08 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:35.107 02:36:08 -- target/device_removal.sh@137 -- # origin_ip=192.168.100.9 00:16:35.107 02:36:08 -- target/device_removal.sh@138 -- # get_pci_dir mlx_0_1 00:16:35.107 02:36:08 -- target/device_removal.sh@61 -- # dev_name=mlx_0_1 00:16:35.107 02:36:08 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.1/net/mlx_0_1/device 00:16:35.107 02:36:08 -- target/device_removal.sh@138 -- # pci_dir=/sys/devices/pci0000:17/0000:17:00.0/0000:18:00.1 00:16:35.107 02:36:08 -- target/device_removal.sh@140 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_1 00:16:35.107 02:36:08 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_1 00:16:35.107 02:36:08 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:16:35.107 02:36:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:35.107 02:36:08 -- common/autotest_common.sh@10 -- # set +x 00:16:35.107 02:36:08 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:16:35.107 02:36:08 -- target/device_removal.sh@77 -- # grep mlx5_1 00:16:35.107 02:36:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:35.107 mlx5_1 00:16:35.107 02:36:08 -- target/device_removal.sh@78 -- # return 0 00:16:35.107 02:36:08 -- target/device_removal.sh@145 -- # remove_one_nic mlx_0_1 00:16:35.107 02:36:08 -- target/device_removal.sh@66 -- # dev_name=mlx_0_1 00:16:35.107 02:36:08 -- target/device_removal.sh@67 -- # echo 1 00:16:35.107 02:36:08 -- target/device_removal.sh@67 -- # get_pci_dir mlx_0_1 00:16:35.107 02:36:08 -- target/device_removal.sh@61 -- # dev_name=mlx_0_1 00:16:35.107 02:36:08 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.1/net/mlx_0_1/device 00:16:35.107 [2024-04-27 02:36:08.668688] rdma.c:3563:nvmf_rdma_handle_device_removal: *NOTICE*: Port 192.168.100.9:4420 on device mlx5_1 is being removed. 00:16:35.107 [2024-04-27 02:36:08.668758] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:16:35.107 [2024-04-27 02:36:08.672622] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:16:35.107 [2024-04-27 02:36:08.672671] rdma.c: 845:nvmf_rdma_qpair_destroy: *WARNING*: Destroying qpair when queue depth is 127 00:16:35.107 [2024-04-27 02:36:08.672698] rdma.c: 632:nvmf_rdma_dump_qpair_contents: *ERROR*: Dumping contents of queue pair (QID 1) 00:16:35.107 [2024-04-27 02:36:08.672724] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.107 [2024-04-27 02:36:08.672749] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.107 [2024-04-27 02:36:08.672775] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.107 [2024-04-27 02:36:08.672799] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.107 [2024-04-27 02:36:08.672823] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.107 [2024-04-27 02:36:08.672847] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.107 [2024-04-27 02:36:08.672872] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.107 [2024-04-27 02:36:08.672897] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.107 [2024-04-27 02:36:08.672921] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.107 [2024-04-27 02:36:08.672946] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.107 [2024-04-27 02:36:08.672974] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.107 [2024-04-27 02:36:08.672981] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.107 [2024-04-27 02:36:08.672989] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.107 [2024-04-27 02:36:08.672997] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.107 [2024-04-27 02:36:08.673004] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.107 [2024-04-27 02:36:08.673012] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.107 [2024-04-27 02:36:08.673020] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.107 [2024-04-27 02:36:08.673028] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.107 [2024-04-27 02:36:08.673035] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.107 [2024-04-27 02:36:08.673043] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.107 [2024-04-27 02:36:08.673050] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.107 [2024-04-27 02:36:08.673058] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.107 [2024-04-27 02:36:08.673065] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.107 [2024-04-27 02:36:08.673073] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.107 [2024-04-27 02:36:08.673081] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:35.107 [2024-04-27 02:36:08.673088] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:35.107 [2024-04-27 02:36:08.673095] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.107 [2024-04-27 02:36:08.673103] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.107 [2024-04-27 02:36:08.673110] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:35.107 [2024-04-27 02:36:08.673117] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:35.107 [2024-04-27 02:36:08.673125] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.107 [2024-04-27 02:36:08.673137] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.107 [2024-04-27 02:36:08.673146] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.107 [2024-04-27 02:36:08.673153] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.107 [2024-04-27 02:36:08.673161] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.107 [2024-04-27 02:36:08.673168] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.107 [2024-04-27 02:36:08.673176] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.107 [2024-04-27 02:36:08.673183] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.107 [2024-04-27 02:36:08.673191] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.107 [2024-04-27 02:36:08.673199] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.107 [2024-04-27 02:36:08.673207] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.107 [2024-04-27 02:36:08.673214] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.107 [2024-04-27 02:36:08.673221] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.107 [2024-04-27 02:36:08.673229] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.107 [2024-04-27 02:36:08.673236] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.107 [2024-04-27 02:36:08.673243] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.107 [2024-04-27 02:36:08.673251] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.107 [2024-04-27 02:36:08.673259] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.107 [2024-04-27 02:36:08.673267] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.107 [2024-04-27 02:36:08.673274] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.107 [2024-04-27 02:36:08.673281] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673288] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673295] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673305] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673313] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673322] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673329] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673345] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673357] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673365] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673372] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673380] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673387] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673394] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673402] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673410] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673417] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673424] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673432] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673439] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673446] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673454] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673463] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673472] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673480] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673488] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673495] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673502] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673510] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673517] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673525] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673533] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673540] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673548] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673555] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673562] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673569] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673577] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673585] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673593] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673600] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673608] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673615] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673622] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673629] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673637] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673644] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673651] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673659] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673665] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673674] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673682] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673689] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673697] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673705] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673712] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673719] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673726] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673733] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673740] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673748] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673756] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673763] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673771] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673780] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673788] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673795] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673803] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673811] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673819] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673826] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673833] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673841] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673848] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673856] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673864] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673872] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673879] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673886] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673894] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673901] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673908] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673916] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673924] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673932] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673939] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673946] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673953] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673961] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673969] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673976] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.673984] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.673992] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.674000] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.674007] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.674014] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.674022] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.674030] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.674037] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.674044] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.674052] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.674059] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.674067] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:35.108 [2024-04-27 02:36:08.674074] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:35.108 [2024-04-27 02:36:08.674083] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.674090] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.674098] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.674106] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.674113] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.674120] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.674127] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.674134] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.674142] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.674150] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.674158] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.674165] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.108 [2024-04-27 02:36:08.674173] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.108 [2024-04-27 02:36:08.674180] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.109 [2024-04-27 02:36:08.674187] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.109 [2024-04-27 02:36:08.674195] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.109 [2024-04-27 02:36:08.674203] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.109 [2024-04-27 02:36:08.674210] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.109 [2024-04-27 02:36:08.674218] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.109 [2024-04-27 02:36:08.674225] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.109 [2024-04-27 02:36:08.674232] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.109 [2024-04-27 02:36:08.674239] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.109 [2024-04-27 02:36:08.674248] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.109 [2024-04-27 02:36:08.674263] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.109 [2024-04-27 02:36:08.674271] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.109 [2024-04-27 02:36:08.674282] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.109 [2024-04-27 02:36:08.674290] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.109 [2024-04-27 02:36:08.674300] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.109 [2024-04-27 02:36:08.674312] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.109 [2024-04-27 02:36:08.674319] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.109 [2024-04-27 02:36:08.674327] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.109 [2024-04-27 02:36:08.674341] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.109 [2024-04-27 02:36:08.674349] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.109 [2024-04-27 02:36:08.674357] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.109 [2024-04-27 02:36:08.674364] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.109 [2024-04-27 02:36:08.674375] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.109 [2024-04-27 02:36:08.674383] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.109 [2024-04-27 02:36:08.674395] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.109 [2024-04-27 02:36:08.674403] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.109 [2024-04-27 02:36:08.674416] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.109 [2024-04-27 02:36:08.674423] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.109 [2024-04-27 02:36:08.674435] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.109 [2024-04-27 02:36:08.674442] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.109 [2024-04-27 02:36:08.674450] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.109 [2024-04-27 02:36:08.674462] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.109 [2024-04-27 02:36:08.674473] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.109 [2024-04-27 02:36:08.674480] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.109 [2024-04-27 02:36:08.674489] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.109 [2024-04-27 02:36:08.674497] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.109 [2024-04-27 02:36:08.674504] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.109 [2024-04-27 02:36:08.674511] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.109 [2024-04-27 02:36:08.674519] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.109 [2024-04-27 02:36:08.674526] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.109 [2024-04-27 02:36:08.674533] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.109 [2024-04-27 02:36:08.674540] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.109 [2024-04-27 02:36:08.674549] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.109 [2024-04-27 02:36:08.674556] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.109 [2024-04-27 02:36:08.674563] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.109 [2024-04-27 02:36:08.674571] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:35.109 [2024-04-27 02:36:08.674578] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:35.109 [2024-04-27 02:36:08.674585] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.109 [2024-04-27 02:36:08.674592] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.109 [2024-04-27 02:36:08.674599] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.109 [2024-04-27 02:36:08.674607] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.109 [2024-04-27 02:36:08.674614] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.109 [2024-04-27 02:36:08.674622] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.109 [2024-04-27 02:36:08.674629] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.109 [2024-04-27 02:36:08.674636] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.109 [2024-04-27 02:36:08.674643] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.109 [2024-04-27 02:36:08.674650] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.109 [2024-04-27 02:36:08.674659] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.109 [2024-04-27 02:36:08.674668] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.109 [2024-04-27 02:36:08.674675] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.109 [2024-04-27 02:36:08.674682] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.109 [2024-04-27 02:36:08.674690] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.109 [2024-04-27 02:36:08.674697] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.109 [2024-04-27 02:36:08.674704] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.109 [2024-04-27 02:36:08.674713] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.109 [2024-04-27 02:36:08.674721] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.109 [2024-04-27 02:36:08.674729] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.109 [2024-04-27 02:36:08.674736] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.109 [2024-04-27 02:36:08.674743] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.109 [2024-04-27 02:36:08.674750] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.109 [2024-04-27 02:36:08.674758] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.109 [2024-04-27 02:36:08.674765] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.109 [2024-04-27 02:36:08.674773] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.109 [2024-04-27 02:36:08.674782] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.109 [2024-04-27 02:36:08.674789] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.109 [2024-04-27 02:36:08.674796] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.109 [2024-04-27 02:36:08.674803] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.109 [2024-04-27 02:36:08.674810] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.109 [2024-04-27 02:36:08.674817] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.109 [2024-04-27 02:36:08.674824] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:35.109 [2024-04-27 02:36:08.674831] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:35.109 [2024-04-27 02:36:08.674839] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.109 [2024-04-27 02:36:08.674847] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.109 [2024-04-27 02:36:08.674854] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.109 [2024-04-27 02:36:08.674861] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:35.109 [2024-04-27 02:36:08.674868] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:35.109 [2024-04-27 02:36:08.674875] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:41.673 02:36:14 -- target/device_removal.sh@147 -- # seq 1 10 00:16:41.673 02:36:14 -- target/device_removal.sh@147 -- # for i in $(seq 1 10) 00:16:41.673 02:36:14 -- target/device_removal.sh@148 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_1 00:16:41.673 02:36:14 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_1 00:16:41.673 02:36:14 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:16:41.673 02:36:14 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:16:41.673 02:36:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:41.673 02:36:14 -- target/device_removal.sh@77 -- # grep mlx5_1 00:16:41.673 02:36:14 -- common/autotest_common.sh@10 -- # set +x 00:16:41.673 02:36:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:41.673 02:36:14 -- target/device_removal.sh@78 -- # return 1 00:16:41.673 02:36:14 -- target/device_removal.sh@149 -- # break 00:16:41.673 02:36:14 -- target/device_removal.sh@158 -- # get_rdma_dev_count_in_nvmf_tgt 00:16:41.673 02:36:14 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:16:41.673 02:36:14 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:16:41.673 02:36:14 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:16:41.673 02:36:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:41.673 02:36:14 -- common/autotest_common.sh@10 -- # set +x 00:16:41.673 02:36:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:41.673 02:36:14 -- target/device_removal.sh@158 -- # ib_count_after_remove=1 00:16:41.673 02:36:14 -- target/device_removal.sh@160 -- # rescan_pci 00:16:41.673 02:36:14 -- target/device_removal.sh@57 -- # echo 1 00:16:41.932 [2024-04-27 02:36:15.318833] rdma.c:3252:nvmf_rdma_rescan_devices: *WARNING*: Failed to init ibv device 0x10df8c0, err 11. Skip rescan. 00:16:41.932 02:36:15 -- target/device_removal.sh@162 -- # seq 1 10 00:16:41.933 02:36:15 -- target/device_removal.sh@162 -- # for i in $(seq 1 10) 00:16:41.933 02:36:15 -- target/device_removal.sh@163 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.1/net 00:16:41.933 02:36:15 -- target/device_removal.sh@163 -- # new_net_dev=mlx_0_1 00:16:41.933 02:36:15 -- target/device_removal.sh@164 -- # [[ -z mlx_0_1 ]] 00:16:41.933 02:36:15 -- target/device_removal.sh@166 -- # [[ mlx_0_1 != \m\l\x\_\0\_\1 ]] 00:16:41.933 02:36:15 -- target/device_removal.sh@171 -- # break 00:16:41.933 02:36:15 -- target/device_removal.sh@175 -- # [[ -z mlx_0_1 ]] 00:16:41.933 02:36:15 -- target/device_removal.sh@179 -- # ip link set mlx_0_1 up 00:16:42.191 [2024-04-27 02:36:15.687649] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xed6070/0xf18ac0) succeed. 00:16:42.191 [2024-04-27 02:36:15.687728] rdma.c:3305:nvmf_rdma_retry_listen_port: *ERROR*: Found new IB device but port 192.168.100.9:4420 is still failed(-1) to listen. 00:16:45.513 02:36:18 -- target/device_removal.sh@180 -- # get_ip_address mlx_0_1 00:16:45.513 02:36:18 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:16:45.513 02:36:18 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:16:45.513 02:36:18 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:45.513 02:36:18 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:45.513 02:36:18 -- target/device_removal.sh@180 -- # [[ -z '' ]] 00:16:45.513 02:36:18 -- target/device_removal.sh@181 -- # ip addr add 192.168.100.9/24 dev mlx_0_1 00:16:45.513 02:36:18 -- target/device_removal.sh@186 -- # seq 1 10 00:16:45.513 02:36:18 -- target/device_removal.sh@186 -- # for i in $(seq 1 10) 00:16:45.513 02:36:18 -- target/device_removal.sh@187 -- # get_rdma_dev_count_in_nvmf_tgt 00:16:45.513 02:36:18 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:16:45.513 02:36:18 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:16:45.513 02:36:18 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:16:45.513 02:36:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:45.513 02:36:18 -- common/autotest_common.sh@10 -- # set +x 00:16:45.513 [2024-04-27 02:36:18.781175] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:16:45.513 [2024-04-27 02:36:18.781210] rdma.c:3311:nvmf_rdma_retry_listen_port: *NOTICE*: Port 192.168.100.9:4420 come back 00:16:45.513 [2024-04-27 02:36:18.781229] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:16:45.513 [2024-04-27 02:36:18.781246] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:16:45.513 02:36:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:45.513 02:36:18 -- target/device_removal.sh@187 -- # ib_count=2 00:16:45.513 02:36:18 -- target/device_removal.sh@188 -- # (( ib_count > ib_count_after_remove )) 00:16:45.513 02:36:18 -- target/device_removal.sh@189 -- # break 00:16:45.513 02:36:18 -- target/device_removal.sh@200 -- # stop_bdevperf 00:16:45.513 02:36:18 -- target/device_removal.sh@116 -- # wait 1558298 00:17:53.222 0 00:17:53.222 02:37:23 -- target/device_removal.sh@118 -- # killprocess 1558110 00:17:53.222 02:37:23 -- common/autotest_common.sh@936 -- # '[' -z 1558110 ']' 00:17:53.222 02:37:23 -- common/autotest_common.sh@940 -- # kill -0 1558110 00:17:53.222 02:37:23 -- common/autotest_common.sh@941 -- # uname 00:17:53.222 02:37:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:53.222 02:37:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1558110 00:17:53.222 02:37:23 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:53.222 02:37:23 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:53.222 02:37:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1558110' 00:17:53.222 killing process with pid 1558110 00:17:53.222 02:37:23 -- common/autotest_common.sh@955 -- # kill 1558110 00:17:53.222 02:37:23 -- common/autotest_common.sh@960 -- # wait 1558110 00:17:53.222 02:37:23 -- target/device_removal.sh@119 -- # bdevperf_pid= 00:17:53.222 02:37:23 -- target/device_removal.sh@121 -- # cat /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/try.txt 00:17:53.222 [2024-04-27 02:35:52.227381] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:17:53.222 [2024-04-27 02:35:52.227448] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1558110 ] 00:17:53.222 EAL: No free 2048 kB hugepages reported on node 1 00:17:53.222 [2024-04-27 02:35:52.297301] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:53.222 [2024-04-27 02:35:52.381832] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:53.222 Running I/O for 90 seconds... 00:17:53.222 [2024-04-27 02:35:58.425255] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:17:53.222 [2024-04-27 02:35:58.425306] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:17:53.222 [2024-04-27 02:35:58.425320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32608 cdw0:16 sqhd:63b9 p:0 m:0 dnr:0 00:17:53.222 [2024-04-27 02:35:58.425332] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:17:53.222 [2024-04-27 02:35:58.425351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32608 cdw0:16 sqhd:63b9 p:0 m:0 dnr:0 00:17:53.222 [2024-04-27 02:35:58.425363] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:17:53.222 [2024-04-27 02:35:58.425372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32608 cdw0:16 sqhd:63b9 p:0 m:0 dnr:0 00:17:53.222 [2024-04-27 02:35:58.425385] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:17:53.222 [2024-04-27 02:35:58.425396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32608 cdw0:16 sqhd:63b9 p:0 m:0 dnr:0 00:17:53.222 [2024-04-27 02:35:58.427059] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:53.222 [2024-04-27 02:35:58.427079] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:17:53.222 [2024-04-27 02:35:58.427112] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:17:53.222 [2024-04-27 02:35:58.435239] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.445261] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.455469] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.465494] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.475522] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.485547] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.495691] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.505718] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.515744] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.526005] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.536503] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.546855] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.557277] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.567713] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.578064] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.588456] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.599114] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.609383] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.619741] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.630266] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.640538] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.650872] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.660897] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.670999] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.681387] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.691404] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.701739] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.712138] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.722166] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.732569] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.742596] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.752622] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.763218] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.773617] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.783862] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.794244] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.804709] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.815061] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.825433] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.835827] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.846250] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.856276] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.866360] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.876751] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.887051] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.897440] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.907887] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.918277] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.928552] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.938842] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.949216] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.959605] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.969860] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.980343] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:58.990560] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:59.000791] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:59.011040] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:59.021368] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:59.031628] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:59.041917] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:59.052235] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:59.062490] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:59.072759] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:59.083033] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:59.093364] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:59.103610] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:59.113879] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:59.124208] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:59.134500] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:59.144526] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:59.154552] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:59.164795] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:59.175052] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:59.185245] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:59.195515] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:59.205821] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:59.215847] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:59.225872] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:59.235897] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:59.246207] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:59.256311] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:59.266343] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:59.276365] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:59.286468] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:59.296757] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:59.306955] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:59.316979] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:59.327420] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:59.337623] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.222 [2024-04-27 02:35:59.347914] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.223 [2024-04-27 02:35:59.358239] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.223 [2024-04-27 02:35:59.368620] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.223 [2024-04-27 02:35:59.378918] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.223 [2024-04-27 02:35:59.389282] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.223 [2024-04-27 02:35:59.399569] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.223 [2024-04-27 02:35:59.409905] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.223 [2024-04-27 02:35:59.420241] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.223 [2024-04-27 02:35:59.429647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:205336 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007786000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.429670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.429690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:205344 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007788000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.429705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.429717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:205352 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000778a000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.429727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.429739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:205360 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000778c000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.429748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.429760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:205368 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000778e000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.429769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.429781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:205376 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007790000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.429791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.429803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:205384 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007792000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.429813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.429824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:205392 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007794000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.429834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.429845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:205400 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007796000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.429857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.429868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:205408 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007798000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.429878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.429889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:205416 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000779a000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.429899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.429912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:205424 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000779c000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.429922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.429934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:205432 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000779e000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.429943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.429957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:205440 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077a0000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.429966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.429978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:205448 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077a2000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.429988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.430001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:205456 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077a4000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.430012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.430024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:205464 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077a6000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.430034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.430045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:205472 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077a8000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.430057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.430069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:205480 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077aa000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.430079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.430093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:205488 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ac000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.430102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.430115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:205496 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ae000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.430125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.430137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:205504 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077b0000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.430147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.430159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:205512 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077b2000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.430168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.430179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:205520 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077b4000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.430189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.430202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:205528 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077b6000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.430212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.430223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:205536 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077b8000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.430233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.430245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:205544 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ba000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.430254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.430265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:205552 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077bc000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.430274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.430285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:205560 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077be000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.430294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.430305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:205568 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077c0000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.430314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.430326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:205576 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077c2000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.430335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.430351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:205584 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077c4000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.430360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.430371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:205592 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077c6000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.430380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.430393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:205600 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077c8000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.430404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.430415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:205608 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ca000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.430425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.430437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:205616 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077cc000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.430446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.430457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:205624 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ce000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.430466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.430478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:205632 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d0000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.430487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.430498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:205640 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d2000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.430507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.430518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:205648 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d4000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.430527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.430538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:205656 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d6000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.430548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.430560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:205664 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d8000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.430569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.430582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:205672 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077da000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.430591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.430601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:205680 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077dc000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.430611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.430623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:205688 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077de000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.430632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.430643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:205696 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077e0000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.430652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.430663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:205704 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077e2000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.430673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.430685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:205712 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077e4000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.430694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.430705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:205720 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077e6000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.430714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.430725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:205728 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077e8000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.430734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.430745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:205736 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ea000 len:0x1000 key:0x181800 00:17:53.223 [2024-04-27 02:35:59.430755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.223 [2024-04-27 02:35:59.430766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:205744 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ec000 len:0x1000 key:0x181800 00:17:53.224 [2024-04-27 02:35:59.430775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.430786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:205752 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ee000 len:0x1000 key:0x181800 00:17:53.224 [2024-04-27 02:35:59.430795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.430806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:205760 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077f0000 len:0x1000 key:0x181800 00:17:53.224 [2024-04-27 02:35:59.430815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.430827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:205768 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077f2000 len:0x1000 key:0x181800 00:17:53.224 [2024-04-27 02:35:59.430836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.430847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:205776 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077f4000 len:0x1000 key:0x181800 00:17:53.224 [2024-04-27 02:35:59.430856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.430867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:205784 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077f6000 len:0x1000 key:0x181800 00:17:53.224 [2024-04-27 02:35:59.430876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.430887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:205792 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077f8000 len:0x1000 key:0x181800 00:17:53.224 [2024-04-27 02:35:59.430898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.430910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:205800 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077fa000 len:0x1000 key:0x181800 00:17:53.224 [2024-04-27 02:35:59.430919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.430929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:205808 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077fc000 len:0x1000 key:0x181800 00:17:53.224 [2024-04-27 02:35:59.430938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.430950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:205816 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077fe000 len:0x1000 key:0x181800 00:17:53.224 [2024-04-27 02:35:59.430959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.430971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:205824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.430980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.430991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:205832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:205840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:205848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:205856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:205864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:205872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:205880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:205888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:205896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:205904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:205912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:205920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:205928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:205936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:205944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:205952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:205960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:205968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:205976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:205984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:205992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:206000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:206008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:206016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:206024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:206032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:206040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:206048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:206056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:206064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:206072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:206080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:206088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:206096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:206104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:206112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:206120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:206128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:206136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:206144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:206152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:206160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:206168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:206176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:206184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:206192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.224 [2024-04-27 02:35:59.431946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.224 [2024-04-27 02:35:59.431957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:206200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.225 [2024-04-27 02:35:59.431966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.225 [2024-04-27 02:35:59.431977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:206208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.225 [2024-04-27 02:35:59.431986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.225 [2024-04-27 02:35:59.431997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:206216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.225 [2024-04-27 02:35:59.432006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.225 [2024-04-27 02:35:59.432017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:206224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.225 [2024-04-27 02:35:59.432027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.225 [2024-04-27 02:35:59.432038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:206232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.225 [2024-04-27 02:35:59.432047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.225 [2024-04-27 02:35:59.432058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:206240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.225 [2024-04-27 02:35:59.432067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.225 [2024-04-27 02:35:59.432079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:206248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.225 [2024-04-27 02:35:59.432089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.225 [2024-04-27 02:35:59.432100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:206256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.225 [2024-04-27 02:35:59.432109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.225 [2024-04-27 02:35:59.432120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:206264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.225 [2024-04-27 02:35:59.432129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.225 [2024-04-27 02:35:59.432140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:206272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.225 [2024-04-27 02:35:59.432150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.225 [2024-04-27 02:35:59.432163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:206280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.225 [2024-04-27 02:35:59.432172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.225 [2024-04-27 02:35:59.432182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:206288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.225 [2024-04-27 02:35:59.432191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.225 [2024-04-27 02:35:59.432202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:206296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.225 [2024-04-27 02:35:59.432212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.225 [2024-04-27 02:35:59.432223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:206304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.225 [2024-04-27 02:35:59.432232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.225 [2024-04-27 02:35:59.432245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:206312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.225 [2024-04-27 02:35:59.432254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.225 [2024-04-27 02:35:59.432265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:206320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.225 [2024-04-27 02:35:59.432275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.225 [2024-04-27 02:35:59.432286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:206328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.225 [2024-04-27 02:35:59.432296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.225 [2024-04-27 02:35:59.432307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:206336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.225 [2024-04-27 02:35:59.432316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.225 [2024-04-27 02:35:59.432327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:206344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.225 [2024-04-27 02:35:59.432340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.225 [2024-04-27 02:35:59.445392] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:17:53.225 [2024-04-27 02:35:59.445408] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:17:53.225 [2024-04-27 02:35:59.445417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:206352 len:8 PRP1 0x0 PRP2 0x0 00:17:53.225 [2024-04-27 02:35:59.445427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:53.225 [2024-04-27 02:35:59.447020] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:17:53.225 [2024-04-27 02:35:59.447320] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:17:53.225 [2024-04-27 02:35:59.447343] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:17:53.225 [2024-04-27 02:35:59.447353] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:17:53.225 [2024-04-27 02:35:59.447376] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:53.225 [2024-04-27 02:35:59.447387] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:17:53.225 [2024-04-27 02:35:59.447399] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:17:53.225 [2024-04-27 02:35:59.447409] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:17:53.225 [2024-04-27 02:35:59.447420] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:17:53.225 [2024-04-27 02:35:59.447441] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:53.225 [2024-04-27 02:35:59.447451] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:17:53.225 [2024-04-27 02:36:00.450134] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:17:53.225 [2024-04-27 02:36:00.450183] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:17:53.225 [2024-04-27 02:36:00.450192] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:17:53.225 [2024-04-27 02:36:00.450215] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:53.225 [2024-04-27 02:36:00.450226] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:17:53.225 [2024-04-27 02:36:00.450239] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:17:53.225 [2024-04-27 02:36:00.450249] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:17:53.225 [2024-04-27 02:36:00.450261] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:17:53.225 [2024-04-27 02:36:00.450287] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:53.225 [2024-04-27 02:36:00.450298] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:17:53.225 [2024-04-27 02:36:01.452812] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:17:53.225 [2024-04-27 02:36:01.452861] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:17:53.225 [2024-04-27 02:36:01.452871] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:17:53.225 [2024-04-27 02:36:01.452893] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:53.225 [2024-04-27 02:36:01.452904] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:17:53.225 [2024-04-27 02:36:01.453204] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:17:53.225 [2024-04-27 02:36:01.453218] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:17:53.225 [2024-04-27 02:36:01.453229] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:17:53.225 [2024-04-27 02:36:01.453277] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:53.225 [2024-04-27 02:36:01.453289] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:17:53.225 [2024-04-27 02:36:03.459230] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:17:53.225 [2024-04-27 02:36:03.459272] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:17:53.225 [2024-04-27 02:36:03.459306] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:53.225 [2024-04-27 02:36:03.459317] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:17:53.225 [2024-04-27 02:36:03.461192] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:17:53.225 [2024-04-27 02:36:03.461214] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:17:53.225 [2024-04-27 02:36:03.461226] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:17:53.225 [2024-04-27 02:36:03.461249] bdev_nvme.c:2872:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Reset is already in progress. Defer failover until reset completes. 00:17:53.225 [2024-04-27 02:36:03.461296] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:53.225 [2024-04-27 02:36:03.461334] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:17:53.225 [2024-04-27 02:36:04.464136] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:17:53.225 [2024-04-27 02:36:04.464174] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:17:53.225 [2024-04-27 02:36:04.464200] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:53.225 [2024-04-27 02:36:04.464212] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:17:53.225 [2024-04-27 02:36:04.464227] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:17:53.225 [2024-04-27 02:36:04.464237] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:17:53.225 [2024-04-27 02:36:04.464248] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:17:53.225 [2024-04-27 02:36:04.464279] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:53.225 [2024-04-27 02:36:04.464289] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:17:53.225 [2024-04-27 02:36:06.469209] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:17:53.225 [2024-04-27 02:36:06.469247] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:17:53.225 [2024-04-27 02:36:06.469274] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:53.225 [2024-04-27 02:36:06.469286] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:17:53.225 [2024-04-27 02:36:06.469299] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:17:53.225 [2024-04-27 02:36:06.469308] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:17:53.225 [2024-04-27 02:36:06.469319] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:17:53.226 [2024-04-27 02:36:06.469349] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:53.226 [2024-04-27 02:36:06.469360] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:17:53.226 [2024-04-27 02:36:08.474283] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:17:53.226 [2024-04-27 02:36:08.474316] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:17:53.226 [2024-04-27 02:36:08.474352] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:53.226 [2024-04-27 02:36:08.474365] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:17:53.226 [2024-04-27 02:36:08.474385] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:17:53.226 [2024-04-27 02:36:08.474395] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:17:53.226 [2024-04-27 02:36:08.474407] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:17:53.226 [2024-04-27 02:36:08.474436] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:53.226 [2024-04-27 02:36:08.474447] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:17:53.226 [2024-04-27 02:36:08.663748] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:17:53.226 [2024-04-27 02:36:08.663783] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:17:53.226 [2024-04-27 02:36:08.663795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32608 cdw0:16 sqhd:63b9 p:0 m:0 dnr:0 00:17:53.226 [2024-04-27 02:36:08.663808] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:17:53.226 [2024-04-27 02:36:08.663817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32608 cdw0:16 sqhd:63b9 p:0 m:0 dnr:0 00:17:53.226 [2024-04-27 02:36:08.663828] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:17:53.226 [2024-04-27 02:36:08.663838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32608 cdw0:16 sqhd:63b9 p:0 m:0 dnr:0 00:17:53.226 [2024-04-27 02:36:08.663847] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:17:53.226 [2024-04-27 02:36:08.663856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32608 cdw0:16 sqhd:63b9 p:0 m:0 dnr:0 00:17:53.226 [2024-04-27 02:36:08.676904] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:53.226 [2024-04-27 02:36:08.676925] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:17:53.226 [2024-04-27 02:36:08.676957] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:17:53.226 [2024-04-27 02:36:08.676994] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:08.686999] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:08.697026] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:08.707053] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:08.717081] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:08.727106] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:08.737131] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:08.747156] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:08.757182] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:08.767207] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:08.777232] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:08.787260] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:08.797286] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:08.807311] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:08.817342] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:08.827368] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:08.837393] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:08.847420] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:08.857446] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:08.867472] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:08.877498] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:08.887525] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:08.897550] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:08.907578] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:08.917603] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:08.927630] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:08.937658] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:08.947684] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:08.957710] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:08.967734] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:08.977760] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:08.987786] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:08.997813] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.007838] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.017865] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.027892] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.037917] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.047943] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.057968] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.067993] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.078020] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.088047] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.098072] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.108099] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.118125] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.128152] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.138177] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.148202] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.158228] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.168253] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.178278] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.188303] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.198328] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.208355] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.218382] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.228407] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.238432] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.248456] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.258482] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.268508] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.278535] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.288561] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.298588] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.308614] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.318641] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.328666] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.338692] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.348718] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.358743] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.368770] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.378797] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.388823] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.398849] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.408874] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.418899] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.428924] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.438949] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.448973] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.459000] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.469025] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.481223] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.501264] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.511267] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.516063] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:53.226 [2024-04-27 02:36:09.521288] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.531310] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.541339] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.551361] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.561388] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.571415] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.581440] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.591465] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.601490] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.611517] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.621541] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.631568] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.641594] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.651622] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.661647] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.671674] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:53.226 [2024-04-27 02:36:09.679406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:18632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.226 [2024-04-27 02:36:09.679420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.226 [2024-04-27 02:36:09.679435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:18640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.226 [2024-04-27 02:36:09.679445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.226 [2024-04-27 02:36:09.679456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:18648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.226 [2024-04-27 02:36:09.679466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.226 [2024-04-27 02:36:09.679477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:18656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.226 [2024-04-27 02:36:09.679487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.226 [2024-04-27 02:36:09.679498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:18664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.226 [2024-04-27 02:36:09.679508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.226 [2024-04-27 02:36:09.679519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:18672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.679528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.679540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:18680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.679549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.679560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:18688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.679569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.679580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:18696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.679589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.679600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.679609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.679620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:18712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.679631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.679641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:18720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.679651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.679662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:18728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.679673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.679684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:18736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.679694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.679705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:18744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.679714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.679725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:18752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.679734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.679745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:18760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.679755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.679766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:18768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.679776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.679787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:18776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.679798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.679808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:18784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.679818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.679829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:18792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.679838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.679849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:18800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.679858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.679869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:18808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.679878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.679889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:18816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.679899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.679910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:18824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.679921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.679932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:18832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.679942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.679953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:18840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.679963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.679973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:18848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.679982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.679993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:18856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.680002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.680014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:18864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.680023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.680034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:18872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.680043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.680054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:18880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.680064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.680074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:18888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.680083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.680094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:18896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.680103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.680114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:18904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.680124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.680135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:18912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.680144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.680155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:18920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.680165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.680178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:18928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.680187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.680198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:18936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.680207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.680218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:18944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.680227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.680238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:18952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.680248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.680259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:18960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.680268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.680279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.680288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.680299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:18976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.680308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.680319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.680328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.680343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:18992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.680352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.680363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:19000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.680372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.680383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:19008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.680392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.680403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:19016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.680413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.680427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:19024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.680437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.680448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:19032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.680458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.680469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:19040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.680478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.680489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:19048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.680499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.680510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:19056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.680520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.680531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:19064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.680540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.680551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:19072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.680562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.680573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:19080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.680582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.680593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:19088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.680603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.680614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:19096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.680623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.680635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:19104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.680645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.680656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:19112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.680665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.680675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:19120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.680686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.680698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:19128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.680707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.680718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:19136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.227 [2024-04-27 02:36:09.680727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.227 [2024-04-27 02:36:09.680738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:19144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.228 [2024-04-27 02:36:09.680747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.228 [2024-04-27 02:36:09.680758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:19152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.228 [2024-04-27 02:36:09.680768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.228 [2024-04-27 02:36:09.680779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:19160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.228 [2024-04-27 02:36:09.680788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.228 [2024-04-27 02:36:09.680799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:19168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.228 [2024-04-27 02:36:09.680809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.228 [2024-04-27 02:36:09.680821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:19176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.228 [2024-04-27 02:36:09.680830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.228 [2024-04-27 02:36:09.680841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:19184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.228 [2024-04-27 02:36:09.680850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.228 [2024-04-27 02:36:09.680861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:19192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.228 [2024-04-27 02:36:09.680870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.228 [2024-04-27 02:36:09.680882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:19200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.228 [2024-04-27 02:36:09.680891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.228 [2024-04-27 02:36:09.680901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:19208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.228 [2024-04-27 02:36:09.680910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.228 [2024-04-27 02:36:09.680921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:19216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.228 [2024-04-27 02:36:09.680933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.229 [2024-04-27 02:36:09.680944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:19224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.229 [2024-04-27 02:36:09.680953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.229 [2024-04-27 02:36:09.680964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:19232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.229 [2024-04-27 02:36:09.680973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.229 [2024-04-27 02:36:09.680984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:19240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.229 [2024-04-27 02:36:09.680993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.229 [2024-04-27 02:36:09.681004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:19248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.229 [2024-04-27 02:36:09.681014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.229 [2024-04-27 02:36:09.681024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:19256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.229 [2024-04-27 02:36:09.681034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.229 [2024-04-27 02:36:09.681045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:19264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.229 [2024-04-27 02:36:09.681055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.229 [2024-04-27 02:36:09.681066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:19272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.229 [2024-04-27 02:36:09.681075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.229 [2024-04-27 02:36:09.681086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:19280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.229 [2024-04-27 02:36:09.681095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.229 [2024-04-27 02:36:09.681105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:19288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.229 [2024-04-27 02:36:09.681116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.229 [2024-04-27 02:36:09.681127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:19296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.229 [2024-04-27 02:36:09.681136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.229 [2024-04-27 02:36:09.681147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:19304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.229 [2024-04-27 02:36:09.681157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.229 [2024-04-27 02:36:09.681168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:19312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.229 [2024-04-27 02:36:09.681179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.229 [2024-04-27 02:36:09.681190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:19320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.229 [2024-04-27 02:36:09.681200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.229 [2024-04-27 02:36:09.681211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:19328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.229 [2024-04-27 02:36:09.681221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.229 [2024-04-27 02:36:09.681232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:19336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.229 [2024-04-27 02:36:09.681241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.229 [2024-04-27 02:36:09.681252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:19344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.229 [2024-04-27 02:36:09.681261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.229 [2024-04-27 02:36:09.681271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:19352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.229 [2024-04-27 02:36:09.681281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.230 [2024-04-27 02:36:09.681292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:19360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.230 [2024-04-27 02:36:09.681301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.230 [2024-04-27 02:36:09.681312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:19368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.230 [2024-04-27 02:36:09.681321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.230 [2024-04-27 02:36:09.681331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:19376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.230 [2024-04-27 02:36:09.681344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.230 [2024-04-27 02:36:09.681356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:19384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.230 [2024-04-27 02:36:09.681365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.230 [2024-04-27 02:36:09.681376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:19392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.230 [2024-04-27 02:36:09.681385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.230 [2024-04-27 02:36:09.681395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:19400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.230 [2024-04-27 02:36:09.681406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.230 [2024-04-27 02:36:09.681417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:19408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.230 [2024-04-27 02:36:09.681426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.230 [2024-04-27 02:36:09.681438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:19416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.230 [2024-04-27 02:36:09.681449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.230 [2024-04-27 02:36:09.681460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:19424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.230 [2024-04-27 02:36:09.681469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.230 [2024-04-27 02:36:09.681480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:19432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.230 [2024-04-27 02:36:09.681489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.230 [2024-04-27 02:36:09.681500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:19440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.230 [2024-04-27 02:36:09.681510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.230 [2024-04-27 02:36:09.681521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:19448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:53.230 [2024-04-27 02:36:09.681530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.230 [2024-04-27 02:36:09.681541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:18432 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007900000 len:0x1000 key:0x1bec00 00:17:53.230 [2024-04-27 02:36:09.681551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.230 [2024-04-27 02:36:09.681562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:18440 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007902000 len:0x1000 key:0x1bec00 00:17:53.230 [2024-04-27 02:36:09.681572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.230 [2024-04-27 02:36:09.681583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:18448 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007904000 len:0x1000 key:0x1bec00 00:17:53.230 [2024-04-27 02:36:09.681593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.230 [2024-04-27 02:36:09.681604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:18456 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007906000 len:0x1000 key:0x1bec00 00:17:53.230 [2024-04-27 02:36:09.681613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.230 [2024-04-27 02:36:09.681624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:18464 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007908000 len:0x1000 key:0x1bec00 00:17:53.230 [2024-04-27 02:36:09.681634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.230 [2024-04-27 02:36:09.681646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18472 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000790a000 len:0x1000 key:0x1bec00 00:17:53.230 [2024-04-27 02:36:09.681655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.230 [2024-04-27 02:36:09.681666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:18480 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000790c000 len:0x1000 key:0x1bec00 00:17:53.230 [2024-04-27 02:36:09.681676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.230 [2024-04-27 02:36:09.681687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:18488 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000790e000 len:0x1000 key:0x1bec00 00:17:53.230 [2024-04-27 02:36:09.681697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.230 [2024-04-27 02:36:09.681708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:18496 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007910000 len:0x1000 key:0x1bec00 00:17:53.230 [2024-04-27 02:36:09.681717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.230 [2024-04-27 02:36:09.681728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:18504 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007912000 len:0x1000 key:0x1bec00 00:17:53.230 [2024-04-27 02:36:09.681737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.230 [2024-04-27 02:36:09.681748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:18512 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007914000 len:0x1000 key:0x1bec00 00:17:53.230 [2024-04-27 02:36:09.681758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.230 [2024-04-27 02:36:09.681769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:18520 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007916000 len:0x1000 key:0x1bec00 00:17:53.230 [2024-04-27 02:36:09.681779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.230 [2024-04-27 02:36:09.681790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:18528 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007918000 len:0x1000 key:0x1bec00 00:17:53.230 [2024-04-27 02:36:09.681799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.230 [2024-04-27 02:36:09.681810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:18536 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000791a000 len:0x1000 key:0x1bec00 00:17:53.230 [2024-04-27 02:36:09.681820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.230 [2024-04-27 02:36:09.681831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:18544 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000791c000 len:0x1000 key:0x1bec00 00:17:53.230 [2024-04-27 02:36:09.681840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.230 [2024-04-27 02:36:09.681851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:18552 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000791e000 len:0x1000 key:0x1bec00 00:17:53.230 [2024-04-27 02:36:09.681860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.230 [2024-04-27 02:36:09.681872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18560 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007920000 len:0x1000 key:0x1bec00 00:17:53.230 [2024-04-27 02:36:09.681881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.230 [2024-04-27 02:36:09.681892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18568 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007922000 len:0x1000 key:0x1bec00 00:17:53.230 [2024-04-27 02:36:09.681901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.230 [2024-04-27 02:36:09.681913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:18576 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007924000 len:0x1000 key:0x1bec00 00:17:53.230 [2024-04-27 02:36:09.681923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.230 [2024-04-27 02:36:09.681935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:18584 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007926000 len:0x1000 key:0x1bec00 00:17:53.230 [2024-04-27 02:36:09.681945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.230 [2024-04-27 02:36:09.681956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:18592 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007928000 len:0x1000 key:0x1bec00 00:17:53.230 [2024-04-27 02:36:09.681965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.230 [2024-04-27 02:36:09.681976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:18600 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000792a000 len:0x1000 key:0x1bec00 00:17:53.230 [2024-04-27 02:36:09.681985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.230 [2024-04-27 02:36:09.681997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:18608 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000792c000 len:0x1000 key:0x1bec00 00:17:53.230 [2024-04-27 02:36:09.682006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.230 [2024-04-27 02:36:09.682018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:18616 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000792e000 len:0x1000 key:0x1bec00 00:17:53.230 [2024-04-27 02:36:09.682028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32608 cdw0:186b7470 sqhd:3530 p:0 m:0 dnr:0 00:17:53.230 [2024-04-27 02:36:09.695012] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:17:53.230 [2024-04-27 02:36:09.695026] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:17:53.230 [2024-04-27 02:36:09.695036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18624 len:8 PRP1 0x0 PRP2 0x0 00:17:53.230 [2024-04-27 02:36:09.695047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:53.230 [2024-04-27 02:36:09.695093] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:17:53.230 [2024-04-27 02:36:09.695312] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:17:53.230 [2024-04-27 02:36:09.695325] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:17:53.230 [2024-04-27 02:36:09.695333] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:17:53.230 [2024-04-27 02:36:09.695358] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:53.230 [2024-04-27 02:36:09.695368] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:17:53.230 [2024-04-27 02:36:09.695380] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:17:53.230 [2024-04-27 02:36:09.695390] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:17:53.230 [2024-04-27 02:36:09.695400] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:17:53.230 [2024-04-27 02:36:09.695421] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:53.230 [2024-04-27 02:36:09.695430] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:17:53.230 [2024-04-27 02:36:10.698582] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:17:53.230 [2024-04-27 02:36:10.698620] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:17:53.230 [2024-04-27 02:36:10.698629] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:17:53.230 [2024-04-27 02:36:10.698650] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:53.230 [2024-04-27 02:36:10.698661] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:17:53.230 [2024-04-27 02:36:10.698709] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:17:53.230 [2024-04-27 02:36:10.698721] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:17:53.230 [2024-04-27 02:36:10.698731] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:17:53.230 [2024-04-27 02:36:10.698755] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:53.230 [2024-04-27 02:36:10.698766] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:17:53.230 [2024-04-27 02:36:11.702665] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:17:53.230 [2024-04-27 02:36:11.702711] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:17:53.230 [2024-04-27 02:36:11.702721] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:17:53.230 [2024-04-27 02:36:11.702743] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:53.230 [2024-04-27 02:36:11.702754] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:17:53.230 [2024-04-27 02:36:11.702775] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:17:53.230 [2024-04-27 02:36:11.702785] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:17:53.230 [2024-04-27 02:36:11.702795] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:17:53.230 [2024-04-27 02:36:11.702821] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:53.230 [2024-04-27 02:36:11.702833] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:17:53.230 [2024-04-27 02:36:13.707925] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:17:53.230 [2024-04-27 02:36:13.707970] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:17:53.230 [2024-04-27 02:36:13.707998] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:53.230 [2024-04-27 02:36:13.708010] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:17:53.230 [2024-04-27 02:36:13.708025] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:17:53.230 [2024-04-27 02:36:13.708035] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:17:53.230 [2024-04-27 02:36:13.708046] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:17:53.230 [2024-04-27 02:36:13.708083] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:53.230 [2024-04-27 02:36:13.708094] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:17:53.230 [2024-04-27 02:36:15.713087] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:17:53.230 [2024-04-27 02:36:15.713118] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:17:53.230 [2024-04-27 02:36:15.713145] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:53.231 [2024-04-27 02:36:15.713157] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:17:53.231 [2024-04-27 02:36:15.715649] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:17:53.231 [2024-04-27 02:36:15.715679] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:17:53.231 [2024-04-27 02:36:15.715691] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:17:53.231 [2024-04-27 02:36:15.715735] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:53.231 [2024-04-27 02:36:15.715746] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:17:53.231 [2024-04-27 02:36:17.720679] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:17:53.231 [2024-04-27 02:36:17.720722] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:17:53.231 [2024-04-27 02:36:17.720749] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:53.231 [2024-04-27 02:36:17.720760] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:17:53.231 [2024-04-27 02:36:17.721112] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:17:53.231 [2024-04-27 02:36:17.721123] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:17:53.231 [2024-04-27 02:36:17.721134] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:17:53.231 [2024-04-27 02:36:17.721160] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:53.231 [2024-04-27 02:36:17.721169] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:17:53.231 [2024-04-27 02:36:19.727330] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:17:53.231 [2024-04-27 02:36:19.727384] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:17:53.231 [2024-04-27 02:36:19.727435] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:53.231 [2024-04-27 02:36:19.727446] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:17:53.231 [2024-04-27 02:36:19.727463] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:17:53.231 [2024-04-27 02:36:19.727473] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:17:53.231 [2024-04-27 02:36:19.727483] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:17:53.231 [2024-04-27 02:36:19.727520] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:53.231 [2024-04-27 02:36:19.727530] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:17:53.231 [2024-04-27 02:36:20.780614] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:53.231 00:17:53.231 Latency(us) 00:17:53.231 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:53.231 Job: Nvme_mlx_0_0n1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:53.231 Verification LBA range: start 0x0 length 0x8000 00:17:53.231 Nvme_mlx_0_0n1 : 90.01 10957.17 42.80 0.00 0.00 11664.34 1980.33 12079595.52 00:17:53.231 Job: Nvme_mlx_0_1n1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:53.231 Verification LBA range: start 0x0 length 0x8000 00:17:53.231 Nvme_mlx_0_1n1 : 90.01 9256.46 36.16 0.00 0.00 13807.43 2464.72 13071639.60 00:17:53.231 =================================================================================================================== 00:17:53.231 Total : 20213.63 78.96 0.00 0.00 12645.72 1980.33 13071639.60 00:17:53.231 Received shutdown signal, test time was about 90.000000 seconds 00:17:53.231 00:17:53.231 Latency(us) 00:17:53.231 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:53.231 =================================================================================================================== 00:17:53.231 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:53.231 02:37:23 -- target/device_removal.sh@123 -- # trap - SIGINT SIGTERM EXIT 00:17:53.231 02:37:23 -- target/device_removal.sh@124 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/try.txt 00:17:53.231 02:37:23 -- target/device_removal.sh@202 -- # killprocess 1557906 00:17:53.231 02:37:23 -- common/autotest_common.sh@936 -- # '[' -z 1557906 ']' 00:17:53.231 02:37:23 -- common/autotest_common.sh@940 -- # kill -0 1557906 00:17:53.231 02:37:23 -- common/autotest_common.sh@941 -- # uname 00:17:53.231 02:37:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:53.231 02:37:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1557906 00:17:53.231 02:37:23 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:53.231 02:37:23 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:53.231 02:37:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1557906' 00:17:53.231 killing process with pid 1557906 00:17:53.231 02:37:23 -- common/autotest_common.sh@955 -- # kill 1557906 00:17:53.231 02:37:23 -- common/autotest_common.sh@960 -- # wait 1557906 00:17:53.231 [2024-04-27 02:37:24.003278] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:17:53.231 02:37:24 -- target/device_removal.sh@203 -- # nvmfpid= 00:17:53.231 02:37:24 -- target/device_removal.sh@205 -- # return 0 00:17:53.231 00:17:53.231 real 1m33.307s 00:17:53.231 user 4m25.446s 00:17:53.231 sys 0m4.580s 00:17:53.231 02:37:24 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:17:53.231 02:37:24 -- common/autotest_common.sh@10 -- # set +x 00:17:53.231 ************************************ 00:17:53.231 END TEST nvmf_device_removal_pci_remove_no_srq 00:17:53.231 ************************************ 00:17:53.231 02:37:24 -- target/device_removal.sh@312 -- # run_test nvmf_device_removal_pci_remove test_remove_and_rescan 00:17:53.231 02:37:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:17:53.231 02:37:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:53.231 02:37:24 -- common/autotest_common.sh@10 -- # set +x 00:17:53.231 ************************************ 00:17:53.231 START TEST nvmf_device_removal_pci_remove 00:17:53.231 ************************************ 00:17:53.231 02:37:24 -- common/autotest_common.sh@1111 -- # test_remove_and_rescan 00:17:53.231 02:37:24 -- target/device_removal.sh@128 -- # nvmfappstart -m 0x3 00:17:53.231 02:37:24 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:17:53.231 02:37:24 -- common/autotest_common.sh@710 -- # xtrace_disable 00:17:53.231 02:37:24 -- common/autotest_common.sh@10 -- # set +x 00:17:53.231 02:37:24 -- nvmf/common.sh@470 -- # nvmfpid=1570998 00:17:53.231 02:37:24 -- nvmf/common.sh@471 -- # waitforlisten 1570998 00:17:53.231 02:37:24 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:17:53.231 02:37:24 -- common/autotest_common.sh@817 -- # '[' -z 1570998 ']' 00:17:53.231 02:37:24 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:53.231 02:37:24 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:53.231 02:37:24 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:53.231 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:53.231 02:37:24 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:53.231 02:37:24 -- common/autotest_common.sh@10 -- # set +x 00:17:53.231 [2024-04-27 02:37:24.545181] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:17:53.231 [2024-04-27 02:37:24.545234] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:53.231 EAL: No free 2048 kB hugepages reported on node 1 00:17:53.231 [2024-04-27 02:37:24.617348] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:17:53.231 [2024-04-27 02:37:24.704622] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:53.231 [2024-04-27 02:37:24.704663] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:53.231 [2024-04-27 02:37:24.704672] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:53.231 [2024-04-27 02:37:24.704681] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:53.231 [2024-04-27 02:37:24.704691] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:53.231 [2024-04-27 02:37:24.704780] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:53.231 [2024-04-27 02:37:24.704782] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:53.231 02:37:25 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:53.231 02:37:25 -- common/autotest_common.sh@850 -- # return 0 00:17:53.231 02:37:25 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:17:53.231 02:37:25 -- common/autotest_common.sh@716 -- # xtrace_disable 00:17:53.231 02:37:25 -- common/autotest_common.sh@10 -- # set +x 00:17:53.231 02:37:25 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:53.231 02:37:25 -- target/device_removal.sh@130 -- # create_subsystem_and_connect 00:17:53.231 02:37:25 -- target/device_removal.sh@45 -- # local -gA netdev_nvme_dict 00:17:53.231 02:37:25 -- target/device_removal.sh@46 -- # netdev_nvme_dict=() 00:17:53.231 02:37:25 -- target/device_removal.sh@48 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:17:53.231 02:37:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:53.231 02:37:25 -- common/autotest_common.sh@10 -- # set +x 00:17:53.231 [2024-04-27 02:37:25.433187] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x2501f40/0x2506430) succeed. 00:17:53.231 [2024-04-27 02:37:25.442087] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x2503440/0x2547ac0) succeed. 00:17:53.231 02:37:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:53.231 02:37:25 -- target/device_removal.sh@49 -- # get_rdma_if_list 00:17:53.231 02:37:25 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:17:53.231 02:37:25 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:17:53.231 02:37:25 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:17:53.231 02:37:25 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:17:53.231 02:37:25 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:17:53.231 02:37:25 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:53.231 02:37:25 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:53.231 02:37:25 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:17:53.231 02:37:25 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:17:53.231 02:37:25 -- nvmf/common.sh@105 -- # continue 2 00:17:53.231 02:37:25 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:53.231 02:37:25 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:53.231 02:37:25 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:17:53.231 02:37:25 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:53.231 02:37:25 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:17:53.231 02:37:25 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:17:53.231 02:37:25 -- nvmf/common.sh@105 -- # continue 2 00:17:53.231 02:37:25 -- target/device_removal.sh@49 -- # for net_dev in $(get_rdma_if_list) 00:17:53.231 02:37:25 -- target/device_removal.sh@50 -- # create_subsystem_and_connect_on_netdev mlx_0_0 00:17:53.231 02:37:25 -- target/device_removal.sh@25 -- # local -a dev_name 00:17:53.231 02:37:25 -- target/device_removal.sh@27 -- # dev_name=mlx_0_0 00:17:53.231 02:37:25 -- target/device_removal.sh@28 -- # malloc_name=mlx_0_0 00:17:53.231 02:37:25 -- target/device_removal.sh@29 -- # get_subsystem_nqn mlx_0_0 00:17:53.231 02:37:25 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_0 00:17:53.231 02:37:25 -- target/device_removal.sh@29 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_0 00:17:53.231 02:37:25 -- target/device_removal.sh@30 -- # get_ip_address mlx_0_0 00:17:53.231 02:37:25 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:17:53.231 02:37:25 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:17:53.231 02:37:25 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:53.231 02:37:25 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:53.231 02:37:25 -- target/device_removal.sh@30 -- # ip=192.168.100.8 00:17:53.231 02:37:25 -- target/device_removal.sh@31 -- # serial=SPDK000mlx_0_0 00:17:53.231 02:37:25 -- target/device_removal.sh@33 -- # MALLOC_BDEV_SIZE=128 00:17:53.231 02:37:25 -- target/device_removal.sh@34 -- # MALLOC_BLOCK_SIZE=512 00:17:53.231 02:37:25 -- target/device_removal.sh@36 -- # rpc_cmd bdev_malloc_create 128 512 -b mlx_0_0 00:17:53.231 02:37:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:53.231 02:37:25 -- common/autotest_common.sh@10 -- # set +x 00:17:53.231 02:37:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:53.231 02:37:25 -- target/device_removal.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:system_mlx_0_0 -a -s SPDK000mlx_0_0 00:17:53.231 02:37:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:53.231 02:37:25 -- common/autotest_common.sh@10 -- # set +x 00:17:53.231 02:37:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:53.231 02:37:25 -- target/device_removal.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:system_mlx_0_0 mlx_0_0 00:17:53.231 02:37:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:53.231 02:37:25 -- common/autotest_common.sh@10 -- # set +x 00:17:53.231 02:37:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:53.231 02:37:25 -- target/device_removal.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:system_mlx_0_0 -t rdma -a 192.168.100.8 -s 4420 00:17:53.231 02:37:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:53.231 02:37:25 -- common/autotest_common.sh@10 -- # set +x 00:17:53.231 [2024-04-27 02:37:25.647890] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:17:53.231 02:37:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:53.231 02:37:25 -- target/device_removal.sh@41 -- # return 0 00:17:53.231 02:37:25 -- target/device_removal.sh@50 -- # netdev_nvme_dict[$net_dev]=mlx_0_0 00:17:53.231 02:37:25 -- target/device_removal.sh@49 -- # for net_dev in $(get_rdma_if_list) 00:17:53.231 02:37:25 -- target/device_removal.sh@50 -- # create_subsystem_and_connect_on_netdev mlx_0_1 00:17:53.231 02:37:25 -- target/device_removal.sh@25 -- # local -a dev_name 00:17:53.231 02:37:25 -- target/device_removal.sh@27 -- # dev_name=mlx_0_1 00:17:53.231 02:37:25 -- target/device_removal.sh@28 -- # malloc_name=mlx_0_1 00:17:53.231 02:37:25 -- target/device_removal.sh@29 -- # get_subsystem_nqn mlx_0_1 00:17:53.231 02:37:25 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_1 00:17:53.231 02:37:25 -- target/device_removal.sh@29 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_1 00:17:53.231 02:37:25 -- target/device_removal.sh@30 -- # get_ip_address mlx_0_1 00:17:53.231 02:37:25 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:17:53.231 02:37:25 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:17:53.231 02:37:25 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:53.231 02:37:25 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:53.231 02:37:25 -- target/device_removal.sh@30 -- # ip=192.168.100.9 00:17:53.231 02:37:25 -- target/device_removal.sh@31 -- # serial=SPDK000mlx_0_1 00:17:53.231 02:37:25 -- target/device_removal.sh@33 -- # MALLOC_BDEV_SIZE=128 00:17:53.231 02:37:25 -- target/device_removal.sh@34 -- # MALLOC_BLOCK_SIZE=512 00:17:53.231 02:37:25 -- target/device_removal.sh@36 -- # rpc_cmd bdev_malloc_create 128 512 -b mlx_0_1 00:17:53.231 02:37:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:53.231 02:37:25 -- common/autotest_common.sh@10 -- # set +x 00:17:53.231 02:37:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:53.231 02:37:25 -- target/device_removal.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:system_mlx_0_1 -a -s SPDK000mlx_0_1 00:17:53.231 02:37:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:53.231 02:37:25 -- common/autotest_common.sh@10 -- # set +x 00:17:53.231 02:37:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:53.231 02:37:25 -- target/device_removal.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:system_mlx_0_1 mlx_0_1 00:17:53.231 02:37:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:53.231 02:37:25 -- common/autotest_common.sh@10 -- # set +x 00:17:53.231 02:37:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:53.232 02:37:25 -- target/device_removal.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:system_mlx_0_1 -t rdma -a 192.168.100.9 -s 4420 00:17:53.232 02:37:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:53.232 02:37:25 -- common/autotest_common.sh@10 -- # set +x 00:17:53.232 [2024-04-27 02:37:25.735998] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:17:53.232 02:37:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:53.232 02:37:25 -- target/device_removal.sh@41 -- # return 0 00:17:53.232 02:37:25 -- target/device_removal.sh@50 -- # netdev_nvme_dict[$net_dev]=mlx_0_1 00:17:53.232 02:37:25 -- target/device_removal.sh@53 -- # return 0 00:17:53.232 02:37:25 -- target/device_removal.sh@132 -- # generate_io_traffic_with_bdevperf mlx_0_0 mlx_0_1 00:17:53.232 02:37:25 -- target/device_removal.sh@87 -- # dev_names=('mlx_0_0' 'mlx_0_1') 00:17:53.232 02:37:25 -- target/device_removal.sh@87 -- # local dev_names 00:17:53.232 02:37:25 -- target/device_removal.sh@89 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:17:53.232 02:37:25 -- target/device_removal.sh@91 -- # bdevperf_pid=1571200 00:17:53.232 02:37:25 -- target/device_removal.sh@93 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; kill -9 $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:53.232 02:37:25 -- target/device_removal.sh@90 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 90 00:17:53.232 02:37:25 -- target/device_removal.sh@94 -- # waitforlisten 1571200 /var/tmp/bdevperf.sock 00:17:53.232 02:37:25 -- common/autotest_common.sh@817 -- # '[' -z 1571200 ']' 00:17:53.232 02:37:25 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:53.232 02:37:25 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:53.232 02:37:25 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:53.232 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:53.232 02:37:25 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:53.232 02:37:25 -- common/autotest_common.sh@10 -- # set +x 00:17:53.232 02:37:26 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:53.232 02:37:26 -- common/autotest_common.sh@850 -- # return 0 00:17:53.232 02:37:26 -- target/device_removal.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_set_options -r -1 00:17:53.232 02:37:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:53.232 02:37:26 -- common/autotest_common.sh@10 -- # set +x 00:17:53.232 02:37:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:53.232 02:37:26 -- target/device_removal.sh@100 -- # for dev_name in "${dev_names[@]}" 00:17:53.232 02:37:26 -- target/device_removal.sh@101 -- # get_subsystem_nqn mlx_0_0 00:17:53.232 02:37:26 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_0 00:17:53.232 02:37:26 -- target/device_removal.sh@101 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_0 00:17:53.232 02:37:26 -- target/device_removal.sh@102 -- # get_ip_address mlx_0_0 00:17:53.232 02:37:26 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:17:53.232 02:37:26 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:17:53.232 02:37:26 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:53.232 02:37:26 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:53.232 02:37:26 -- target/device_removal.sh@102 -- # tgt_ip=192.168.100.8 00:17:53.232 02:37:26 -- target/device_removal.sh@106 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme_mlx_0_0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:system_mlx_0_0 -l -1 -o 1 00:17:53.232 02:37:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:53.232 02:37:26 -- common/autotest_common.sh@10 -- # set +x 00:17:53.232 Nvme_mlx_0_0n1 00:17:53.232 02:37:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:53.232 02:37:26 -- target/device_removal.sh@100 -- # for dev_name in "${dev_names[@]}" 00:17:53.232 02:37:26 -- target/device_removal.sh@101 -- # get_subsystem_nqn mlx_0_1 00:17:53.232 02:37:26 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_1 00:17:53.232 02:37:26 -- target/device_removal.sh@101 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_1 00:17:53.232 02:37:26 -- target/device_removal.sh@102 -- # get_ip_address mlx_0_1 00:17:53.232 02:37:26 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:17:53.232 02:37:26 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:53.232 02:37:26 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:17:53.232 02:37:26 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:53.232 02:37:26 -- target/device_removal.sh@102 -- # tgt_ip=192.168.100.9 00:17:53.232 02:37:26 -- target/device_removal.sh@106 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme_mlx_0_1 -t rdma -a 192.168.100.9 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:system_mlx_0_1 -l -1 -o 1 00:17:53.232 02:37:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:53.232 02:37:26 -- common/autotest_common.sh@10 -- # set +x 00:17:53.232 Nvme_mlx_0_1n1 00:17:53.232 02:37:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:53.232 02:37:26 -- target/device_removal.sh@110 -- # bdevperf_rpc_pid=1571256 00:17:53.232 02:37:26 -- target/device_removal.sh@112 -- # sleep 5 00:17:53.232 02:37:26 -- target/device_removal.sh@109 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 120 -s /var/tmp/bdevperf.sock perform_tests 00:17:58.505 02:37:31 -- target/device_removal.sh@134 -- # for net_dev in "${!netdev_nvme_dict[@]}" 00:17:58.505 02:37:31 -- target/device_removal.sh@135 -- # nvme_dev=mlx_0_0 00:17:58.505 02:37:31 -- target/device_removal.sh@136 -- # get_rdma_device_name mlx_0_0 00:17:58.505 02:37:31 -- target/device_removal.sh@71 -- # dev_name=mlx_0_0 00:17:58.505 02:37:31 -- target/device_removal.sh@72 -- # get_pci_dir mlx_0_0 00:17:58.505 02:37:31 -- target/device_removal.sh@61 -- # dev_name=mlx_0_0 00:17:58.505 02:37:31 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.0/net/mlx_0_0/device 00:17:58.505 02:37:31 -- target/device_removal.sh@72 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.0/infiniband 00:17:58.505 02:37:31 -- target/device_removal.sh@136 -- # rdma_dev_name=mlx5_0 00:17:58.505 02:37:31 -- target/device_removal.sh@137 -- # get_ip_address mlx_0_0 00:17:58.505 02:37:31 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:17:58.505 02:37:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:17:58.505 02:37:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:58.505 02:37:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:58.505 02:37:31 -- target/device_removal.sh@137 -- # origin_ip=192.168.100.8 00:17:58.505 02:37:31 -- target/device_removal.sh@138 -- # get_pci_dir mlx_0_0 00:17:58.505 02:37:31 -- target/device_removal.sh@61 -- # dev_name=mlx_0_0 00:17:58.505 02:37:31 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.0/net/mlx_0_0/device 00:17:58.505 02:37:31 -- target/device_removal.sh@138 -- # pci_dir=/sys/devices/pci0000:17/0000:17:00.0/0000:18:00.0 00:17:58.505 02:37:31 -- target/device_removal.sh@140 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_0 00:17:58.505 02:37:31 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_0 00:17:58.505 02:37:31 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:17:58.505 02:37:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:58.505 02:37:31 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:17:58.505 02:37:31 -- common/autotest_common.sh@10 -- # set +x 00:17:58.505 02:37:31 -- target/device_removal.sh@77 -- # grep mlx5_0 00:17:58.505 02:37:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:58.505 mlx5_0 00:17:58.505 02:37:31 -- target/device_removal.sh@78 -- # return 0 00:17:58.505 02:37:31 -- target/device_removal.sh@145 -- # remove_one_nic mlx_0_0 00:17:58.505 02:37:31 -- target/device_removal.sh@66 -- # dev_name=mlx_0_0 00:17:58.505 02:37:31 -- target/device_removal.sh@67 -- # echo 1 00:17:58.505 02:37:31 -- target/device_removal.sh@67 -- # get_pci_dir mlx_0_0 00:17:58.505 02:37:31 -- target/device_removal.sh@61 -- # dev_name=mlx_0_0 00:17:58.505 02:37:31 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.0/net/mlx_0_0/device 00:17:58.505 [2024-04-27 02:37:32.002422] rdma.c:3563:nvmf_rdma_handle_device_removal: *NOTICE*: Port 192.168.100.8:4420 on device mlx5_0 is being removed. 00:17:58.505 [2024-04-27 02:37:32.002552] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:17:58.505 [2024-04-27 02:37:32.008241] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:17:58.505 [2024-04-27 02:37:32.008266] rdma.c: 845:nvmf_rdma_qpair_destroy: *WARNING*: Destroying qpair when queue depth is 98 00:17:58.505 [2024-04-27 02:37:32.008676] rdma_verbs.c: 83:spdk_rdma_qp_destroy: *WARNING*: Destroying qpair with queued Work Requests 00:18:05.076 02:37:37 -- target/device_removal.sh@147 -- # seq 1 10 00:18:05.076 02:37:37 -- target/device_removal.sh@147 -- # for i in $(seq 1 10) 00:18:05.076 02:37:37 -- target/device_removal.sh@148 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_0 00:18:05.076 02:37:37 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_0 00:18:05.076 02:37:37 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:18:05.076 02:37:37 -- target/device_removal.sh@77 -- # grep mlx5_0 00:18:05.076 02:37:37 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:18:05.076 02:37:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:05.076 02:37:37 -- common/autotest_common.sh@10 -- # set +x 00:18:05.076 02:37:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:05.076 02:37:37 -- target/device_removal.sh@78 -- # return 1 00:18:05.076 02:37:37 -- target/device_removal.sh@149 -- # break 00:18:05.076 02:37:37 -- target/device_removal.sh@158 -- # get_rdma_dev_count_in_nvmf_tgt 00:18:05.076 02:37:37 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:18:05.076 02:37:37 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:18:05.076 02:37:37 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:18:05.076 02:37:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:05.076 02:37:37 -- common/autotest_common.sh@10 -- # set +x 00:18:05.076 02:37:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:05.076 02:37:37 -- target/device_removal.sh@158 -- # ib_count_after_remove=1 00:18:05.076 02:37:37 -- target/device_removal.sh@160 -- # rescan_pci 00:18:05.076 02:37:37 -- target/device_removal.sh@57 -- # echo 1 00:18:05.076 [2024-04-27 02:37:38.563420] rdma.c:3252:nvmf_rdma_rescan_devices: *WARNING*: Failed to init ibv device 0x25dfa00, err 11. Skip rescan. 00:18:05.076 [2024-04-27 02:37:38.568646] rdma.c:3252:nvmf_rdma_rescan_devices: *WARNING*: Failed to init ibv device 0x25dfa00, err 11. Skip rescan. 00:18:05.076 02:37:38 -- target/device_removal.sh@162 -- # seq 1 10 00:18:05.076 02:37:38 -- target/device_removal.sh@162 -- # for i in $(seq 1 10) 00:18:05.076 02:37:38 -- target/device_removal.sh@163 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.0/net 00:18:05.076 02:37:38 -- target/device_removal.sh@163 -- # new_net_dev=mlx_0_0 00:18:05.076 02:37:38 -- target/device_removal.sh@164 -- # [[ -z mlx_0_0 ]] 00:18:05.076 02:37:38 -- target/device_removal.sh@166 -- # [[ mlx_0_0 != \m\l\x\_\0\_\0 ]] 00:18:05.076 02:37:38 -- target/device_removal.sh@171 -- # break 00:18:05.076 02:37:38 -- target/device_removal.sh@175 -- # [[ -z mlx_0_0 ]] 00:18:05.076 02:37:38 -- target/device_removal.sh@179 -- # ip link set mlx_0_0 up 00:18:05.336 [2024-04-27 02:37:38.955904] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x2504bd0/0x2506430) succeed. 00:18:05.336 [2024-04-27 02:37:38.955977] rdma.c:3305:nvmf_rdma_retry_listen_port: *ERROR*: Found new IB device but port 192.168.100.8:4420 is still failed(-1) to listen. 00:18:08.627 02:37:41 -- target/device_removal.sh@180 -- # get_ip_address mlx_0_0 00:18:08.627 02:37:41 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:18:08.627 02:37:41 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:18:08.627 02:37:41 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:08.627 02:37:41 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:08.627 02:37:41 -- target/device_removal.sh@180 -- # [[ -z '' ]] 00:18:08.627 02:37:41 -- target/device_removal.sh@181 -- # ip addr add 192.168.100.8/24 dev mlx_0_0 00:18:08.627 02:37:41 -- target/device_removal.sh@186 -- # seq 1 10 00:18:08.627 02:37:41 -- target/device_removal.sh@186 -- # for i in $(seq 1 10) 00:18:08.627 02:37:41 -- target/device_removal.sh@187 -- # get_rdma_dev_count_in_nvmf_tgt 00:18:08.627 02:37:41 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:18:08.628 [2024-04-27 02:37:41.939352] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:18:08.628 [2024-04-27 02:37:41.939396] rdma.c:3311:nvmf_rdma_retry_listen_port: *NOTICE*: Port 192.168.100.8:4420 come back 00:18:08.628 [2024-04-27 02:37:41.939417] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:18:08.628 [2024-04-27 02:37:41.939434] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:18:08.628 02:37:41 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:18:08.628 02:37:41 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:18:08.628 02:37:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:08.628 02:37:41 -- common/autotest_common.sh@10 -- # set +x 00:18:08.628 02:37:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:08.628 02:37:41 -- target/device_removal.sh@187 -- # ib_count=2 00:18:08.628 02:37:41 -- target/device_removal.sh@188 -- # (( ib_count > ib_count_after_remove )) 00:18:08.628 02:37:41 -- target/device_removal.sh@189 -- # break 00:18:08.628 02:37:41 -- target/device_removal.sh@134 -- # for net_dev in "${!netdev_nvme_dict[@]}" 00:18:08.628 02:37:41 -- target/device_removal.sh@135 -- # nvme_dev=mlx_0_1 00:18:08.628 02:37:41 -- target/device_removal.sh@136 -- # get_rdma_device_name mlx_0_1 00:18:08.628 02:37:41 -- target/device_removal.sh@71 -- # dev_name=mlx_0_1 00:18:08.628 02:37:41 -- target/device_removal.sh@72 -- # get_pci_dir mlx_0_1 00:18:08.628 02:37:41 -- target/device_removal.sh@61 -- # dev_name=mlx_0_1 00:18:08.628 02:37:41 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.1/net/mlx_0_1/device 00:18:08.628 02:37:41 -- target/device_removal.sh@72 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.1/infiniband 00:18:08.628 02:37:42 -- target/device_removal.sh@136 -- # rdma_dev_name=mlx5_1 00:18:08.628 02:37:42 -- target/device_removal.sh@137 -- # get_ip_address mlx_0_1 00:18:08.628 02:37:42 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:18:08.628 02:37:42 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:18:08.628 02:37:42 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:08.628 02:37:42 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:08.628 02:37:42 -- target/device_removal.sh@137 -- # origin_ip=192.168.100.9 00:18:08.628 02:37:42 -- target/device_removal.sh@138 -- # get_pci_dir mlx_0_1 00:18:08.628 02:37:42 -- target/device_removal.sh@61 -- # dev_name=mlx_0_1 00:18:08.628 02:37:42 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.1/net/mlx_0_1/device 00:18:08.628 02:37:42 -- target/device_removal.sh@138 -- # pci_dir=/sys/devices/pci0000:17/0000:17:00.0/0000:18:00.1 00:18:08.628 02:37:42 -- target/device_removal.sh@140 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_1 00:18:08.628 02:37:42 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_1 00:18:08.628 02:37:42 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:18:08.628 02:37:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:08.628 02:37:42 -- common/autotest_common.sh@10 -- # set +x 00:18:08.628 02:37:42 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:18:08.628 02:37:42 -- target/device_removal.sh@77 -- # grep mlx5_1 00:18:08.628 02:37:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:08.628 mlx5_1 00:18:08.628 02:37:42 -- target/device_removal.sh@78 -- # return 0 00:18:08.628 02:37:42 -- target/device_removal.sh@145 -- # remove_one_nic mlx_0_1 00:18:08.628 02:37:42 -- target/device_removal.sh@66 -- # dev_name=mlx_0_1 00:18:08.628 02:37:42 -- target/device_removal.sh@67 -- # echo 1 00:18:08.628 02:37:42 -- target/device_removal.sh@67 -- # get_pci_dir mlx_0_1 00:18:08.628 02:37:42 -- target/device_removal.sh@61 -- # dev_name=mlx_0_1 00:18:08.628 02:37:42 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.1/net/mlx_0_1/device 00:18:08.628 [2024-04-27 02:37:42.134603] rdma.c:3563:nvmf_rdma_handle_device_removal: *NOTICE*: Port 192.168.100.9:4420 on device mlx5_1 is being removed. 00:18:08.628 [2024-04-27 02:37:42.134674] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:18:08.628 [2024-04-27 02:37:42.138391] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:18:08.628 [2024-04-27 02:37:42.138412] rdma.c: 845:nvmf_rdma_qpair_destroy: *WARNING*: Destroying qpair when queue depth is 129 00:18:15.243 02:37:47 -- target/device_removal.sh@147 -- # seq 1 10 00:18:15.243 02:37:47 -- target/device_removal.sh@147 -- # for i in $(seq 1 10) 00:18:15.243 02:37:47 -- target/device_removal.sh@148 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_1 00:18:15.243 02:37:47 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_1 00:18:15.243 02:37:47 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:18:15.243 02:37:47 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:18:15.243 02:37:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:15.243 02:37:47 -- common/autotest_common.sh@10 -- # set +x 00:18:15.243 02:37:47 -- target/device_removal.sh@77 -- # grep mlx5_1 00:18:15.243 02:37:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:15.243 02:37:47 -- target/device_removal.sh@78 -- # return 1 00:18:15.243 02:37:47 -- target/device_removal.sh@149 -- # break 00:18:15.243 02:37:47 -- target/device_removal.sh@158 -- # get_rdma_dev_count_in_nvmf_tgt 00:18:15.243 02:37:47 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:18:15.243 02:37:47 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:18:15.243 02:37:47 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:18:15.243 02:37:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:15.243 02:37:47 -- common/autotest_common.sh@10 -- # set +x 00:18:15.243 02:37:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:15.243 02:37:47 -- target/device_removal.sh@158 -- # ib_count_after_remove=1 00:18:15.243 02:37:47 -- target/device_removal.sh@160 -- # rescan_pci 00:18:15.243 02:37:47 -- target/device_removal.sh@57 -- # echo 1 00:18:15.243 [2024-04-27 02:37:48.768724] rdma.c:3252:nvmf_rdma_rescan_devices: *WARNING*: Failed to init ibv device 0x24ef040, err 11. Skip rescan. 00:18:15.507 02:37:48 -- target/device_removal.sh@162 -- # seq 1 10 00:18:15.507 02:37:48 -- target/device_removal.sh@162 -- # for i in $(seq 1 10) 00:18:15.507 02:37:48 -- target/device_removal.sh@163 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.1/net 00:18:15.507 02:37:48 -- target/device_removal.sh@163 -- # new_net_dev=mlx_0_1 00:18:15.507 02:37:48 -- target/device_removal.sh@164 -- # [[ -z mlx_0_1 ]] 00:18:15.507 02:37:48 -- target/device_removal.sh@166 -- # [[ mlx_0_1 != \m\l\x\_\0\_\1 ]] 00:18:15.507 02:37:48 -- target/device_removal.sh@171 -- # break 00:18:15.507 02:37:48 -- target/device_removal.sh@175 -- # [[ -z mlx_0_1 ]] 00:18:15.507 02:37:48 -- target/device_removal.sh@179 -- # ip link set mlx_0_1 up 00:18:15.766 [2024-04-27 02:37:49.151110] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x2505250/0x2547ac0) succeed. 00:18:15.766 [2024-04-27 02:37:49.151197] rdma.c:3305:nvmf_rdma_retry_listen_port: *ERROR*: Found new IB device but port 192.168.100.9:4420 is still failed(-1) to listen. 00:18:19.058 02:37:52 -- target/device_removal.sh@180 -- # get_ip_address mlx_0_1 00:18:19.058 02:37:52 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:18:19.058 02:37:52 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:18:19.058 02:37:52 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:19.058 02:37:52 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:19.058 02:37:52 -- target/device_removal.sh@180 -- # [[ -z '' ]] 00:18:19.058 02:37:52 -- target/device_removal.sh@181 -- # ip addr add 192.168.100.9/24 dev mlx_0_1 00:18:19.058 02:37:52 -- target/device_removal.sh@186 -- # seq 1 10 00:18:19.058 02:37:52 -- target/device_removal.sh@186 -- # for i in $(seq 1 10) 00:18:19.058 02:37:52 -- target/device_removal.sh@187 -- # get_rdma_dev_count_in_nvmf_tgt 00:18:19.058 02:37:52 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:18:19.058 02:37:52 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:18:19.058 02:37:52 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:18:19.058 02:37:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:19.058 02:37:52 -- common/autotest_common.sh@10 -- # set +x 00:18:19.058 [2024-04-27 02:37:52.239424] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:18:19.058 [2024-04-27 02:37:52.239461] rdma.c:3311:nvmf_rdma_retry_listen_port: *NOTICE*: Port 192.168.100.9:4420 come back 00:18:19.058 [2024-04-27 02:37:52.239480] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:18:19.058 [2024-04-27 02:37:52.239498] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:18:19.058 02:37:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:19.058 02:37:52 -- target/device_removal.sh@187 -- # ib_count=2 00:18:19.058 02:37:52 -- target/device_removal.sh@188 -- # (( ib_count > ib_count_after_remove )) 00:18:19.058 02:37:52 -- target/device_removal.sh@189 -- # break 00:18:19.058 02:37:52 -- target/device_removal.sh@200 -- # stop_bdevperf 00:18:19.058 02:37:52 -- target/device_removal.sh@116 -- # wait 1571256 00:19:26.772 0 00:19:26.772 02:38:57 -- target/device_removal.sh@118 -- # killprocess 1571200 00:19:26.772 02:38:57 -- common/autotest_common.sh@936 -- # '[' -z 1571200 ']' 00:19:26.772 02:38:57 -- common/autotest_common.sh@940 -- # kill -0 1571200 00:19:26.772 02:38:57 -- common/autotest_common.sh@941 -- # uname 00:19:26.772 02:38:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:26.772 02:38:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1571200 00:19:26.772 02:38:57 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:19:26.772 02:38:57 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:19:26.772 02:38:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1571200' 00:19:26.772 killing process with pid 1571200 00:19:26.772 02:38:57 -- common/autotest_common.sh@955 -- # kill 1571200 00:19:26.772 02:38:57 -- common/autotest_common.sh@960 -- # wait 1571200 00:19:26.772 02:38:57 -- target/device_removal.sh@119 -- # bdevperf_pid= 00:19:26.772 02:38:57 -- target/device_removal.sh@121 -- # cat /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/try.txt 00:19:26.772 [2024-04-27 02:37:25.795103] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:19:26.772 [2024-04-27 02:37:25.795157] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1571200 ] 00:19:26.772 EAL: No free 2048 kB hugepages reported on node 1 00:19:26.772 [2024-04-27 02:37:25.863388] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:26.772 [2024-04-27 02:37:25.942087] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:26.772 Running I/O for 90 seconds... 00:19:26.772 [2024-04-27 02:37:32.004541] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:19:26.772 [2024-04-27 02:37:32.004581] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:19:26.772 [2024-04-27 02:37:32.004594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32615 cdw0:16 sqhd:43b9 p:0 m:0 dnr:0 00:19:26.772 [2024-04-27 02:37:32.004606] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:19:26.772 [2024-04-27 02:37:32.004616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32615 cdw0:16 sqhd:43b9 p:0 m:0 dnr:0 00:19:26.772 [2024-04-27 02:37:32.004627] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:19:26.772 [2024-04-27 02:37:32.004638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32615 cdw0:16 sqhd:43b9 p:0 m:0 dnr:0 00:19:26.772 [2024-04-27 02:37:32.004648] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:19:26.772 [2024-04-27 02:37:32.004659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32615 cdw0:16 sqhd:43b9 p:0 m:0 dnr:0 00:19:26.772 [2024-04-27 02:37:32.006626] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:19:26.772 [2024-04-27 02:37:32.006643] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:19:26.772 [2024-04-27 02:37:32.006678] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:19:26.772 [2024-04-27 02:37:32.014538] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.024566] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.034585] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.044615] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.054642] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.064668] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.074733] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.085023] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.095264] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.105453] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.115682] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.125923] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.136100] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.146270] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.156538] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.166820] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.177034] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.187289] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.197449] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.207659] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.217838] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.228966] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.239183] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.249211] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.259240] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.269324] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.279668] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.290013] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.300224] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.310447] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.320598] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.331240] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.341267] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.351655] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.362044] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.372145] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.382286] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.392405] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.402654] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.413391] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.423416] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.433474] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.443491] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.453901] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.463926] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.474230] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.772 [2024-04-27 02:37:32.484255] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.494281] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.504434] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.514750] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.524776] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.534836] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.545064] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.556134] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.566158] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.577218] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.587481] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.597666] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.607695] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.618277] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.628483] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.638509] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.648536] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.658739] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.668985] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.679055] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.689405] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.699445] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.709474] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.719580] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.730582] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.740617] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.750781] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.760967] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.771545] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.781622] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.791707] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.801733] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.812058] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.822256] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.832388] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.842625] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.852907] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.863050] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.873250] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.883415] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.893616] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.904199] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.914235] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.924332] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.934357] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.944521] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.954597] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.964754] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.974837] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.984983] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:32.995114] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:33.005328] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.773 [2024-04-27 02:37:33.009130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:194296 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007740000 len:0x1000 key:0x1810ef 00:19:26.773 [2024-04-27 02:37:33.009149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.773 [2024-04-27 02:37:33.009167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:194304 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000773e000 len:0x1000 key:0x1810ef 00:19:26.773 [2024-04-27 02:37:33.009181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.773 [2024-04-27 02:37:33.009194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:194312 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000773c000 len:0x1000 key:0x1810ef 00:19:26.773 [2024-04-27 02:37:33.009203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.773 [2024-04-27 02:37:33.009214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:194320 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000773a000 len:0x1000 key:0x1810ef 00:19:26.773 [2024-04-27 02:37:33.009223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.773 [2024-04-27 02:37:33.009235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:194328 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007738000 len:0x1000 key:0x1810ef 00:19:26.773 [2024-04-27 02:37:33.009244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.773 [2024-04-27 02:37:33.009256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:194336 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007736000 len:0x1000 key:0x1810ef 00:19:26.773 [2024-04-27 02:37:33.009265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.773 [2024-04-27 02:37:33.009276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:194344 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007734000 len:0x1000 key:0x1810ef 00:19:26.773 [2024-04-27 02:37:33.009285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.773 [2024-04-27 02:37:33.009296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:194352 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007732000 len:0x1000 key:0x1810ef 00:19:26.773 [2024-04-27 02:37:33.009306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.773 [2024-04-27 02:37:33.009316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:194360 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007730000 len:0x1000 key:0x1810ef 00:19:26.773 [2024-04-27 02:37:33.009326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.773 [2024-04-27 02:37:33.009340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:194368 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000772e000 len:0x1000 key:0x1810ef 00:19:26.773 [2024-04-27 02:37:33.009350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.773 [2024-04-27 02:37:33.009361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:194376 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000772c000 len:0x1000 key:0x1810ef 00:19:26.773 [2024-04-27 02:37:33.009370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.773 [2024-04-27 02:37:33.009381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:194384 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000772a000 len:0x1000 key:0x1810ef 00:19:26.773 [2024-04-27 02:37:33.009391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.773 [2024-04-27 02:37:33.009401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:194392 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007728000 len:0x1000 key:0x1810ef 00:19:26.773 [2024-04-27 02:37:33.009413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.773 [2024-04-27 02:37:33.009425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:194400 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007726000 len:0x1000 key:0x1810ef 00:19:26.773 [2024-04-27 02:37:33.009434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.773 [2024-04-27 02:37:33.009445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:194408 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007724000 len:0x1000 key:0x1810ef 00:19:26.773 [2024-04-27 02:37:33.009454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.773 [2024-04-27 02:37:33.009465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:194416 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007722000 len:0x1000 key:0x1810ef 00:19:26.773 [2024-04-27 02:37:33.009475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.773 [2024-04-27 02:37:33.009486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:194424 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007720000 len:0x1000 key:0x1810ef 00:19:26.773 [2024-04-27 02:37:33.009495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.773 [2024-04-27 02:37:33.009506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:194432 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000771e000 len:0x1000 key:0x1810ef 00:19:26.773 [2024-04-27 02:37:33.009516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.773 [2024-04-27 02:37:33.009526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:194440 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000771c000 len:0x1000 key:0x1810ef 00:19:26.773 [2024-04-27 02:37:33.009536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.773 [2024-04-27 02:37:33.009547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:194448 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000771a000 len:0x1000 key:0x1810ef 00:19:26.773 [2024-04-27 02:37:33.009557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.773 [2024-04-27 02:37:33.009568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:194456 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007718000 len:0x1000 key:0x1810ef 00:19:26.773 [2024-04-27 02:37:33.009577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.773 [2024-04-27 02:37:33.009588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:194464 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007716000 len:0x1000 key:0x1810ef 00:19:26.773 [2024-04-27 02:37:33.009598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.773 [2024-04-27 02:37:33.009609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:194472 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007714000 len:0x1000 key:0x1810ef 00:19:26.773 [2024-04-27 02:37:33.009618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.773 [2024-04-27 02:37:33.009629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:194480 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007712000 len:0x1000 key:0x1810ef 00:19:26.773 [2024-04-27 02:37:33.009640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.773 [2024-04-27 02:37:33.009651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:194488 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007710000 len:0x1000 key:0x1810ef 00:19:26.773 [2024-04-27 02:37:33.009661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.773 [2024-04-27 02:37:33.009671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:194496 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000770e000 len:0x1000 key:0x1810ef 00:19:26.773 [2024-04-27 02:37:33.009681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.773 [2024-04-27 02:37:33.009692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:194504 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000770c000 len:0x1000 key:0x1810ef 00:19:26.773 [2024-04-27 02:37:33.009701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.773 [2024-04-27 02:37:33.009712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:194512 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000770a000 len:0x1000 key:0x1810ef 00:19:26.773 [2024-04-27 02:37:33.009721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.773 [2024-04-27 02:37:33.009732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:194520 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007708000 len:0x1000 key:0x1810ef 00:19:26.773 [2024-04-27 02:37:33.009741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.773 [2024-04-27 02:37:33.009752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:194528 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007706000 len:0x1000 key:0x1810ef 00:19:26.773 [2024-04-27 02:37:33.009762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.773 [2024-04-27 02:37:33.009772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:194536 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007704000 len:0x1000 key:0x1810ef 00:19:26.773 [2024-04-27 02:37:33.009782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.773 [2024-04-27 02:37:33.009792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:194544 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007702000 len:0x1000 key:0x1810ef 00:19:26.773 [2024-04-27 02:37:33.009802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.773 [2024-04-27 02:37:33.009813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:194552 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007700000 len:0x1000 key:0x1810ef 00:19:26.773 [2024-04-27 02:37:33.009822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.773 [2024-04-27 02:37:33.009833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:194560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.773 [2024-04-27 02:37:33.009842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.009853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:194568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.009862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.009874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:194576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.009885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.009896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:194584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.009906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.009917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:194592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.009926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.009937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:194600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.009946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.009957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:194608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.009966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.009977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:194616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.009986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.009996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:194624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:194632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:194640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:194648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:194656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:194664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:194672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:194680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:194688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:194696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:194704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:194712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:194720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:194728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:194736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:194744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:194752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:194760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:194768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:194776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:194784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:194792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:194800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:194808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:194816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:194824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:194832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:194840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:194848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:194856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:194864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:194872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:194880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:194888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:194896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:194904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:194912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:194920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:194928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:194936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:194944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:194952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:194960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:194968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:194976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:194984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:194992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:195000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.010984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:195008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.010994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.011004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:195016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.011013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.011024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:195024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.011035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.011046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:195032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.011055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.011066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:195040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.011075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.011086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:195048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.011095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.011106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:195056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.774 [2024-04-27 02:37:33.011115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.774 [2024-04-27 02:37:33.011128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:195064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.775 [2024-04-27 02:37:33.011137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.775 [2024-04-27 02:37:33.011148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:195072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.775 [2024-04-27 02:37:33.011157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.775 [2024-04-27 02:37:33.011168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:195080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.775 [2024-04-27 02:37:33.011177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.775 [2024-04-27 02:37:33.011188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:195088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.775 [2024-04-27 02:37:33.011198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.775 [2024-04-27 02:37:33.011209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:195096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.775 [2024-04-27 02:37:33.011218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.775 [2024-04-27 02:37:33.011229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:195104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.775 [2024-04-27 02:37:33.011238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.775 [2024-04-27 02:37:33.011249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:195112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.775 [2024-04-27 02:37:33.011258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.775 [2024-04-27 02:37:33.011269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:195120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.775 [2024-04-27 02:37:33.011278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.775 [2024-04-27 02:37:33.011289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:195128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.775 [2024-04-27 02:37:33.011298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.775 [2024-04-27 02:37:33.011309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:195136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.775 [2024-04-27 02:37:33.011320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.775 [2024-04-27 02:37:33.011331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:195144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.775 [2024-04-27 02:37:33.011344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.775 [2024-04-27 02:37:33.011355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:195152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.775 [2024-04-27 02:37:33.011365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.775 [2024-04-27 02:37:33.011377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:195160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.775 [2024-04-27 02:37:33.011386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.775 [2024-04-27 02:37:33.011397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:195168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.775 [2024-04-27 02:37:33.011407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.775 [2024-04-27 02:37:33.011418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:195176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.775 [2024-04-27 02:37:33.011427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.775 [2024-04-27 02:37:33.011438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:195184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.775 [2024-04-27 02:37:33.011447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.775 [2024-04-27 02:37:33.011458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:195192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.775 [2024-04-27 02:37:33.011467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.775 [2024-04-27 02:37:33.011478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:195200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.775 [2024-04-27 02:37:33.011487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.775 [2024-04-27 02:37:33.011498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:195208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.775 [2024-04-27 02:37:33.011508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.775 [2024-04-27 02:37:33.011519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:195216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.775 [2024-04-27 02:37:33.011528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.775 [2024-04-27 02:37:33.011540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:195224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.775 [2024-04-27 02:37:33.011549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.775 [2024-04-27 02:37:33.011560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:195232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.775 [2024-04-27 02:37:33.011570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.775 [2024-04-27 02:37:33.011581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:195240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.775 [2024-04-27 02:37:33.011590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.775 [2024-04-27 02:37:33.011601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:195248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.775 [2024-04-27 02:37:33.011611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.775 [2024-04-27 02:37:33.011621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:195256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.775 [2024-04-27 02:37:33.011632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.775 [2024-04-27 02:37:33.011643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:195264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.775 [2024-04-27 02:37:33.011652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.775 [2024-04-27 02:37:33.011663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:195272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.775 [2024-04-27 02:37:33.011672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.775 [2024-04-27 02:37:33.011683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:195280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.775 [2024-04-27 02:37:33.011693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.775 [2024-04-27 02:37:33.011703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:195288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.775 [2024-04-27 02:37:33.011713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.775 [2024-04-27 02:37:33.011723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:195296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.775 [2024-04-27 02:37:33.011733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.776 [2024-04-27 02:37:33.011743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:195304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.776 [2024-04-27 02:37:33.011753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.776 [2024-04-27 02:37:33.024699] rdma_verbs.c: 83:spdk_rdma_qp_destroy: *WARNING*: Destroying qpair with queued Work Requests 00:19:26.776 [2024-04-27 02:37:33.024767] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:19:26.776 [2024-04-27 02:37:33.024777] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:19:26.776 [2024-04-27 02:37:33.024786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:195312 len:8 PRP1 0x0 PRP2 0x0 00:19:26.776 [2024-04-27 02:37:33.024797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:19:26.776 [2024-04-27 02:37:33.026263] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:19:26.776 [2024-04-27 02:37:33.026539] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:19:26.776 [2024-04-27 02:37:33.026554] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:19:26.776 [2024-04-27 02:37:33.026562] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:19:26.776 [2024-04-27 02:37:33.026582] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:19:26.776 [2024-04-27 02:37:33.026592] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:19:26.776 [2024-04-27 02:37:33.026604] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:19:26.776 [2024-04-27 02:37:33.026614] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:19:26.776 [2024-04-27 02:37:33.026626] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:19:26.776 [2024-04-27 02:37:33.026647] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:19:26.776 [2024-04-27 02:37:33.026656] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:19:26.776 [2024-04-27 02:37:34.029206] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:19:26.776 [2024-04-27 02:37:34.029246] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:19:26.776 [2024-04-27 02:37:34.029255] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:19:26.776 [2024-04-27 02:37:34.029278] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:19:26.776 [2024-04-27 02:37:34.029289] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:19:26.776 [2024-04-27 02:37:34.029635] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:19:26.776 [2024-04-27 02:37:34.029647] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:19:26.776 [2024-04-27 02:37:34.029657] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:19:26.776 [2024-04-27 02:37:34.029681] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:19:26.776 [2024-04-27 02:37:34.029691] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:19:26.776 [2024-04-27 02:37:35.032203] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:19:26.776 [2024-04-27 02:37:35.032242] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:19:26.776 [2024-04-27 02:37:35.032254] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:19:26.776 [2024-04-27 02:37:35.032276] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:19:26.776 [2024-04-27 02:37:35.032288] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:19:26.776 [2024-04-27 02:37:35.032302] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:19:26.776 [2024-04-27 02:37:35.032315] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:19:26.776 [2024-04-27 02:37:35.032325] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:19:26.776 [2024-04-27 02:37:35.032355] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:19:26.776 [2024-04-27 02:37:35.032369] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:19:26.776 [2024-04-27 02:37:37.037294] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:19:26.776 [2024-04-27 02:37:37.037330] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:19:26.776 [2024-04-27 02:37:37.037360] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:19:26.776 [2024-04-27 02:37:37.037371] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:19:26.776 [2024-04-27 02:37:37.037544] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:19:26.776 [2024-04-27 02:37:37.037555] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:19:26.776 [2024-04-27 02:37:37.037570] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:19:26.776 [2024-04-27 02:37:37.037603] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:19:26.776 [2024-04-27 02:37:37.037614] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:19:26.776 [2024-04-27 02:37:39.042536] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:19:26.776 [2024-04-27 02:37:39.042573] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:19:26.776 [2024-04-27 02:37:39.042599] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:19:26.776 [2024-04-27 02:37:39.042611] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:19:26.776 [2024-04-27 02:37:39.042624] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:19:26.776 [2024-04-27 02:37:39.042634] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:19:26.776 [2024-04-27 02:37:39.042644] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:19:26.776 [2024-04-27 02:37:39.042667] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:19:26.776 [2024-04-27 02:37:39.042676] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:19:26.776 [2024-04-27 02:37:41.047597] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:19:26.776 [2024-04-27 02:37:41.047627] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:19:26.776 [2024-04-27 02:37:41.047650] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:19:26.776 [2024-04-27 02:37:41.047661] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:19:26.776 [2024-04-27 02:37:41.047674] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:19:26.776 [2024-04-27 02:37:41.047684] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:19:26.776 [2024-04-27 02:37:41.047694] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:19:26.776 [2024-04-27 02:37:41.047717] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:19:26.776 [2024-04-27 02:37:41.047726] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:19:26.776 [2024-04-27 02:37:42.116896] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:19:26.776 [2024-04-27 02:37:42.130632] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:19:26.776 [2024-04-27 02:37:42.130659] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:19:26.776 [2024-04-27 02:37:42.130671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32615 cdw0:16 sqhd:43b9 p:0 m:0 dnr:0 00:19:26.776 [2024-04-27 02:37:42.130682] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:19:26.776 [2024-04-27 02:37:42.130692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32615 cdw0:16 sqhd:43b9 p:0 m:0 dnr:0 00:19:26.776 [2024-04-27 02:37:42.130702] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:19:26.776 [2024-04-27 02:37:42.130711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32615 cdw0:16 sqhd:43b9 p:0 m:0 dnr:0 00:19:26.776 [2024-04-27 02:37:42.130725] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:19:26.776 [2024-04-27 02:37:42.130734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32615 cdw0:16 sqhd:43b9 p:0 m:0 dnr:0 00:19:26.776 [2024-04-27 02:37:42.132831] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:19:26.776 [2024-04-27 02:37:42.132845] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:19:26.776 [2024-04-27 02:37:42.132877] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:19:26.776 [2024-04-27 02:37:42.140639] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.776 [2024-04-27 02:37:42.150666] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.776 [2024-04-27 02:37:42.160691] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.776 [2024-04-27 02:37:42.170716] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.776 [2024-04-27 02:37:42.180741] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.776 [2024-04-27 02:37:42.190766] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.776 [2024-04-27 02:37:42.200792] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.776 [2024-04-27 02:37:42.210820] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.776 [2024-04-27 02:37:42.220845] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.776 [2024-04-27 02:37:42.230872] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.776 [2024-04-27 02:37:42.240898] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.250925] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.260952] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.270977] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.281002] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.291027] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.301053] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.311078] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.321103] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.331127] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.341153] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.351178] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.361204] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.371230] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.381255] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.391280] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.401306] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.411333] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.421361] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.431386] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.441411] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.451436] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.461461] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.471487] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.481513] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.491538] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.501565] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.511591] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.521617] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.531645] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.541670] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.551698] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.561724] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.571749] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.581774] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.591799] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.601827] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.611852] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.621878] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.631904] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.641931] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.651956] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.661984] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.672010] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.682035] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.692063] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.702089] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.712115] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.722141] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.732168] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.742196] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.752223] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.762249] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.772274] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.782300] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.792325] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.802352] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.812377] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.822402] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.832429] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.842454] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.852482] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.862509] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.872536] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.882561] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.892589] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.902615] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.912639] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.922664] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.932689] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.942715] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.952741] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.962766] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.972791] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.982816] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:42.992842] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:43.002868] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:43.012895] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:43.022923] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:43.032947] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:43.042975] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:43.053003] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:43.063029] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:43.073873] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:43.083898] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:43.094278] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:43.105188] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:43.115277] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:43.125305] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:26.777 [2024-04-27 02:37:43.135638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:14864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.777 [2024-04-27 02:37:43.135659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.777 [2024-04-27 02:37:43.135675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:14872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.778 [2024-04-27 02:37:43.135685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.778 [2024-04-27 02:37:43.135696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:14880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.778 [2024-04-27 02:37:43.135706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.778 [2024-04-27 02:37:43.135716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:14888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.778 [2024-04-27 02:37:43.135726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.778 [2024-04-27 02:37:43.135737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:14896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.778 [2024-04-27 02:37:43.135746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.778 [2024-04-27 02:37:43.135757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:14904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.778 [2024-04-27 02:37:43.135766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.778 [2024-04-27 02:37:43.135780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:14912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.778 [2024-04-27 02:37:43.135790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.778 [2024-04-27 02:37:43.135801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:14920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.778 [2024-04-27 02:37:43.135810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.778 [2024-04-27 02:37:43.135821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:14928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.778 [2024-04-27 02:37:43.135830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.778 [2024-04-27 02:37:43.135841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:14936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.778 [2024-04-27 02:37:43.135850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.778 [2024-04-27 02:37:43.135861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:14944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.778 [2024-04-27 02:37:43.135870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.778 [2024-04-27 02:37:43.135881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:14952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.778 [2024-04-27 02:37:43.135890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.778 [2024-04-27 02:37:43.135901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:14960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.778 [2024-04-27 02:37:43.135910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.778 [2024-04-27 02:37:43.135921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:14968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.778 [2024-04-27 02:37:43.135930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.778 [2024-04-27 02:37:43.135941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:14976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.778 [2024-04-27 02:37:43.135950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.778 [2024-04-27 02:37:43.135961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:14984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.778 [2024-04-27 02:37:43.135970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.778 [2024-04-27 02:37:43.135980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:14992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.778 [2024-04-27 02:37:43.135990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.778 [2024-04-27 02:37:43.136001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.778 [2024-04-27 02:37:43.136010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.778 [2024-04-27 02:37:43.136022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:15008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.778 [2024-04-27 02:37:43.136033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.778 [2024-04-27 02:37:43.136044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:15016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.778 [2024-04-27 02:37:43.136054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.778 [2024-04-27 02:37:43.136065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:15024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.778 [2024-04-27 02:37:43.136074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.778 [2024-04-27 02:37:43.136085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:15032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.778 [2024-04-27 02:37:43.136095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.778 [2024-04-27 02:37:43.136106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:15040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.778 [2024-04-27 02:37:43.136116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.778 [2024-04-27 02:37:43.136126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:15048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.778 [2024-04-27 02:37:43.136135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.778 [2024-04-27 02:37:43.136146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:15056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.778 [2024-04-27 02:37:43.136155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.778 [2024-04-27 02:37:43.136167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:15064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.778 [2024-04-27 02:37:43.136176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.778 [2024-04-27 02:37:43.136186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:15072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.778 [2024-04-27 02:37:43.136196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.778 [2024-04-27 02:37:43.136206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:15080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.778 [2024-04-27 02:37:43.136215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.778 [2024-04-27 02:37:43.136227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:15088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.778 [2024-04-27 02:37:43.136236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.778 [2024-04-27 02:37:43.136246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:15096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.778 [2024-04-27 02:37:43.136255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.778 [2024-04-27 02:37:43.136266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:15104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.778 [2024-04-27 02:37:43.136277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.778 [2024-04-27 02:37:43.136288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.778 [2024-04-27 02:37:43.136297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.778 [2024-04-27 02:37:43.136308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:15120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.778 [2024-04-27 02:37:43.136317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.778 [2024-04-27 02:37:43.136328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:15128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.778 [2024-04-27 02:37:43.136343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.778 [2024-04-27 02:37:43.136354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:15136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.778 [2024-04-27 02:37:43.136364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.778 [2024-04-27 02:37:43.136376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.778 [2024-04-27 02:37:43.136386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.778 [2024-04-27 02:37:43.136396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:15152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.778 [2024-04-27 02:37:43.136406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.778 [2024-04-27 02:37:43.136417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:15160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.778 [2024-04-27 02:37:43.136426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.778 [2024-04-27 02:37:43.136437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:15168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.778 [2024-04-27 02:37:43.136446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.778 [2024-04-27 02:37:43.136457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:15176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.778 [2024-04-27 02:37:43.136466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.778 [2024-04-27 02:37:43.136477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:15184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.779 [2024-04-27 02:37:43.136487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.779 [2024-04-27 02:37:43.136497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:15192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.779 [2024-04-27 02:37:43.136506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.779 [2024-04-27 02:37:43.136517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:15200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.779 [2024-04-27 02:37:43.136528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.779 [2024-04-27 02:37:43.136539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:15208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.779 [2024-04-27 02:37:43.136548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.779 [2024-04-27 02:37:43.136559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:15216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.779 [2024-04-27 02:37:43.136568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.779 [2024-04-27 02:37:43.136579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:15224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.779 [2024-04-27 02:37:43.136589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.779 [2024-04-27 02:37:43.136601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:15232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.779 [2024-04-27 02:37:43.136610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.779 [2024-04-27 02:37:43.136621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:15240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.779 [2024-04-27 02:37:43.136630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.779 [2024-04-27 02:37:43.136641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:15248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.779 [2024-04-27 02:37:43.136651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.779 [2024-04-27 02:37:43.136662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:15256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.779 [2024-04-27 02:37:43.136671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.779 [2024-04-27 02:37:43.136682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:15264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.779 [2024-04-27 02:37:43.136691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.779 [2024-04-27 02:37:43.136702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:15272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.779 [2024-04-27 02:37:43.136711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.779 [2024-04-27 02:37:43.136721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:15280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.779 [2024-04-27 02:37:43.136730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.779 [2024-04-27 02:37:43.136741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:15288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.779 [2024-04-27 02:37:43.136751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.779 [2024-04-27 02:37:43.136762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:15296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.779 [2024-04-27 02:37:43.136771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.779 [2024-04-27 02:37:43.136786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:15304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.779 [2024-04-27 02:37:43.136796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.779 [2024-04-27 02:37:43.136806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:15312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.779 [2024-04-27 02:37:43.136816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.779 [2024-04-27 02:37:43.136827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:15320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.779 [2024-04-27 02:37:43.136836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.779 [2024-04-27 02:37:43.136847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:15328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.779 [2024-04-27 02:37:43.136856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.779 [2024-04-27 02:37:43.136867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:15336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.779 [2024-04-27 02:37:43.136877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.779 [2024-04-27 02:37:43.136888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:15344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.779 [2024-04-27 02:37:43.136897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.779 [2024-04-27 02:37:43.136907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:15352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:26.779 [2024-04-27 02:37:43.136916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.779 [2024-04-27 02:37:43.136928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:14336 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007900000 len:0x1000 key:0x1bf0ef 00:19:26.779 [2024-04-27 02:37:43.136938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.779 [2024-04-27 02:37:43.136949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:14344 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007902000 len:0x1000 key:0x1bf0ef 00:19:26.779 [2024-04-27 02:37:43.136958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.779 [2024-04-27 02:37:43.136969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:14352 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007904000 len:0x1000 key:0x1bf0ef 00:19:26.779 [2024-04-27 02:37:43.136978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.779 [2024-04-27 02:37:43.136989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:14360 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007906000 len:0x1000 key:0x1bf0ef 00:19:26.779 [2024-04-27 02:37:43.136999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.779 [2024-04-27 02:37:43.137009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:14368 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007908000 len:0x1000 key:0x1bf0ef 00:19:26.779 [2024-04-27 02:37:43.137020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.779 [2024-04-27 02:37:43.137031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:14376 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000790a000 len:0x1000 key:0x1bf0ef 00:19:26.779 [2024-04-27 02:37:43.137040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.779 [2024-04-27 02:37:43.137052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:14384 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000790c000 len:0x1000 key:0x1bf0ef 00:19:26.779 [2024-04-27 02:37:43.137061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.779 [2024-04-27 02:37:43.137071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:14392 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000790e000 len:0x1000 key:0x1bf0ef 00:19:26.779 [2024-04-27 02:37:43.137080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.779 [2024-04-27 02:37:43.137091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:14400 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007910000 len:0x1000 key:0x1bf0ef 00:19:26.779 [2024-04-27 02:37:43.137100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.779 [2024-04-27 02:37:43.137112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:14408 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007912000 len:0x1000 key:0x1bf0ef 00:19:26.779 [2024-04-27 02:37:43.137121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.779 [2024-04-27 02:37:43.137133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14416 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007914000 len:0x1000 key:0x1bf0ef 00:19:26.779 [2024-04-27 02:37:43.137142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.779 [2024-04-27 02:37:43.137153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:14424 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007916000 len:0x1000 key:0x1bf0ef 00:19:26.779 [2024-04-27 02:37:43.137162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.779 [2024-04-27 02:37:43.137173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:14432 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007918000 len:0x1000 key:0x1bf0ef 00:19:26.779 [2024-04-27 02:37:43.137182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.779 [2024-04-27 02:37:43.137193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:14440 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000791a000 len:0x1000 key:0x1bf0ef 00:19:26.779 [2024-04-27 02:37:43.137202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.779 [2024-04-27 02:37:43.137213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:14448 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000791c000 len:0x1000 key:0x1bf0ef 00:19:26.779 [2024-04-27 02:37:43.137222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.779 [2024-04-27 02:37:43.137233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:14456 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000791e000 len:0x1000 key:0x1bf0ef 00:19:26.779 [2024-04-27 02:37:43.137242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.780 [2024-04-27 02:37:43.137254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:14464 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007920000 len:0x1000 key:0x1bf0ef 00:19:26.780 [2024-04-27 02:37:43.137263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.780 [2024-04-27 02:37:43.137274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:14472 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007922000 len:0x1000 key:0x1bf0ef 00:19:26.780 [2024-04-27 02:37:43.137284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.780 [2024-04-27 02:37:43.137295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:14480 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007924000 len:0x1000 key:0x1bf0ef 00:19:26.780 [2024-04-27 02:37:43.137304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.780 [2024-04-27 02:37:43.137315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:14488 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007926000 len:0x1000 key:0x1bf0ef 00:19:26.780 [2024-04-27 02:37:43.137324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.780 [2024-04-27 02:37:43.137335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:14496 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007928000 len:0x1000 key:0x1bf0ef 00:19:26.780 [2024-04-27 02:37:43.137348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.780 [2024-04-27 02:37:43.137359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:14504 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000792a000 len:0x1000 key:0x1bf0ef 00:19:26.780 [2024-04-27 02:37:43.137369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.780 [2024-04-27 02:37:43.137380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:14512 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000792c000 len:0x1000 key:0x1bf0ef 00:19:26.780 [2024-04-27 02:37:43.137389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.780 [2024-04-27 02:37:43.137400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:14520 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000792e000 len:0x1000 key:0x1bf0ef 00:19:26.780 [2024-04-27 02:37:43.137409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.780 [2024-04-27 02:37:43.137420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:14528 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007930000 len:0x1000 key:0x1bf0ef 00:19:26.780 [2024-04-27 02:37:43.137429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.780 [2024-04-27 02:37:43.137440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:14536 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007932000 len:0x1000 key:0x1bf0ef 00:19:26.780 [2024-04-27 02:37:43.137449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.780 [2024-04-27 02:37:43.137460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:14544 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007934000 len:0x1000 key:0x1bf0ef 00:19:26.780 [2024-04-27 02:37:43.137470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.780 [2024-04-27 02:37:43.137483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:14552 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007936000 len:0x1000 key:0x1bf0ef 00:19:26.780 [2024-04-27 02:37:43.137492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.780 [2024-04-27 02:37:43.137503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:14560 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007938000 len:0x1000 key:0x1bf0ef 00:19:26.780 [2024-04-27 02:37:43.137512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.780 [2024-04-27 02:37:43.137523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:14568 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000793a000 len:0x1000 key:0x1bf0ef 00:19:26.780 [2024-04-27 02:37:43.137533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.780 [2024-04-27 02:37:43.137544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:14576 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000793c000 len:0x1000 key:0x1bf0ef 00:19:26.780 [2024-04-27 02:37:43.137553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.780 [2024-04-27 02:37:43.137564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:14584 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000793e000 len:0x1000 key:0x1bf0ef 00:19:26.780 [2024-04-27 02:37:43.137573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.780 [2024-04-27 02:37:43.137584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:14592 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007940000 len:0x1000 key:0x1bf0ef 00:19:26.780 [2024-04-27 02:37:43.137594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.780 [2024-04-27 02:37:43.137605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:14600 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007942000 len:0x1000 key:0x1bf0ef 00:19:26.780 [2024-04-27 02:37:43.137614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.780 [2024-04-27 02:37:43.137625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:14608 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007944000 len:0x1000 key:0x1bf0ef 00:19:26.780 [2024-04-27 02:37:43.137634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.780 [2024-04-27 02:37:43.137645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:14616 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007946000 len:0x1000 key:0x1bf0ef 00:19:26.780 [2024-04-27 02:37:43.137655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.780 [2024-04-27 02:37:43.137666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:14624 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007948000 len:0x1000 key:0x1bf0ef 00:19:26.780 [2024-04-27 02:37:43.137675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.780 [2024-04-27 02:37:43.137686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:14632 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000794a000 len:0x1000 key:0x1bf0ef 00:19:26.780 [2024-04-27 02:37:43.137695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.780 [2024-04-27 02:37:43.137706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:14640 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000794c000 len:0x1000 key:0x1bf0ef 00:19:26.780 [2024-04-27 02:37:43.137716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.780 [2024-04-27 02:37:43.137728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:14648 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000794e000 len:0x1000 key:0x1bf0ef 00:19:26.780 [2024-04-27 02:37:43.137737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.780 [2024-04-27 02:37:43.137748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:14656 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007950000 len:0x1000 key:0x1bf0ef 00:19:26.780 [2024-04-27 02:37:43.137757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.780 [2024-04-27 02:37:43.137768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:14664 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007952000 len:0x1000 key:0x1bf0ef 00:19:26.780 [2024-04-27 02:37:43.137777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.780 [2024-04-27 02:37:43.137788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:14672 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007954000 len:0x1000 key:0x1bf0ef 00:19:26.780 [2024-04-27 02:37:43.137798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.780 [2024-04-27 02:37:43.137808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:14680 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007956000 len:0x1000 key:0x1bf0ef 00:19:26.780 [2024-04-27 02:37:43.137818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.780 [2024-04-27 02:37:43.137829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:14688 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007958000 len:0x1000 key:0x1bf0ef 00:19:26.780 [2024-04-27 02:37:43.137839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.780 [2024-04-27 02:37:43.137850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:14696 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000795a000 len:0x1000 key:0x1bf0ef 00:19:26.780 [2024-04-27 02:37:43.137859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.780 [2024-04-27 02:37:43.137870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:14704 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000795c000 len:0x1000 key:0x1bf0ef 00:19:26.780 [2024-04-27 02:37:43.137879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.780 [2024-04-27 02:37:43.137890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:14712 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000795e000 len:0x1000 key:0x1bf0ef 00:19:26.780 [2024-04-27 02:37:43.137899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.781 [2024-04-27 02:37:43.137910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:14720 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007960000 len:0x1000 key:0x1bf0ef 00:19:26.781 [2024-04-27 02:37:43.137919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.781 [2024-04-27 02:37:43.137930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:14728 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007962000 len:0x1000 key:0x1bf0ef 00:19:26.781 [2024-04-27 02:37:43.137940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.781 [2024-04-27 02:37:43.137951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:14736 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007964000 len:0x1000 key:0x1bf0ef 00:19:26.781 [2024-04-27 02:37:43.137960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.781 [2024-04-27 02:37:43.137971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:14744 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007966000 len:0x1000 key:0x1bf0ef 00:19:26.781 [2024-04-27 02:37:43.137980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.781 [2024-04-27 02:37:43.137991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:14752 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007968000 len:0x1000 key:0x1bf0ef 00:19:26.781 [2024-04-27 02:37:43.138000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.781 [2024-04-27 02:37:43.138011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:14760 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000796a000 len:0x1000 key:0x1bf0ef 00:19:26.781 [2024-04-27 02:37:43.138021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.781 [2024-04-27 02:37:43.138032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:14768 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000796c000 len:0x1000 key:0x1bf0ef 00:19:26.781 [2024-04-27 02:37:43.138041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.781 [2024-04-27 02:37:43.138052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:14776 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000796e000 len:0x1000 key:0x1bf0ef 00:19:26.781 [2024-04-27 02:37:43.138061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.781 [2024-04-27 02:37:43.138072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:14784 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007970000 len:0x1000 key:0x1bf0ef 00:19:26.781 [2024-04-27 02:37:43.138082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.781 [2024-04-27 02:37:43.138093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:14792 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007972000 len:0x1000 key:0x1bf0ef 00:19:26.781 [2024-04-27 02:37:43.138102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.781 [2024-04-27 02:37:43.138112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:14800 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007974000 len:0x1000 key:0x1bf0ef 00:19:26.781 [2024-04-27 02:37:43.138121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.781 [2024-04-27 02:37:43.138132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:14808 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007976000 len:0x1000 key:0x1bf0ef 00:19:26.781 [2024-04-27 02:37:43.138142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.781 [2024-04-27 02:37:43.138152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:14816 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007978000 len:0x1000 key:0x1bf0ef 00:19:26.781 [2024-04-27 02:37:43.138162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.781 [2024-04-27 02:37:43.138174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:14824 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000797a000 len:0x1000 key:0x1bf0ef 00:19:26.781 [2024-04-27 02:37:43.138184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.781 [2024-04-27 02:37:43.138195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:14832 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000797c000 len:0x1000 key:0x1bf0ef 00:19:26.781 [2024-04-27 02:37:43.138204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.781 [2024-04-27 02:37:43.138215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:14840 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000797e000 len:0x1000 key:0x1bf0ef 00:19:26.781 [2024-04-27 02:37:43.138224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.781 [2024-04-27 02:37:43.138235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:14848 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007980000 len:0x1000 key:0x1bf0ef 00:19:26.781 [2024-04-27 02:37:43.138247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32615 cdw0:a18378a0 sqhd:1530 p:0 m:0 dnr:0 00:19:26.781 [2024-04-27 02:37:43.151258] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:19:26.781 [2024-04-27 02:37:43.151274] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:19:26.781 [2024-04-27 02:37:43.151283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14856 len:8 PRP1 0x0 PRP2 0x0 00:19:26.781 [2024-04-27 02:37:43.151293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:19:26.781 [2024-04-27 02:37:43.151351] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:19:26.781 [2024-04-27 02:37:43.151619] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:19:26.781 [2024-04-27 02:37:43.151633] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:19:26.781 [2024-04-27 02:37:43.151640] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:19:26.781 [2024-04-27 02:37:43.151659] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:19:26.781 [2024-04-27 02:37:43.151669] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:19:26.781 [2024-04-27 02:37:43.151681] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:19:26.781 [2024-04-27 02:37:43.151690] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:19:26.781 [2024-04-27 02:37:43.151700] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:19:26.781 [2024-04-27 02:37:43.151719] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:19:26.781 [2024-04-27 02:37:43.151728] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:19:26.781 [2024-04-27 02:37:44.155021] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:19:26.781 [2024-04-27 02:37:44.155057] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:19:26.781 [2024-04-27 02:37:44.155066] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:19:26.781 [2024-04-27 02:37:44.155092] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:19:26.781 [2024-04-27 02:37:44.155103] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:19:26.781 [2024-04-27 02:37:44.155115] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:19:26.781 [2024-04-27 02:37:44.155124] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:19:26.781 [2024-04-27 02:37:44.155134] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:19:26.781 [2024-04-27 02:37:44.155157] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:19:26.781 [2024-04-27 02:37:44.155167] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:19:26.781 [2024-04-27 02:37:45.158305] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:19:26.781 [2024-04-27 02:37:45.158350] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:19:26.781 [2024-04-27 02:37:45.158359] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:19:26.781 [2024-04-27 02:37:45.158381] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:19:26.781 [2024-04-27 02:37:45.158392] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:19:26.781 [2024-04-27 02:37:45.158405] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:19:26.781 [2024-04-27 02:37:45.158414] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:19:26.781 [2024-04-27 02:37:45.158424] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:19:26.781 [2024-04-27 02:37:45.158447] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:19:26.781 [2024-04-27 02:37:45.158456] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:19:26.781 [2024-04-27 02:37:47.164422] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:19:26.781 [2024-04-27 02:37:47.164463] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:19:26.781 [2024-04-27 02:37:47.164489] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:19:26.781 [2024-04-27 02:37:47.164500] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:19:26.781 [2024-04-27 02:37:47.164937] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:19:26.781 [2024-04-27 02:37:47.164949] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:19:26.781 [2024-04-27 02:37:47.164959] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:19:26.781 [2024-04-27 02:37:47.164978] bdev_nvme.c:2872:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Reset is already in progress. Defer failover until reset completes. 00:19:26.781 [2024-04-27 02:37:47.165022] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:19:26.781 [2024-04-27 02:37:47.165054] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:19:26.781 [2024-04-27 02:37:48.168193] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:19:26.781 [2024-04-27 02:37:48.168231] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:19:26.781 [2024-04-27 02:37:48.168257] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:19:26.782 [2024-04-27 02:37:48.168272] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:19:26.782 [2024-04-27 02:37:48.169101] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:19:26.782 [2024-04-27 02:37:48.169114] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:19:26.782 [2024-04-27 02:37:48.169125] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:19:26.782 [2024-04-27 02:37:48.169489] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:19:26.782 [2024-04-27 02:37:48.169503] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:19:26.782 [2024-04-27 02:37:50.174514] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:19:26.782 [2024-04-27 02:37:50.174562] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:19:26.782 [2024-04-27 02:37:50.174588] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:19:26.782 [2024-04-27 02:37:50.174600] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:19:26.782 [2024-04-27 02:37:50.174982] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:19:26.782 [2024-04-27 02:37:50.174994] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:19:26.782 [2024-04-27 02:37:50.175004] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:19:26.782 [2024-04-27 02:37:50.175089] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:19:26.782 [2024-04-27 02:37:50.175100] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:19:26.782 [2024-04-27 02:37:52.181093] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:19:26.782 [2024-04-27 02:37:52.181128] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:19:26.782 [2024-04-27 02:37:52.181154] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:19:26.782 [2024-04-27 02:37:52.181166] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:19:26.782 [2024-04-27 02:37:52.182050] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:19:26.782 [2024-04-27 02:37:52.182065] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:19:26.782 [2024-04-27 02:37:52.182075] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:19:26.782 [2024-04-27 02:37:52.182114] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:19:26.782 [2024-04-27 02:37:52.182124] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:19:26.782 [2024-04-27 02:37:53.236513] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:19:26.782 00:19:26.782 Latency(us) 00:19:26.782 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:26.782 Job: Nvme_mlx_0_0n1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:19:26.782 Verification LBA range: start 0x0 length 0x8000 00:19:26.782 Nvme_mlx_0_0n1 : 90.01 11015.29 43.03 0.00 0.00 11598.08 2137.04 11087551.44 00:19:26.782 Job: Nvme_mlx_0_1n1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:19:26.782 Verification LBA range: start 0x0 length 0x8000 00:19:26.782 Nvme_mlx_0_1n1 : 90.01 9456.80 36.94 0.00 0.00 13517.56 2350.75 12079595.52 00:19:26.782 =================================================================================================================== 00:19:26.782 Total : 20472.09 79.97 0.00 0.00 12484.75 2137.04 12079595.52 00:19:26.782 Received shutdown signal, test time was about 90.000000 seconds 00:19:26.782 00:19:26.782 Latency(us) 00:19:26.782 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:26.782 =================================================================================================================== 00:19:26.782 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:19:26.782 02:38:57 -- target/device_removal.sh@123 -- # trap - SIGINT SIGTERM EXIT 00:19:26.782 02:38:57 -- target/device_removal.sh@124 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/try.txt 00:19:26.782 02:38:57 -- target/device_removal.sh@202 -- # killprocess 1570998 00:19:26.782 02:38:57 -- common/autotest_common.sh@936 -- # '[' -z 1570998 ']' 00:19:26.782 02:38:57 -- common/autotest_common.sh@940 -- # kill -0 1570998 00:19:26.782 02:38:57 -- common/autotest_common.sh@941 -- # uname 00:19:26.782 02:38:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:26.782 02:38:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1570998 00:19:26.782 02:38:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:26.782 02:38:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:26.782 02:38:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1570998' 00:19:26.782 killing process with pid 1570998 00:19:26.782 02:38:57 -- common/autotest_common.sh@955 -- # kill 1570998 00:19:26.782 02:38:57 -- common/autotest_common.sh@960 -- # wait 1570998 00:19:26.782 [2024-04-27 02:38:57.603405] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:19:26.782 02:38:57 -- target/device_removal.sh@203 -- # nvmfpid= 00:19:26.782 02:38:57 -- target/device_removal.sh@205 -- # return 0 00:19:26.782 00:19:26.782 real 1m33.381s 00:19:26.782 user 4m25.488s 00:19:26.782 sys 0m4.771s 00:19:26.782 02:38:57 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:19:26.782 02:38:57 -- common/autotest_common.sh@10 -- # set +x 00:19:26.782 ************************************ 00:19:26.782 END TEST nvmf_device_removal_pci_remove 00:19:26.782 ************************************ 00:19:26.782 02:38:57 -- target/device_removal.sh@317 -- # nvmftestfini 00:19:26.782 02:38:57 -- nvmf/common.sh@477 -- # nvmfcleanup 00:19:26.782 02:38:57 -- nvmf/common.sh@117 -- # sync 00:19:26.782 02:38:57 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:19:26.782 02:38:57 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:19:26.782 02:38:57 -- nvmf/common.sh@120 -- # set +e 00:19:26.782 02:38:57 -- nvmf/common.sh@121 -- # for i in {1..20} 00:19:26.782 02:38:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:19:26.782 rmmod nvme_rdma 00:19:26.782 rmmod nvme_fabrics 00:19:26.782 02:38:57 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:19:26.782 02:38:57 -- nvmf/common.sh@124 -- # set -e 00:19:26.782 02:38:57 -- nvmf/common.sh@125 -- # return 0 00:19:26.782 02:38:57 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:19:26.782 02:38:57 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:19:26.782 02:38:57 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:19:26.782 02:38:57 -- target/device_removal.sh@318 -- # clean_bond_device 00:19:26.782 02:38:57 -- target/device_removal.sh@240 -- # ip link 00:19:26.782 02:38:57 -- target/device_removal.sh@240 -- # grep bond_nvmf 00:19:26.782 00:19:26.782 real 3m13.470s 00:19:26.782 user 8m52.828s 00:19:26.782 sys 0m14.347s 00:19:26.782 02:38:57 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:19:26.782 02:38:57 -- common/autotest_common.sh@10 -- # set +x 00:19:26.782 ************************************ 00:19:26.782 END TEST nvmf_device_removal 00:19:26.782 ************************************ 00:19:26.782 02:38:58 -- nvmf/nvmf.sh@79 -- # run_test nvmf_srq_overwhelm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/srq_overwhelm.sh --transport=rdma 00:19:26.782 02:38:58 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:26.782 02:38:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:26.782 02:38:58 -- common/autotest_common.sh@10 -- # set +x 00:19:26.782 ************************************ 00:19:26.782 START TEST nvmf_srq_overwhelm 00:19:26.782 ************************************ 00:19:26.782 02:38:58 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/srq_overwhelm.sh --transport=rdma 00:19:26.782 * Looking for test storage... 00:19:26.782 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:19:26.782 02:38:58 -- target/srq_overwhelm.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:19:26.782 02:38:58 -- nvmf/common.sh@7 -- # uname -s 00:19:26.782 02:38:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:26.782 02:38:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:26.782 02:38:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:26.782 02:38:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:26.782 02:38:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:26.782 02:38:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:26.782 02:38:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:26.782 02:38:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:26.782 02:38:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:26.782 02:38:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:26.782 02:38:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:19:26.782 02:38:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:19:26.782 02:38:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:26.782 02:38:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:26.782 02:38:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:26.782 02:38:58 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:19:26.782 02:38:58 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:19:26.782 02:38:58 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:26.782 02:38:58 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:26.782 02:38:58 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:26.782 02:38:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:26.782 02:38:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:26.783 02:38:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:26.783 02:38:58 -- paths/export.sh@5 -- # export PATH 00:19:26.783 02:38:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:26.783 02:38:58 -- nvmf/common.sh@47 -- # : 0 00:19:26.783 02:38:58 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:19:26.783 02:38:58 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:19:26.783 02:38:58 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:19:26.783 02:38:58 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:26.783 02:38:58 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:26.783 02:38:58 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:19:26.783 02:38:58 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:19:26.783 02:38:58 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:19:26.783 02:38:58 -- target/srq_overwhelm.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:26.783 02:38:58 -- target/srq_overwhelm.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:26.783 02:38:58 -- target/srq_overwhelm.sh@13 -- # NVME_CONNECT='nvme connect -i 16' 00:19:26.783 02:38:58 -- target/srq_overwhelm.sh@15 -- # nvmftestinit 00:19:26.783 02:38:58 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:19:26.783 02:38:58 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:26.783 02:38:58 -- nvmf/common.sh@437 -- # prepare_net_devs 00:19:26.783 02:38:58 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:19:26.783 02:38:58 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:19:26.783 02:38:58 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:26.783 02:38:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:26.783 02:38:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:26.783 02:38:58 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:19:26.783 02:38:58 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:19:26.783 02:38:58 -- nvmf/common.sh@285 -- # xtrace_disable 00:19:26.783 02:38:58 -- common/autotest_common.sh@10 -- # set +x 00:19:30.971 02:39:03 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:30.971 02:39:03 -- nvmf/common.sh@291 -- # pci_devs=() 00:19:30.971 02:39:03 -- nvmf/common.sh@291 -- # local -a pci_devs 00:19:30.971 02:39:03 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:19:30.971 02:39:03 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:19:30.971 02:39:03 -- nvmf/common.sh@293 -- # pci_drivers=() 00:19:30.971 02:39:03 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:19:30.971 02:39:03 -- nvmf/common.sh@295 -- # net_devs=() 00:19:30.971 02:39:03 -- nvmf/common.sh@295 -- # local -ga net_devs 00:19:30.971 02:39:03 -- nvmf/common.sh@296 -- # e810=() 00:19:30.971 02:39:03 -- nvmf/common.sh@296 -- # local -ga e810 00:19:30.971 02:39:03 -- nvmf/common.sh@297 -- # x722=() 00:19:30.971 02:39:03 -- nvmf/common.sh@297 -- # local -ga x722 00:19:30.971 02:39:03 -- nvmf/common.sh@298 -- # mlx=() 00:19:30.971 02:39:03 -- nvmf/common.sh@298 -- # local -ga mlx 00:19:30.971 02:39:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:30.971 02:39:03 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:30.971 02:39:03 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:30.971 02:39:03 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:30.971 02:39:03 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:30.971 02:39:03 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:30.971 02:39:03 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:30.971 02:39:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:30.971 02:39:03 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:30.971 02:39:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:30.971 02:39:03 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:30.971 02:39:03 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:19:30.971 02:39:03 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:19:30.971 02:39:03 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:19:30.971 02:39:03 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:19:30.971 02:39:03 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:19:30.971 02:39:03 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:19:30.971 02:39:03 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:19:30.971 02:39:03 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:30.971 02:39:03 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:19:30.971 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:19:30.971 02:39:03 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:19:30.971 02:39:03 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:19:30.971 02:39:03 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:19:30.971 02:39:03 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:19:30.971 02:39:03 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:30.971 02:39:03 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:30.971 02:39:03 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:30.971 02:39:03 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:19:30.971 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:19:30.971 02:39:03 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:19:30.971 02:39:03 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:19:30.971 02:39:03 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:19:30.971 02:39:03 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:19:30.971 02:39:03 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:30.971 02:39:03 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:30.971 02:39:03 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:19:30.971 02:39:03 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:19:30.971 02:39:03 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:30.971 02:39:03 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:30.971 02:39:03 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:30.971 02:39:03 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:30.971 02:39:03 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:19:30.971 Found net devices under 0000:18:00.0: mlx_0_0 00:19:30.971 02:39:03 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:30.971 02:39:03 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:30.971 02:39:03 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:30.971 02:39:03 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:30.971 02:39:03 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:30.971 02:39:03 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:19:30.971 Found net devices under 0000:18:00.1: mlx_0_1 00:19:30.971 02:39:03 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:30.971 02:39:03 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:19:30.971 02:39:03 -- nvmf/common.sh@403 -- # is_hw=yes 00:19:30.971 02:39:03 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:19:30.971 02:39:03 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:19:30.971 02:39:03 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:19:30.971 02:39:03 -- nvmf/common.sh@409 -- # rdma_device_init 00:19:30.971 02:39:03 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:19:30.971 02:39:03 -- nvmf/common.sh@58 -- # uname 00:19:30.971 02:39:03 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:19:30.971 02:39:03 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:19:30.971 02:39:03 -- nvmf/common.sh@63 -- # modprobe ib_core 00:19:30.971 02:39:03 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:19:30.971 02:39:03 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:19:30.971 02:39:03 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:19:30.971 02:39:03 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:19:30.971 02:39:03 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:19:30.971 02:39:03 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:19:30.971 02:39:03 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:19:30.971 02:39:03 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:19:30.971 02:39:03 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:30.971 02:39:03 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:30.971 02:39:03 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:30.971 02:39:03 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:30.971 02:39:03 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:30.971 02:39:03 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:30.971 02:39:03 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:30.971 02:39:03 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:19:30.971 02:39:03 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:19:30.971 02:39:03 -- nvmf/common.sh@105 -- # continue 2 00:19:30.971 02:39:03 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:30.971 02:39:03 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:30.971 02:39:03 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:19:30.971 02:39:03 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:30.971 02:39:03 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:19:30.971 02:39:03 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:19:30.971 02:39:03 -- nvmf/common.sh@105 -- # continue 2 00:19:30.971 02:39:03 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:30.971 02:39:03 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:19:30.971 02:39:03 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:19:30.971 02:39:03 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:19:30.971 02:39:03 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:30.971 02:39:03 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:30.971 02:39:03 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:19:30.971 02:39:03 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:19:30.971 02:39:03 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:19:30.971 64: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:19:30.971 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:19:30.971 altname enp24s0f0np0 00:19:30.971 altname ens785f0np0 00:19:30.971 inet 192.168.100.8/24 scope global mlx_0_0 00:19:30.971 valid_lft forever preferred_lft forever 00:19:30.971 02:39:03 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:30.971 02:39:03 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:19:30.971 02:39:03 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:19:30.971 02:39:03 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:19:30.971 02:39:03 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:30.971 02:39:03 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:30.971 02:39:03 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:19:30.971 02:39:03 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:19:30.971 02:39:03 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:19:30.971 65: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:19:30.971 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:19:30.971 altname enp24s0f1np1 00:19:30.971 altname ens785f1np1 00:19:30.971 inet 192.168.100.9/24 scope global mlx_0_1 00:19:30.971 valid_lft forever preferred_lft forever 00:19:30.971 02:39:03 -- nvmf/common.sh@411 -- # return 0 00:19:30.971 02:39:03 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:19:30.971 02:39:03 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:19:30.971 02:39:03 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:19:30.971 02:39:03 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:19:30.971 02:39:03 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:19:30.971 02:39:03 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:30.971 02:39:03 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:30.971 02:39:03 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:30.971 02:39:03 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:30.971 02:39:03 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:30.971 02:39:03 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:30.971 02:39:03 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:30.971 02:39:03 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:19:30.971 02:39:03 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:19:30.971 02:39:03 -- nvmf/common.sh@105 -- # continue 2 00:19:30.971 02:39:03 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:30.971 02:39:03 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:30.971 02:39:03 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:19:30.972 02:39:03 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:30.972 02:39:03 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:19:30.972 02:39:03 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:19:30.972 02:39:03 -- nvmf/common.sh@105 -- # continue 2 00:19:30.972 02:39:03 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:30.972 02:39:03 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:19:30.972 02:39:03 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:19:30.972 02:39:03 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:19:30.972 02:39:03 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:30.972 02:39:03 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:30.972 02:39:03 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:30.972 02:39:03 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:19:30.972 02:39:03 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:19:30.972 02:39:03 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:19:30.972 02:39:03 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:30.972 02:39:03 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:30.972 02:39:03 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:19:30.972 192.168.100.9' 00:19:30.972 02:39:03 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:19:30.972 192.168.100.9' 00:19:30.972 02:39:03 -- nvmf/common.sh@446 -- # head -n 1 00:19:30.972 02:39:03 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:19:30.972 02:39:03 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:19:30.972 192.168.100.9' 00:19:30.972 02:39:03 -- nvmf/common.sh@447 -- # head -n 1 00:19:30.972 02:39:03 -- nvmf/common.sh@447 -- # tail -n +2 00:19:30.972 02:39:03 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:19:30.972 02:39:03 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:19:30.972 02:39:03 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:19:30.972 02:39:03 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:19:30.972 02:39:03 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:19:30.972 02:39:03 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:19:30.972 02:39:03 -- target/srq_overwhelm.sh@17 -- # nvmfappstart -m 0xF 00:19:30.972 02:39:03 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:19:30.972 02:39:03 -- common/autotest_common.sh@710 -- # xtrace_disable 00:19:30.972 02:39:03 -- common/autotest_common.sh@10 -- # set +x 00:19:30.972 02:39:03 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:30.972 02:39:03 -- nvmf/common.sh@470 -- # nvmfpid=1586311 00:19:30.972 02:39:03 -- nvmf/common.sh@471 -- # waitforlisten 1586311 00:19:30.972 02:39:03 -- common/autotest_common.sh@817 -- # '[' -z 1586311 ']' 00:19:30.972 02:39:03 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:30.972 02:39:03 -- common/autotest_common.sh@822 -- # local max_retries=100 00:19:30.972 02:39:03 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:30.972 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:30.972 02:39:03 -- common/autotest_common.sh@826 -- # xtrace_disable 00:19:30.972 02:39:03 -- common/autotest_common.sh@10 -- # set +x 00:19:30.972 [2024-04-27 02:39:03.994225] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:19:30.972 [2024-04-27 02:39:03.994280] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:30.972 EAL: No free 2048 kB hugepages reported on node 1 00:19:30.972 [2024-04-27 02:39:04.066905] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:30.972 [2024-04-27 02:39:04.164510] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:30.972 [2024-04-27 02:39:04.164548] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:30.972 [2024-04-27 02:39:04.164558] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:19:30.972 [2024-04-27 02:39:04.164567] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:19:30.972 [2024-04-27 02:39:04.164575] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:30.972 [2024-04-27 02:39:04.164628] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:30.972 [2024-04-27 02:39:04.164645] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:30.972 [2024-04-27 02:39:04.164738] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:30.972 [2024-04-27 02:39:04.164739] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:31.230 02:39:04 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:19:31.230 02:39:04 -- common/autotest_common.sh@850 -- # return 0 00:19:31.230 02:39:04 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:19:31.230 02:39:04 -- common/autotest_common.sh@716 -- # xtrace_disable 00:19:31.230 02:39:04 -- common/autotest_common.sh@10 -- # set +x 00:19:31.489 02:39:04 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:31.489 02:39:04 -- target/srq_overwhelm.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -s 1024 00:19:31.489 02:39:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:31.489 02:39:04 -- common/autotest_common.sh@10 -- # set +x 00:19:31.489 [2024-04-27 02:39:04.907378] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x221b4d0/0x221f9c0) succeed. 00:19:31.489 [2024-04-27 02:39:04.917908] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x221cb10/0x2261050) succeed. 00:19:31.489 02:39:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:31.489 02:39:04 -- target/srq_overwhelm.sh@22 -- # seq 0 5 00:19:31.489 02:39:04 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:19:31.489 02:39:04 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK00000000000000 00:19:31.489 02:39:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:31.489 02:39:04 -- common/autotest_common.sh@10 -- # set +x 00:19:31.489 02:39:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:31.489 02:39:04 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:31.489 02:39:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:31.489 02:39:04 -- common/autotest_common.sh@10 -- # set +x 00:19:31.489 Malloc0 00:19:31.489 02:39:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:31.489 02:39:05 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Malloc0 00:19:31.489 02:39:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:31.489 02:39:05 -- common/autotest_common.sh@10 -- # set +x 00:19:31.489 02:39:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:31.489 02:39:05 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:19:31.489 02:39:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:31.489 02:39:05 -- common/autotest_common.sh@10 -- # set +x 00:19:31.490 [2024-04-27 02:39:05.022495] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:19:31.490 02:39:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:31.490 02:39:05 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode0 -a 192.168.100.8 -s 4420 00:19:32.429 02:39:06 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme0n1 00:19:32.429 02:39:06 -- common/autotest_common.sh@1221 -- # local i=0 00:19:32.429 02:39:06 -- common/autotest_common.sh@1222 -- # lsblk -l -o NAME 00:19:32.429 02:39:06 -- common/autotest_common.sh@1222 -- # grep -q -w nvme0n1 00:19:32.429 02:39:06 -- common/autotest_common.sh@1228 -- # lsblk -l -o NAME 00:19:32.429 02:39:06 -- common/autotest_common.sh@1228 -- # grep -q -w nvme0n1 00:19:32.429 02:39:06 -- common/autotest_common.sh@1232 -- # return 0 00:19:32.429 02:39:06 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:19:32.429 02:39:06 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:32.429 02:39:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:32.429 02:39:06 -- common/autotest_common.sh@10 -- # set +x 00:19:32.688 02:39:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:32.688 02:39:06 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:19:32.688 02:39:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:32.688 02:39:06 -- common/autotest_common.sh@10 -- # set +x 00:19:32.688 Malloc1 00:19:32.688 02:39:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:32.688 02:39:06 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:19:32.688 02:39:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:32.688 02:39:06 -- common/autotest_common.sh@10 -- # set +x 00:19:32.688 02:39:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:32.688 02:39:06 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:19:32.688 02:39:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:32.688 02:39:06 -- common/autotest_common.sh@10 -- # set +x 00:19:32.688 02:39:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:32.688 02:39:06 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:19:33.626 02:39:07 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme1n1 00:19:33.626 02:39:07 -- common/autotest_common.sh@1221 -- # local i=0 00:19:33.626 02:39:07 -- common/autotest_common.sh@1222 -- # lsblk -l -o NAME 00:19:33.626 02:39:07 -- common/autotest_common.sh@1222 -- # grep -q -w nvme1n1 00:19:33.626 02:39:07 -- common/autotest_common.sh@1228 -- # lsblk -l -o NAME 00:19:33.626 02:39:07 -- common/autotest_common.sh@1228 -- # grep -q -w nvme1n1 00:19:33.626 02:39:07 -- common/autotest_common.sh@1232 -- # return 0 00:19:33.626 02:39:07 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:19:33.626 02:39:07 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:19:33.626 02:39:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:33.626 02:39:07 -- common/autotest_common.sh@10 -- # set +x 00:19:33.626 02:39:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:33.626 02:39:07 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:19:33.626 02:39:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:33.626 02:39:07 -- common/autotest_common.sh@10 -- # set +x 00:19:33.626 Malloc2 00:19:33.626 02:39:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:33.626 02:39:07 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:19:33.626 02:39:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:33.626 02:39:07 -- common/autotest_common.sh@10 -- # set +x 00:19:33.626 02:39:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:33.626 02:39:07 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t rdma -a 192.168.100.8 -s 4420 00:19:33.626 02:39:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:33.626 02:39:07 -- common/autotest_common.sh@10 -- # set +x 00:19:33.626 02:39:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:33.626 02:39:07 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode2 -a 192.168.100.8 -s 4420 00:19:34.564 02:39:08 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme2n1 00:19:34.564 02:39:08 -- common/autotest_common.sh@1221 -- # local i=0 00:19:34.564 02:39:08 -- common/autotest_common.sh@1222 -- # lsblk -l -o NAME 00:19:34.564 02:39:08 -- common/autotest_common.sh@1222 -- # grep -q -w nvme2n1 00:19:34.564 02:39:08 -- common/autotest_common.sh@1228 -- # lsblk -l -o NAME 00:19:34.564 02:39:08 -- common/autotest_common.sh@1228 -- # grep -q -w nvme2n1 00:19:34.564 02:39:08 -- common/autotest_common.sh@1232 -- # return 0 00:19:34.564 02:39:08 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:19:34.564 02:39:08 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:19:34.564 02:39:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:34.564 02:39:08 -- common/autotest_common.sh@10 -- # set +x 00:19:34.564 02:39:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:34.564 02:39:08 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:19:34.564 02:39:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:34.564 02:39:08 -- common/autotest_common.sh@10 -- # set +x 00:19:34.564 Malloc3 00:19:34.564 02:39:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:34.564 02:39:08 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:19:34.564 02:39:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:34.564 02:39:08 -- common/autotest_common.sh@10 -- # set +x 00:19:34.564 02:39:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:34.564 02:39:08 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t rdma -a 192.168.100.8 -s 4420 00:19:34.564 02:39:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:34.564 02:39:08 -- common/autotest_common.sh@10 -- # set +x 00:19:34.564 02:39:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:34.564 02:39:08 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode3 -a 192.168.100.8 -s 4420 00:19:35.946 02:39:09 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme3n1 00:19:35.946 02:39:09 -- common/autotest_common.sh@1221 -- # local i=0 00:19:35.946 02:39:09 -- common/autotest_common.sh@1222 -- # lsblk -l -o NAME 00:19:35.946 02:39:09 -- common/autotest_common.sh@1222 -- # grep -q -w nvme3n1 00:19:35.946 02:39:09 -- common/autotest_common.sh@1228 -- # grep -q -w nvme3n1 00:19:35.946 02:39:09 -- common/autotest_common.sh@1228 -- # lsblk -l -o NAME 00:19:35.946 02:39:09 -- common/autotest_common.sh@1232 -- # return 0 00:19:35.946 02:39:09 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:19:35.946 02:39:09 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:19:35.946 02:39:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:35.946 02:39:09 -- common/autotest_common.sh@10 -- # set +x 00:19:35.946 02:39:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:35.946 02:39:09 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:19:35.946 02:39:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:35.946 02:39:09 -- common/autotest_common.sh@10 -- # set +x 00:19:35.946 Malloc4 00:19:35.946 02:39:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:35.946 02:39:09 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:19:35.946 02:39:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:35.946 02:39:09 -- common/autotest_common.sh@10 -- # set +x 00:19:35.946 02:39:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:35.946 02:39:09 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t rdma -a 192.168.100.8 -s 4420 00:19:35.946 02:39:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:35.946 02:39:09 -- common/autotest_common.sh@10 -- # set +x 00:19:35.946 02:39:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:35.946 02:39:09 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode4 -a 192.168.100.8 -s 4420 00:19:36.915 02:39:10 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme4n1 00:19:36.915 02:39:10 -- common/autotest_common.sh@1221 -- # local i=0 00:19:36.915 02:39:10 -- common/autotest_common.sh@1222 -- # lsblk -l -o NAME 00:19:36.915 02:39:10 -- common/autotest_common.sh@1222 -- # grep -q -w nvme4n1 00:19:36.915 02:39:10 -- common/autotest_common.sh@1228 -- # lsblk -l -o NAME 00:19:36.915 02:39:10 -- common/autotest_common.sh@1228 -- # grep -q -w nvme4n1 00:19:36.915 02:39:10 -- common/autotest_common.sh@1232 -- # return 0 00:19:36.915 02:39:10 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:19:36.915 02:39:10 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK00000000000005 00:19:36.915 02:39:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:36.915 02:39:10 -- common/autotest_common.sh@10 -- # set +x 00:19:36.915 02:39:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:36.915 02:39:10 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:19:36.915 02:39:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:36.915 02:39:10 -- common/autotest_common.sh@10 -- # set +x 00:19:36.915 Malloc5 00:19:36.915 02:39:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:36.915 02:39:10 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:19:36.915 02:39:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:36.915 02:39:10 -- common/autotest_common.sh@10 -- # set +x 00:19:36.915 02:39:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:36.915 02:39:10 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t rdma -a 192.168.100.8 -s 4420 00:19:36.915 02:39:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:36.915 02:39:10 -- common/autotest_common.sh@10 -- # set +x 00:19:36.915 02:39:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:36.915 02:39:10 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode5 -a 192.168.100.8 -s 4420 00:19:37.852 02:39:11 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme5n1 00:19:37.852 02:39:11 -- common/autotest_common.sh@1221 -- # local i=0 00:19:37.852 02:39:11 -- common/autotest_common.sh@1222 -- # lsblk -l -o NAME 00:19:37.852 02:39:11 -- common/autotest_common.sh@1222 -- # grep -q -w nvme5n1 00:19:37.852 02:39:11 -- common/autotest_common.sh@1228 -- # grep -q -w nvme5n1 00:19:37.852 02:39:11 -- common/autotest_common.sh@1228 -- # lsblk -l -o NAME 00:19:37.852 02:39:11 -- common/autotest_common.sh@1232 -- # return 0 00:19:37.852 02:39:11 -- target/srq_overwhelm.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 1048576 -d 128 -t read -r 10 -n 13 00:19:37.852 [global] 00:19:37.852 thread=1 00:19:37.852 invalidate=1 00:19:37.852 rw=read 00:19:37.852 time_based=1 00:19:37.852 runtime=10 00:19:37.852 ioengine=libaio 00:19:37.852 direct=1 00:19:37.852 bs=1048576 00:19:37.852 iodepth=128 00:19:37.852 norandommap=1 00:19:37.852 numjobs=13 00:19:37.852 00:19:37.852 [job0] 00:19:37.852 filename=/dev/nvme0n1 00:19:37.852 [job1] 00:19:37.852 filename=/dev/nvme1n1 00:19:37.852 [job2] 00:19:37.852 filename=/dev/nvme2n1 00:19:37.852 [job3] 00:19:37.852 filename=/dev/nvme3n1 00:19:37.852 [job4] 00:19:37.852 filename=/dev/nvme4n1 00:19:37.852 [job5] 00:19:37.852 filename=/dev/nvme5n1 00:19:37.852 Could not set queue depth (nvme0n1) 00:19:37.852 Could not set queue depth (nvme1n1) 00:19:37.852 Could not set queue depth (nvme2n1) 00:19:37.852 Could not set queue depth (nvme3n1) 00:19:37.852 Could not set queue depth (nvme4n1) 00:19:37.852 Could not set queue depth (nvme5n1) 00:19:38.111 job0: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:19:38.111 ... 00:19:38.111 job1: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:19:38.111 ... 00:19:38.111 job2: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:19:38.111 ... 00:19:38.111 job3: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:19:38.111 ... 00:19:38.111 job4: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:19:38.111 ... 00:19:38.111 job5: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:19:38.111 ... 00:19:38.111 fio-3.35 00:19:38.111 Starting 78 threads 00:19:53.009 00:19:53.009 job0: (groupid=0, jobs=1): err= 0: pid=1587952: Sat Apr 27 02:39:24 2024 00:19:53.009 read: IOPS=5, BW=5493KiB/s (5625kB/s)(69.0MiB/12862msec) 00:19:53.009 slat (usec): min=924, max=2070.1k, avg=155523.60, stdev=527587.65 00:19:53.009 clat (msec): min=2130, max=12859, avg=9156.72, stdev=3219.41 00:19:53.009 lat (msec): min=4200, max=12861, avg=9312.25, stdev=3133.02 00:19:53.009 clat percentiles (msec): 00:19:53.009 | 1.00th=[ 2123], 5.00th=[ 4212], 10.00th=[ 4245], 20.00th=[ 6342], 00:19:53.009 | 30.00th=[ 6477], 40.00th=[ 8490], 50.00th=[ 8557], 60.00th=[10671], 00:19:53.009 | 70.00th=[12684], 80.00th=[12818], 90.00th=[12818], 95.00th=[12818], 00:19:53.009 | 99.00th=[12818], 99.50th=[12818], 99.90th=[12818], 99.95th=[12818], 00:19:53.009 | 99.99th=[12818] 00:19:53.009 lat (msec) : >=2000=100.00% 00:19:53.009 cpu : usr=0.00%, sys=0.52%, ctx=73, majf=0, minf=17665 00:19:53.009 IO depths : 1=1.4%, 2=2.9%, 4=5.8%, 8=11.6%, 16=23.2%, 32=46.4%, >=64=8.7% 00:19:53.009 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.009 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:19:53.009 issued rwts: total=69,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.009 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.009 job0: (groupid=0, jobs=1): err= 0: pid=1587953: Sat Apr 27 02:39:24 2024 00:19:53.009 read: IOPS=9, BW=9527KiB/s (9756kB/s)(120MiB/12898msec) 00:19:53.009 slat (usec): min=614, max=4180.1k, avg=90021.26, stdev=489133.15 00:19:53.009 clat (msec): min=2094, max=12892, avg=12247.76, stdev=1644.76 00:19:53.009 lat (msec): min=4190, max=12897, avg=12337.78, stdev=1354.34 00:19:53.009 clat percentiles (msec): 00:19:53.009 | 1.00th=[ 4178], 5.00th=[10537], 10.00th=[12281], 20.00th=[12416], 00:19:53.009 | 30.00th=[12416], 40.00th=[12550], 50.00th=[12550], 60.00th=[12550], 00:19:53.009 | 70.00th=[12684], 80.00th=[12818], 90.00th=[12818], 95.00th=[12818], 00:19:53.009 | 99.00th=[12953], 99.50th=[12953], 99.90th=[12953], 99.95th=[12953], 00:19:53.009 | 99.99th=[12953] 00:19:53.009 lat (msec) : >=2000=100.00% 00:19:53.009 cpu : usr=0.00%, sys=0.92%, ctx=133, majf=0, minf=30721 00:19:53.009 IO depths : 1=0.8%, 2=1.7%, 4=3.3%, 8=6.7%, 16=13.3%, 32=26.7%, >=64=47.5% 00:19:53.009 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.009 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:19:53.009 issued rwts: total=120,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.009 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.009 job0: (groupid=0, jobs=1): err= 0: pid=1587954: Sat Apr 27 02:39:24 2024 00:19:53.009 read: IOPS=68, BW=68.5MiB/s (71.8MB/s)(887MiB/12955msec) 00:19:53.009 slat (usec): min=53, max=2163.7k, avg=12231.91, stdev=122731.36 00:19:53.009 clat (msec): min=516, max=9132, avg=1821.84, stdev=2760.02 00:19:53.009 lat (msec): min=517, max=9132, avg=1834.08, stdev=2769.18 00:19:53.009 clat percentiles (msec): 00:19:53.009 | 1.00th=[ 550], 5.00th=[ 592], 10.00th=[ 609], 20.00th=[ 634], 00:19:53.009 | 30.00th=[ 642], 40.00th=[ 651], 50.00th=[ 667], 60.00th=[ 684], 00:19:53.009 | 70.00th=[ 693], 80.00th=[ 735], 90.00th=[ 8658], 95.00th=[ 8926], 00:19:53.009 | 99.00th=[ 9060], 99.50th=[ 9060], 99.90th=[ 9194], 99.95th=[ 9194], 00:19:53.009 | 99.99th=[ 9194] 00:19:53.009 bw ( KiB/s): min= 2052, max=215040, per=5.26%, avg=141498.55, stdev=84834.29, samples=11 00:19:53.009 iops : min= 2, max= 210, avg=138.18, stdev=82.85, samples=11 00:19:53.009 lat (msec) : 750=82.75%, 1000=1.01%, >=2000=16.23% 00:19:53.009 cpu : usr=0.02%, sys=1.61%, ctx=795, majf=0, minf=32769 00:19:53.009 IO depths : 1=0.1%, 2=0.2%, 4=0.5%, 8=0.9%, 16=1.8%, 32=3.6%, >=64=92.9% 00:19:53.009 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.009 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:53.009 issued rwts: total=887,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.009 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.009 job0: (groupid=0, jobs=1): err= 0: pid=1587955: Sat Apr 27 02:39:24 2024 00:19:53.009 read: IOPS=0, BW=882KiB/s (904kB/s)(11.0MiB/12766msec) 00:19:53.009 slat (msec): min=5, max=2137, avg=970.12, stdev=1090.63 00:19:53.009 clat (msec): min=2094, max=10660, avg=7531.35, stdev=3082.95 00:19:53.009 lat (msec): min=4182, max=12765, avg=8501.47, stdev=2872.71 00:19:53.009 clat percentiles (msec): 00:19:53.009 | 1.00th=[ 2089], 5.00th=[ 2089], 10.00th=[ 4178], 20.00th=[ 4212], 00:19:53.009 | 30.00th=[ 6342], 40.00th=[ 6409], 50.00th=[ 8490], 60.00th=[ 8490], 00:19:53.009 | 70.00th=[10671], 80.00th=[10671], 90.00th=[10671], 95.00th=[10671], 00:19:53.009 | 99.00th=[10671], 99.50th=[10671], 99.90th=[10671], 99.95th=[10671], 00:19:53.009 | 99.99th=[10671] 00:19:53.009 lat (msec) : >=2000=100.00% 00:19:53.009 cpu : usr=0.00%, sys=0.09%, ctx=42, majf=0, minf=2817 00:19:53.009 IO depths : 1=9.1%, 2=18.2%, 4=36.4%, 8=36.4%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:53.009 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.009 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=100.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.010 issued rwts: total=11,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.010 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.010 job0: (groupid=0, jobs=1): err= 0: pid=1587956: Sat Apr 27 02:39:24 2024 00:19:53.010 read: IOPS=3, BW=4043KiB/s (4140kB/s)(51.0MiB/12918msec) 00:19:53.010 slat (usec): min=928, max=2084.9k, avg=211901.75, stdev=609900.10 00:19:53.010 clat (msec): min=2109, max=12914, avg=9827.17, stdev=3343.73 00:19:53.010 lat (msec): min=4194, max=12917, avg=10039.07, stdev=3183.49 00:19:53.010 clat percentiles (msec): 00:19:53.010 | 1.00th=[ 2106], 5.00th=[ 4212], 10.00th=[ 4279], 20.00th=[ 6409], 00:19:53.010 | 30.00th=[ 8557], 40.00th=[ 8557], 50.00th=[10671], 60.00th=[12818], 00:19:53.010 | 70.00th=[12818], 80.00th=[12953], 90.00th=[12953], 95.00th=[12953], 00:19:53.010 | 99.00th=[12953], 99.50th=[12953], 99.90th=[12953], 99.95th=[12953], 00:19:53.010 | 99.99th=[12953] 00:19:53.010 lat (msec) : >=2000=100.00% 00:19:53.010 cpu : usr=0.00%, sys=0.41%, ctx=80, majf=0, minf=13057 00:19:53.010 IO depths : 1=2.0%, 2=3.9%, 4=7.8%, 8=15.7%, 16=31.4%, 32=39.2%, >=64=0.0% 00:19:53.010 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.010 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:19:53.010 issued rwts: total=51,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.010 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.010 job0: (groupid=0, jobs=1): err= 0: pid=1587957: Sat Apr 27 02:39:24 2024 00:19:53.010 read: IOPS=3, BW=3270KiB/s (3349kB/s)(41.0MiB/12839msec) 00:19:53.010 slat (usec): min=884, max=2092.4k, avg=262065.37, stdev=676028.88 00:19:53.010 clat (msec): min=2094, max=12805, avg=9571.86, stdev=2968.62 00:19:53.010 lat (msec): min=4182, max=12838, avg=9833.92, stdev=2758.84 00:19:53.010 clat percentiles (msec): 00:19:53.010 | 1.00th=[ 2089], 5.00th=[ 4212], 10.00th=[ 6342], 20.00th=[ 6409], 00:19:53.010 | 30.00th=[ 8490], 40.00th=[ 8557], 50.00th=[10671], 60.00th=[10671], 00:19:53.010 | 70.00th=[12684], 80.00th=[12684], 90.00th=[12684], 95.00th=[12818], 00:19:53.010 | 99.00th=[12818], 99.50th=[12818], 99.90th=[12818], 99.95th=[12818], 00:19:53.010 | 99.99th=[12818] 00:19:53.010 lat (msec) : >=2000=100.00% 00:19:53.010 cpu : usr=0.00%, sys=0.26%, ctx=75, majf=0, minf=10497 00:19:53.010 IO depths : 1=2.4%, 2=4.9%, 4=9.8%, 8=19.5%, 16=39.0%, 32=24.4%, >=64=0.0% 00:19:53.010 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.010 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:19:53.010 issued rwts: total=41,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.010 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.010 job0: (groupid=0, jobs=1): err= 0: pid=1587959: Sat Apr 27 02:39:24 2024 00:19:53.010 read: IOPS=6, BW=6649KiB/s (6809kB/s)(83.0MiB/12782msec) 00:19:53.010 slat (usec): min=507, max=2062.7k, avg=128448.98, stdev=481031.17 00:19:53.010 clat (msec): min=2119, max=12773, avg=6890.13, stdev=2063.31 00:19:53.010 lat (msec): min=4171, max=12780, avg=7018.58, stdev=2094.30 00:19:53.010 clat percentiles (msec): 00:19:53.010 | 1.00th=[ 2123], 5.00th=[ 4212], 10.00th=[ 6141], 20.00th=[ 6141], 00:19:53.010 | 30.00th=[ 6208], 40.00th=[ 6208], 50.00th=[ 6275], 60.00th=[ 6275], 00:19:53.010 | 70.00th=[ 6342], 80.00th=[ 6409], 90.00th=[10671], 95.00th=[12684], 00:19:53.010 | 99.00th=[12818], 99.50th=[12818], 99.90th=[12818], 99.95th=[12818], 00:19:53.010 | 99.99th=[12818] 00:19:53.010 lat (msec) : >=2000=100.00% 00:19:53.010 cpu : usr=0.02%, sys=0.51%, ctx=78, majf=0, minf=21249 00:19:53.010 IO depths : 1=1.2%, 2=2.4%, 4=4.8%, 8=9.6%, 16=19.3%, 32=38.6%, >=64=24.1% 00:19:53.010 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.010 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:19:53.010 issued rwts: total=83,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.010 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.010 job0: (groupid=0, jobs=1): err= 0: pid=1587960: Sat Apr 27 02:39:24 2024 00:19:53.010 read: IOPS=61, BW=61.5MiB/s (64.5MB/s)(790MiB/12852msec) 00:19:53.010 slat (usec): min=42, max=2062.9k, avg=13580.61, stdev=139697.50 00:19:53.010 clat (msec): min=241, max=10754, avg=1998.71, stdev=3148.50 00:19:53.010 lat (msec): min=241, max=10754, avg=2012.30, stdev=3162.22 00:19:53.010 clat percentiles (msec): 00:19:53.010 | 1.00th=[ 264], 5.00th=[ 266], 10.00th=[ 275], 20.00th=[ 288], 00:19:53.010 | 30.00th=[ 313], 40.00th=[ 388], 50.00th=[ 430], 60.00th=[ 550], 00:19:53.010 | 70.00th=[ 592], 80.00th=[ 2400], 90.00th=[ 8423], 95.00th=[10402], 00:19:53.010 | 99.00th=[10671], 99.50th=[10671], 99.90th=[10805], 99.95th=[10805], 00:19:53.010 | 99.99th=[10805] 00:19:53.010 bw ( KiB/s): min= 2043, max=468992, per=5.04%, avg=135702.90, stdev=165082.86, samples=10 00:19:53.010 iops : min= 1, max= 458, avg=132.30, stdev=161.27, samples=10 00:19:53.010 lat (msec) : 250=0.25%, 500=55.44%, 750=18.35%, >=2000=25.95% 00:19:53.010 cpu : usr=0.02%, sys=1.29%, ctx=639, majf=0, minf=32769 00:19:53.010 IO depths : 1=0.1%, 2=0.3%, 4=0.5%, 8=1.0%, 16=2.0%, 32=4.1%, >=64=92.0% 00:19:53.010 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.010 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:19:53.010 issued rwts: total=790,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.010 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.010 job0: (groupid=0, jobs=1): err= 0: pid=1587961: Sat Apr 27 02:39:24 2024 00:19:53.010 read: IOPS=2, BW=2463KiB/s (2523kB/s)(31.0MiB/12886msec) 00:19:53.010 slat (usec): min=731, max=6376.5k, avg=348143.71, stdev=1230576.50 00:19:53.010 clat (msec): min=2092, max=12883, avg=8865.94, stdev=4237.19 00:19:53.010 lat (msec): min=4179, max=12885, avg=9214.08, stdev=4103.37 00:19:53.010 clat percentiles (msec): 00:19:53.010 | 1.00th=[ 2089], 5.00th=[ 4178], 10.00th=[ 4178], 20.00th=[ 4212], 00:19:53.010 | 30.00th=[ 4212], 40.00th=[ 4245], 50.00th=[10671], 60.00th=[12684], 00:19:53.010 | 70.00th=[12818], 80.00th=[12818], 90.00th=[12818], 95.00th=[12818], 00:19:53.010 | 99.00th=[12818], 99.50th=[12818], 99.90th=[12818], 99.95th=[12818], 00:19:53.010 | 99.99th=[12818] 00:19:53.010 lat (msec) : >=2000=100.00% 00:19:53.010 cpu : usr=0.00%, sys=0.25%, ctx=64, majf=0, minf=7937 00:19:53.010 IO depths : 1=3.2%, 2=6.5%, 4=12.9%, 8=25.8%, 16=51.6%, 32=0.0%, >=64=0.0% 00:19:53.010 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.010 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0% 00:19:53.010 issued rwts: total=31,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.010 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.010 job0: (groupid=0, jobs=1): err= 0: pid=1587962: Sat Apr 27 02:39:24 2024 00:19:53.010 read: IOPS=2, BW=2952KiB/s (3023kB/s)(37.0MiB/12833msec) 00:19:53.010 slat (usec): min=744, max=2079.9k, avg=288704.38, stdev=705710.98 00:19:53.010 clat (msec): min=2150, max=12830, avg=9631.79, stdev=3285.35 00:19:53.010 lat (msec): min=4230, max=12832, avg=9920.49, stdev=3072.12 00:19:53.010 clat percentiles (msec): 00:19:53.010 | 1.00th=[ 2165], 5.00th=[ 4245], 10.00th=[ 6342], 20.00th=[ 6409], 00:19:53.010 | 30.00th=[ 6409], 40.00th=[ 8557], 50.00th=[10671], 60.00th=[12684], 00:19:53.010 | 70.00th=[12818], 80.00th=[12818], 90.00th=[12818], 95.00th=[12818], 00:19:53.010 | 99.00th=[12818], 99.50th=[12818], 99.90th=[12818], 99.95th=[12818], 00:19:53.010 | 99.99th=[12818] 00:19:53.010 lat (msec) : >=2000=100.00% 00:19:53.010 cpu : usr=0.00%, sys=0.27%, ctx=62, majf=0, minf=9473 00:19:53.010 IO depths : 1=2.7%, 2=5.4%, 4=10.8%, 8=21.6%, 16=43.2%, 32=16.2%, >=64=0.0% 00:19:53.010 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.010 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:19:53.010 issued rwts: total=37,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.010 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.010 job0: (groupid=0, jobs=1): err= 0: pid=1587963: Sat Apr 27 02:39:24 2024 00:19:53.010 read: IOPS=4, BW=4895KiB/s (5012kB/s)(61.0MiB/12761msec) 00:19:53.010 slat (usec): min=896, max=2072.5k, avg=174452.70, stdev=559048.33 00:19:53.010 clat (msec): min=2118, max=12759, avg=8733.98, stdev=3281.77 00:19:53.010 lat (msec): min=4158, max=12760, avg=8908.43, stdev=3206.21 00:19:53.010 clat percentiles (msec): 00:19:53.010 | 1.00th=[ 2123], 5.00th=[ 4178], 10.00th=[ 4212], 20.00th=[ 6342], 00:19:53.010 | 30.00th=[ 6409], 40.00th=[ 8490], 50.00th=[ 8557], 60.00th=[10671], 00:19:53.010 | 70.00th=[10671], 80.00th=[12684], 90.00th=[12818], 95.00th=[12818], 00:19:53.010 | 99.00th=[12818], 99.50th=[12818], 99.90th=[12818], 99.95th=[12818], 00:19:53.010 | 99.99th=[12818] 00:19:53.010 lat (msec) : >=2000=100.00% 00:19:53.010 cpu : usr=0.02%, sys=0.45%, ctx=60, majf=0, minf=15617 00:19:53.010 IO depths : 1=1.6%, 2=3.3%, 4=6.6%, 8=13.1%, 16=26.2%, 32=49.2%, >=64=0.0% 00:19:53.010 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.010 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:19:53.010 issued rwts: total=61,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.010 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.010 job0: (groupid=0, jobs=1): err= 0: pid=1587964: Sat Apr 27 02:39:24 2024 00:19:53.010 read: IOPS=2, BW=3022KiB/s (3094kB/s)(38.0MiB/12877msec) 00:19:53.010 slat (usec): min=880, max=2084.9k, avg=283328.48, stdev=696810.15 00:19:53.010 clat (msec): min=2109, max=12864, avg=9406.02, stdev=3294.18 00:19:53.010 lat (msec): min=4194, max=12876, avg=9689.35, stdev=3107.41 00:19:53.010 clat percentiles (msec): 00:19:53.010 | 1.00th=[ 2106], 5.00th=[ 4212], 10.00th=[ 4279], 20.00th=[ 6409], 00:19:53.010 | 30.00th=[ 8490], 40.00th=[ 8557], 50.00th=[10671], 60.00th=[10671], 00:19:53.010 | 70.00th=[12684], 80.00th=[12684], 90.00th=[12818], 95.00th=[12818], 00:19:53.010 | 99.00th=[12818], 99.50th=[12818], 99.90th=[12818], 99.95th=[12818], 00:19:53.010 | 99.99th=[12818] 00:19:53.010 lat (msec) : >=2000=100.00% 00:19:53.010 cpu : usr=0.00%, sys=0.27%, ctx=62, majf=0, minf=9729 00:19:53.010 IO depths : 1=2.6%, 2=5.3%, 4=10.5%, 8=21.1%, 16=42.1%, 32=18.4%, >=64=0.0% 00:19:53.010 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.010 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:19:53.010 issued rwts: total=38,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.010 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.010 job0: (groupid=0, jobs=1): err= 0: pid=1587965: Sat Apr 27 02:39:24 2024 00:19:53.010 read: IOPS=5, BW=6024KiB/s (6169kB/s)(76.0MiB/12919msec) 00:19:53.010 slat (usec): min=881, max=2112.5k, avg=142475.19, stdev=513057.60 00:19:53.010 clat (msec): min=2089, max=12916, avg=9486.77, stdev=3645.59 00:19:53.010 lat (msec): min=4182, max=12918, avg=9629.24, stdev=3563.31 00:19:53.010 clat percentiles (msec): 00:19:53.010 | 1.00th=[ 2089], 5.00th=[ 4178], 10.00th=[ 4212], 20.00th=[ 6342], 00:19:53.010 | 30.00th=[ 6409], 40.00th=[ 8490], 50.00th=[10671], 60.00th=[12818], 00:19:53.010 | 70.00th=[12818], 80.00th=[12818], 90.00th=[12953], 95.00th=[12953], 00:19:53.011 | 99.00th=[12953], 99.50th=[12953], 99.90th=[12953], 99.95th=[12953], 00:19:53.011 | 99.99th=[12953] 00:19:53.011 lat (msec) : >=2000=100.00% 00:19:53.011 cpu : usr=0.01%, sys=0.61%, ctx=100, majf=0, minf=19457 00:19:53.011 IO depths : 1=1.3%, 2=2.6%, 4=5.3%, 8=10.5%, 16=21.1%, 32=42.1%, >=64=17.1% 00:19:53.011 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.011 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:19:53.011 issued rwts: total=76,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.011 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.011 job1: (groupid=0, jobs=1): err= 0: pid=1587981: Sat Apr 27 02:39:24 2024 00:19:53.011 read: IOPS=0, BW=960KiB/s (983kB/s)(12.0MiB/12803msec) 00:19:53.011 slat (msec): min=9, max=2146, avg=892.83, stdev=1058.98 00:19:53.011 clat (msec): min=2088, max=12680, avg=8139.56, stdev=3267.90 00:19:53.011 lat (msec): min=4182, max=12802, avg=9032.38, stdev=2908.04 00:19:53.011 clat percentiles (msec): 00:19:53.011 | 1.00th=[ 2089], 5.00th=[ 2089], 10.00th=[ 4178], 20.00th=[ 4212], 00:19:53.011 | 30.00th=[ 6342], 40.00th=[ 8490], 50.00th=[ 8490], 60.00th=[10671], 00:19:53.011 | 70.00th=[10671], 80.00th=[10671], 90.00th=[10671], 95.00th=[12684], 00:19:53.011 | 99.00th=[12684], 99.50th=[12684], 99.90th=[12684], 99.95th=[12684], 00:19:53.011 | 99.99th=[12684] 00:19:53.011 lat (msec) : >=2000=100.00% 00:19:53.011 cpu : usr=0.00%, sys=0.09%, ctx=41, majf=0, minf=3073 00:19:53.011 IO depths : 1=8.3%, 2=16.7%, 4=33.3%, 8=41.7%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:53.011 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.011 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=100.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.011 issued rwts: total=12,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.011 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.011 job1: (groupid=0, jobs=1): err= 0: pid=1587982: Sat Apr 27 02:39:24 2024 00:19:53.011 read: IOPS=4, BW=4872KiB/s (4989kB/s)(61.0MiB/12821msec) 00:19:53.011 slat (usec): min=855, max=2057.8k, avg=175411.31, stdev=558221.67 00:19:53.011 clat (msec): min=2120, max=12819, avg=8903.86, stdev=3281.61 00:19:53.011 lat (msec): min=4178, max=12820, avg=9079.27, stdev=3197.89 00:19:53.011 clat percentiles (msec): 00:19:53.011 | 1.00th=[ 2123], 5.00th=[ 4212], 10.00th=[ 4212], 20.00th=[ 6342], 00:19:53.011 | 30.00th=[ 6409], 40.00th=[ 8490], 50.00th=[ 8557], 60.00th=[10671], 00:19:53.011 | 70.00th=[10671], 80.00th=[12818], 90.00th=[12818], 95.00th=[12818], 00:19:53.011 | 99.00th=[12818], 99.50th=[12818], 99.90th=[12818], 99.95th=[12818], 00:19:53.011 | 99.99th=[12818] 00:19:53.011 lat (msec) : >=2000=100.00% 00:19:53.011 cpu : usr=0.01%, sys=0.45%, ctx=68, majf=0, minf=15617 00:19:53.011 IO depths : 1=1.6%, 2=3.3%, 4=6.6%, 8=13.1%, 16=26.2%, 32=49.2%, >=64=0.0% 00:19:53.011 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.011 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:19:53.011 issued rwts: total=61,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.011 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.011 job1: (groupid=0, jobs=1): err= 0: pid=1587983: Sat Apr 27 02:39:24 2024 00:19:53.011 read: IOPS=4, BW=4436KiB/s (4542kB/s)(56.0MiB/12928msec) 00:19:53.011 slat (usec): min=781, max=2104.3k, avg=193717.20, stdev=593467.08 00:19:53.011 clat (msec): min=2079, max=12925, avg=10891.24, stdev=3284.64 00:19:53.011 lat (msec): min=4175, max=12927, avg=11084.95, stdev=3068.27 00:19:53.011 clat percentiles (msec): 00:19:53.011 | 1.00th=[ 2072], 5.00th=[ 4178], 10.00th=[ 4245], 20.00th=[ 8490], 00:19:53.011 | 30.00th=[10671], 40.00th=[12818], 50.00th=[12818], 60.00th=[12818], 00:19:53.011 | 70.00th=[12953], 80.00th=[12953], 90.00th=[12953], 95.00th=[12953], 00:19:53.011 | 99.00th=[12953], 99.50th=[12953], 99.90th=[12953], 99.95th=[12953], 00:19:53.011 | 99.99th=[12953] 00:19:53.011 lat (msec) : >=2000=100.00% 00:19:53.011 cpu : usr=0.00%, sys=0.48%, ctx=82, majf=0, minf=14337 00:19:53.011 IO depths : 1=1.8%, 2=3.6%, 4=7.1%, 8=14.3%, 16=28.6%, 32=44.6%, >=64=0.0% 00:19:53.011 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.011 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:19:53.011 issued rwts: total=56,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.011 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.011 job1: (groupid=0, jobs=1): err= 0: pid=1587984: Sat Apr 27 02:39:24 2024 00:19:53.011 read: IOPS=37, BW=37.2MiB/s (39.0MB/s)(481MiB/12923msec) 00:19:53.011 slat (usec): min=404, max=2063.0k, avg=22458.85, stdev=177898.58 00:19:53.011 clat (msec): min=524, max=10512, avg=3259.69, stdev=4019.18 00:19:53.011 lat (msec): min=527, max=10516, avg=3282.15, stdev=4029.85 00:19:53.011 clat percentiles (msec): 00:19:53.011 | 1.00th=[ 527], 5.00th=[ 535], 10.00th=[ 567], 20.00th=[ 625], 00:19:53.011 | 30.00th=[ 667], 40.00th=[ 684], 50.00th=[ 810], 60.00th=[ 1003], 00:19:53.011 | 70.00th=[ 2232], 80.00th=[10268], 90.00th=[10268], 95.00th=[10402], 00:19:53.011 | 99.00th=[10537], 99.50th=[10537], 99.90th=[10537], 99.95th=[10537], 00:19:53.011 | 99.99th=[10537] 00:19:53.011 bw ( KiB/s): min= 2052, max=235520, per=3.37%, avg=90624.50, stdev=92498.54, samples=8 00:19:53.011 iops : min= 2, max= 230, avg=88.50, stdev=90.33, samples=8 00:19:53.011 lat (msec) : 750=46.99%, 1000=13.10%, 2000=9.36%, >=2000=30.56% 00:19:53.011 cpu : usr=0.01%, sys=1.20%, ctx=980, majf=0, minf=32769 00:19:53.011 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.7%, 16=3.3%, 32=6.7%, >=64=86.9% 00:19:53.011 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.011 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:19:53.011 issued rwts: total=481,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.011 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.011 job1: (groupid=0, jobs=1): err= 0: pid=1587985: Sat Apr 27 02:39:24 2024 00:19:53.011 read: IOPS=2, BW=2881KiB/s (2951kB/s)(36.0MiB/12794msec) 00:19:53.011 slat (usec): min=781, max=2063.5k, avg=296101.54, stdev=706772.85 00:19:53.011 clat (msec): min=2133, max=12790, avg=8681.84, stdev=3494.50 00:19:53.011 lat (msec): min=4193, max=12793, avg=8977.94, stdev=3373.27 00:19:53.011 clat percentiles (msec): 00:19:53.011 | 1.00th=[ 2140], 5.00th=[ 4178], 10.00th=[ 4212], 20.00th=[ 4279], 00:19:53.011 | 30.00th=[ 6409], 40.00th=[ 8490], 50.00th=[ 8557], 60.00th=[10671], 00:19:53.011 | 70.00th=[12684], 80.00th=[12684], 90.00th=[12818], 95.00th=[12818], 00:19:53.011 | 99.00th=[12818], 99.50th=[12818], 99.90th=[12818], 99.95th=[12818], 00:19:53.011 | 99.99th=[12818] 00:19:53.011 lat (msec) : >=2000=100.00% 00:19:53.011 cpu : usr=0.01%, sys=0.23%, ctx=65, majf=0, minf=9217 00:19:53.011 IO depths : 1=2.8%, 2=5.6%, 4=11.1%, 8=22.2%, 16=44.4%, 32=13.9%, >=64=0.0% 00:19:53.011 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.011 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:19:53.011 issued rwts: total=36,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.011 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.011 job1: (groupid=0, jobs=1): err= 0: pid=1587986: Sat Apr 27 02:39:24 2024 00:19:53.011 read: IOPS=2, BW=2317KiB/s (2373kB/s)(29.0MiB/12816msec) 00:19:53.011 slat (usec): min=965, max=2112.9k, avg=369937.51, stdev=790187.24 00:19:53.011 clat (msec): min=2087, max=12776, avg=7451.36, stdev=3111.06 00:19:53.011 lat (msec): min=4167, max=12815, avg=7821.29, stdev=3088.21 00:19:53.011 clat percentiles (msec): 00:19:53.011 | 1.00th=[ 2089], 5.00th=[ 4178], 10.00th=[ 4178], 20.00th=[ 4212], 00:19:53.011 | 30.00th=[ 6342], 40.00th=[ 6342], 50.00th=[ 6342], 60.00th=[ 8423], 00:19:53.011 | 70.00th=[ 8490], 80.00th=[10671], 90.00th=[12684], 95.00th=[12684], 00:19:53.011 | 99.00th=[12818], 99.50th=[12818], 99.90th=[12818], 99.95th=[12818], 00:19:53.011 | 99.99th=[12818] 00:19:53.011 lat (msec) : >=2000=100.00% 00:19:53.011 cpu : usr=0.00%, sys=0.20%, ctx=59, majf=0, minf=7425 00:19:53.011 IO depths : 1=3.4%, 2=6.9%, 4=13.8%, 8=27.6%, 16=48.3%, 32=0.0%, >=64=0.0% 00:19:53.011 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.011 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0% 00:19:53.011 issued rwts: total=29,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.011 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.011 job1: (groupid=0, jobs=1): err= 0: pid=1587987: Sat Apr 27 02:39:24 2024 00:19:53.011 read: IOPS=16, BW=17.0MiB/s (17.8MB/s)(217MiB/12800msec) 00:19:53.011 slat (usec): min=591, max=2127.3k, avg=49239.17, stdev=283068.53 00:19:53.011 clat (msec): min=1208, max=12791, avg=7109.12, stdev=4803.08 00:19:53.011 lat (msec): min=1228, max=12799, avg=7158.36, stdev=4797.30 00:19:53.011 clat percentiles (msec): 00:19:53.011 | 1.00th=[ 1217], 5.00th=[ 1234], 10.00th=[ 1250], 20.00th=[ 1284], 00:19:53.011 | 30.00th=[ 1301], 40.00th=[ 4212], 50.00th=[10805], 60.00th=[10939], 00:19:53.011 | 70.00th=[11208], 80.00th=[11342], 90.00th=[11610], 95.00th=[11745], 00:19:53.011 | 99.00th=[12818], 99.50th=[12818], 99.90th=[12818], 99.95th=[12818], 00:19:53.011 | 99.99th=[12818] 00:19:53.011 bw ( KiB/s): min= 2052, max=114688, per=0.98%, avg=26322.57, stdev=40553.58, samples=7 00:19:53.011 iops : min= 2, max= 112, avg=25.57, stdev=39.58, samples=7 00:19:53.011 lat (msec) : 2000=37.79%, >=2000=62.21% 00:19:53.011 cpu : usr=0.01%, sys=1.04%, ctx=386, majf=0, minf=32769 00:19:53.011 IO depths : 1=0.5%, 2=0.9%, 4=1.8%, 8=3.7%, 16=7.4%, 32=14.7%, >=64=71.0% 00:19:53.011 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.011 complete : 0=0.0%, 4=98.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=1.1% 00:19:53.011 issued rwts: total=217,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.011 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.011 job1: (groupid=0, jobs=1): err= 0: pid=1587988: Sat Apr 27 02:39:24 2024 00:19:53.011 read: IOPS=9, BW=9.90MiB/s (10.4MB/s)(127MiB/12830msec) 00:19:53.011 slat (usec): min=426, max=3953.0k, avg=84514.11, stdev=460693.44 00:19:53.011 clat (msec): min=2095, max=12826, avg=10682.94, stdev=1627.19 00:19:53.011 lat (msec): min=4189, max=12829, avg=10767.45, stdev=1446.31 00:19:53.011 clat percentiles (msec): 00:19:53.011 | 1.00th=[ 4178], 5.00th=[10268], 10.00th=[10402], 20.00th=[10402], 00:19:53.011 | 30.00th=[10402], 40.00th=[10402], 50.00th=[10537], 60.00th=[10537], 00:19:53.011 | 70.00th=[10537], 80.00th=[12550], 90.00th=[12818], 95.00th=[12818], 00:19:53.011 | 99.00th=[12818], 99.50th=[12818], 99.90th=[12818], 99.95th=[12818], 00:19:53.011 | 99.99th=[12818] 00:19:53.011 lat (msec) : >=2000=100.00% 00:19:53.011 cpu : usr=0.02%, sys=0.57%, ctx=300, majf=0, minf=32513 00:19:53.011 IO depths : 1=0.8%, 2=1.6%, 4=3.1%, 8=6.3%, 16=12.6%, 32=25.2%, >=64=50.4% 00:19:53.011 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.011 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:19:53.012 issued rwts: total=127,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.012 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.012 job1: (groupid=0, jobs=1): err= 0: pid=1587989: Sat Apr 27 02:39:24 2024 00:19:53.012 read: IOPS=34, BW=34.2MiB/s (35.8MB/s)(442MiB/12930msec) 00:19:53.012 slat (usec): min=461, max=2090.9k, avg=24406.49, stdev=187385.32 00:19:53.012 clat (msec): min=496, max=12804, avg=3506.59, stdev=4219.09 00:19:53.012 lat (msec): min=499, max=12871, avg=3531.00, stdev=4230.45 00:19:53.012 clat percentiles (msec): 00:19:53.012 | 1.00th=[ 498], 5.00th=[ 510], 10.00th=[ 531], 20.00th=[ 625], 00:19:53.012 | 30.00th=[ 659], 40.00th=[ 667], 50.00th=[ 785], 60.00th=[ 986], 00:19:53.012 | 70.00th=[ 4279], 80.00th=[10268], 90.00th=[10402], 95.00th=[10537], 00:19:53.012 | 99.00th=[10805], 99.50th=[10805], 99.90th=[12818], 99.95th=[12818], 00:19:53.012 | 99.99th=[12818] 00:19:53.012 bw ( KiB/s): min= 2052, max=253952, per=2.99%, avg=80640.50, stdev=90714.17, samples=8 00:19:53.012 iops : min= 2, max= 248, avg=78.75, stdev=88.59, samples=8 00:19:53.012 lat (msec) : 500=2.49%, 750=45.25%, 1000=13.12%, 2000=5.88%, >=2000=33.26% 00:19:53.012 cpu : usr=0.02%, sys=1.06%, ctx=946, majf=0, minf=32769 00:19:53.012 IO depths : 1=0.2%, 2=0.5%, 4=0.9%, 8=1.8%, 16=3.6%, 32=7.2%, >=64=85.7% 00:19:53.012 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.012 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:19:53.012 issued rwts: total=442,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.012 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.012 job1: (groupid=0, jobs=1): err= 0: pid=1587990: Sat Apr 27 02:39:24 2024 00:19:53.012 read: IOPS=31, BW=31.1MiB/s (32.6MB/s)(398MiB/12806msec) 00:19:53.012 slat (usec): min=47, max=2057.8k, avg=26839.60, stdev=211956.03 00:19:53.012 clat (msec): min=234, max=8575, avg=2857.14, stdev=2329.37 00:19:53.012 lat (msec): min=235, max=8576, avg=2883.98, stdev=2333.66 00:19:53.012 clat percentiles (msec): 00:19:53.012 | 1.00th=[ 236], 5.00th=[ 262], 10.00th=[ 264], 20.00th=[ 266], 00:19:53.012 | 30.00th=[ 1871], 40.00th=[ 2072], 50.00th=[ 2072], 60.00th=[ 2072], 00:19:53.012 | 70.00th=[ 4396], 80.00th=[ 6007], 90.00th=[ 6074], 95.00th=[ 6141], 00:19:53.012 | 99.00th=[ 8557], 99.50th=[ 8557], 99.90th=[ 8557], 99.95th=[ 8557], 00:19:53.012 | 99.99th=[ 8557] 00:19:53.012 bw ( KiB/s): min= 2048, max=352256, per=2.94%, avg=79287.43, stdev=125617.94, samples=7 00:19:53.012 iops : min= 2, max= 344, avg=77.43, stdev=122.67, samples=7 00:19:53.012 lat (msec) : 250=3.77%, 500=25.13%, 2000=4.27%, >=2000=66.83% 00:19:53.012 cpu : usr=0.01%, sys=0.89%, ctx=293, majf=0, minf=32769 00:19:53.012 IO depths : 1=0.3%, 2=0.5%, 4=1.0%, 8=2.0%, 16=4.0%, 32=8.0%, >=64=84.2% 00:19:53.012 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.012 complete : 0=0.0%, 4=99.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.4% 00:19:53.012 issued rwts: total=398,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.012 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.012 job1: (groupid=0, jobs=1): err= 0: pid=1587991: Sat Apr 27 02:39:24 2024 00:19:53.012 read: IOPS=2, BW=2952KiB/s (3023kB/s)(37.0MiB/12836msec) 00:19:53.012 slat (usec): min=1045, max=2112.9k, avg=290479.36, stdev=713082.19 00:19:53.012 clat (msec): min=2087, max=12832, avg=8321.38, stdev=3765.56 00:19:53.012 lat (msec): min=4163, max=12835, avg=8611.86, stdev=3685.01 00:19:53.012 clat percentiles (msec): 00:19:53.012 | 1.00th=[ 2089], 5.00th=[ 4178], 10.00th=[ 4178], 20.00th=[ 4212], 00:19:53.012 | 30.00th=[ 4245], 40.00th=[ 6342], 50.00th=[ 8490], 60.00th=[10671], 00:19:53.012 | 70.00th=[12684], 80.00th=[12818], 90.00th=[12818], 95.00th=[12818], 00:19:53.012 | 99.00th=[12818], 99.50th=[12818], 99.90th=[12818], 99.95th=[12818], 00:19:53.012 | 99.99th=[12818] 00:19:53.012 lat (msec) : >=2000=100.00% 00:19:53.012 cpu : usr=0.00%, sys=0.27%, ctx=72, majf=0, minf=9473 00:19:53.012 IO depths : 1=2.7%, 2=5.4%, 4=10.8%, 8=21.6%, 16=43.2%, 32=16.2%, >=64=0.0% 00:19:53.012 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.012 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:19:53.012 issued rwts: total=37,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.012 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.012 job1: (groupid=0, jobs=1): err= 0: pid=1587992: Sat Apr 27 02:39:24 2024 00:19:53.012 read: IOPS=17, BW=17.6MiB/s (18.5MB/s)(226MiB/12840msec) 00:19:53.012 slat (usec): min=548, max=2127.3k, avg=47536.89, stdev=278166.34 00:19:53.012 clat (msec): min=1258, max=11858, avg=6883.84, stdev=4799.72 00:19:53.012 lat (msec): min=1263, max=11900, avg=6931.38, stdev=4795.98 00:19:53.012 clat percentiles (msec): 00:19:53.012 | 1.00th=[ 1267], 5.00th=[ 1301], 10.00th=[ 1318], 20.00th=[ 1334], 00:19:53.012 | 30.00th=[ 1351], 40.00th=[ 1401], 50.00th=[10805], 60.00th=[10939], 00:19:53.012 | 70.00th=[11208], 80.00th=[11342], 90.00th=[11610], 95.00th=[11745], 00:19:53.012 | 99.00th=[11879], 99.50th=[11879], 99.90th=[11879], 99.95th=[11879], 00:19:53.012 | 99.99th=[11879] 00:19:53.012 bw ( KiB/s): min= 2052, max=116736, per=1.08%, avg=28965.14, stdev=41492.48, samples=7 00:19:53.012 iops : min= 2, max= 114, avg=28.29, stdev=40.52, samples=7 00:19:53.012 lat (msec) : 2000=40.27%, >=2000=59.73% 00:19:53.012 cpu : usr=0.00%, sys=1.10%, ctx=390, majf=0, minf=32769 00:19:53.012 IO depths : 1=0.4%, 2=0.9%, 4=1.8%, 8=3.5%, 16=7.1%, 32=14.2%, >=64=72.1% 00:19:53.012 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.012 complete : 0=0.0%, 4=99.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=1.0% 00:19:53.012 issued rwts: total=226,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.012 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.012 job1: (groupid=0, jobs=1): err= 0: pid=1587993: Sat Apr 27 02:39:24 2024 00:19:53.012 read: IOPS=6, BW=6320KiB/s (6471kB/s)(80.0MiB/12963msec) 00:19:53.012 slat (usec): min=583, max=2068.3k, avg=135418.42, stdev=493437.39 00:19:53.012 clat (msec): min=2128, max=12958, avg=11276.18, stdev=2928.52 00:19:53.012 lat (msec): min=4197, max=12962, avg=11411.60, stdev=2744.91 00:19:53.012 clat percentiles (msec): 00:19:53.012 | 1.00th=[ 2123], 5.00th=[ 4245], 10.00th=[ 6342], 20.00th=[ 8557], 00:19:53.012 | 30.00th=[12684], 40.00th=[12818], 50.00th=[12818], 60.00th=[12953], 00:19:53.012 | 70.00th=[12953], 80.00th=[12953], 90.00th=[12953], 95.00th=[12953], 00:19:53.012 | 99.00th=[12953], 99.50th=[12953], 99.90th=[12953], 99.95th=[12953], 00:19:53.012 | 99.99th=[12953] 00:19:53.012 lat (msec) : >=2000=100.00% 00:19:53.012 cpu : usr=0.00%, sys=0.63%, ctx=116, majf=0, minf=20481 00:19:53.012 IO depths : 1=1.2%, 2=2.5%, 4=5.0%, 8=10.0%, 16=20.0%, 32=40.0%, >=64=21.3% 00:19:53.012 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.012 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:19:53.012 issued rwts: total=80,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.012 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.012 job2: (groupid=0, jobs=1): err= 0: pid=1587997: Sat Apr 27 02:39:24 2024 00:19:53.012 read: IOPS=6, BW=6697KiB/s (6858kB/s)(84.0MiB/12844msec) 00:19:53.012 slat (usec): min=584, max=2054.4k, avg=127781.62, stdev=474493.10 00:19:53.012 clat (msec): min=2109, max=12840, avg=8986.95, stdev=2593.13 00:19:53.012 lat (msec): min=4164, max=12843, avg=9114.73, stdev=2513.40 00:19:53.012 clat percentiles (msec): 00:19:53.012 | 1.00th=[ 2106], 5.00th=[ 4212], 10.00th=[ 4245], 20.00th=[ 6409], 00:19:53.012 | 30.00th=[ 8423], 40.00th=[ 8557], 50.00th=[ 8557], 60.00th=[10537], 00:19:53.012 | 70.00th=[10537], 80.00th=[10671], 90.00th=[12818], 95.00th=[12818], 00:19:53.012 | 99.00th=[12818], 99.50th=[12818], 99.90th=[12818], 99.95th=[12818], 00:19:53.012 | 99.99th=[12818] 00:19:53.012 lat (msec) : >=2000=100.00% 00:19:53.012 cpu : usr=0.02%, sys=0.53%, ctx=76, majf=0, minf=21505 00:19:53.012 IO depths : 1=1.2%, 2=2.4%, 4=4.8%, 8=9.5%, 16=19.0%, 32=38.1%, >=64=25.0% 00:19:53.012 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.012 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:19:53.012 issued rwts: total=84,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.012 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.012 job2: (groupid=0, jobs=1): err= 0: pid=1587998: Sat Apr 27 02:39:24 2024 00:19:53.012 read: IOPS=2, BW=2959KiB/s (3030kB/s)(37.0MiB/12805msec) 00:19:53.012 slat (usec): min=732, max=2098.6k, avg=288581.95, stdev=705041.50 00:19:53.012 clat (msec): min=2126, max=12712, avg=9503.24, stdev=3376.38 00:19:53.012 lat (msec): min=4159, max=12804, avg=9791.82, stdev=3178.96 00:19:53.012 clat percentiles (msec): 00:19:53.012 | 1.00th=[ 2123], 5.00th=[ 4144], 10.00th=[ 4212], 20.00th=[ 6342], 00:19:53.012 | 30.00th=[ 8423], 40.00th=[ 8490], 50.00th=[10671], 60.00th=[10671], 00:19:53.012 | 70.00th=[12684], 80.00th=[12684], 90.00th=[12684], 95.00th=[12684], 00:19:53.012 | 99.00th=[12684], 99.50th=[12684], 99.90th=[12684], 99.95th=[12684], 00:19:53.012 | 99.99th=[12684] 00:19:53.012 lat (msec) : >=2000=100.00% 00:19:53.012 cpu : usr=0.02%, sys=0.23%, ctx=63, majf=0, minf=9473 00:19:53.012 IO depths : 1=2.7%, 2=5.4%, 4=10.8%, 8=21.6%, 16=43.2%, 32=16.2%, >=64=0.0% 00:19:53.012 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.012 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:19:53.012 issued rwts: total=37,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.012 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.012 job2: (groupid=0, jobs=1): err= 0: pid=1587999: Sat Apr 27 02:39:24 2024 00:19:53.012 read: IOPS=4, BW=4158KiB/s (4258kB/s)(44.0MiB/10836msec) 00:19:53.012 slat (usec): min=576, max=2135.8k, avg=243505.76, stdev=666914.79 00:19:53.012 clat (msec): min=120, max=10832, avg=7133.06, stdev=3237.86 00:19:53.012 lat (msec): min=2155, max=10835, avg=7376.57, stdev=3098.10 00:19:53.012 clat percentiles (msec): 00:19:53.012 | 1.00th=[ 122], 5.00th=[ 2165], 10.00th=[ 2198], 20.00th=[ 4329], 00:19:53.012 | 30.00th=[ 6477], 40.00th=[ 6477], 50.00th=[ 6477], 60.00th=[ 8658], 00:19:53.012 | 70.00th=[10805], 80.00th=[10805], 90.00th=[10805], 95.00th=[10805], 00:19:53.012 | 99.00th=[10805], 99.50th=[10805], 99.90th=[10805], 99.95th=[10805], 00:19:53.012 | 99.99th=[10805] 00:19:53.012 lat (msec) : 250=2.27%, >=2000=97.73% 00:19:53.012 cpu : usr=0.02%, sys=0.35%, ctx=63, majf=0, minf=11265 00:19:53.012 IO depths : 1=2.3%, 2=4.5%, 4=9.1%, 8=18.2%, 16=36.4%, 32=29.5%, >=64=0.0% 00:19:53.012 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.012 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:19:53.012 issued rwts: total=44,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.012 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.012 job2: (groupid=0, jobs=1): err= 0: pid=1588001: Sat Apr 27 02:39:24 2024 00:19:53.012 read: IOPS=46, BW=46.1MiB/s (48.3MB/s)(595MiB/12920msec) 00:19:53.012 slat (usec): min=55, max=2080.8k, avg=18164.84, stdev=136332.99 00:19:53.012 clat (msec): min=269, max=9346, avg=2634.22, stdev=3110.44 00:19:53.012 lat (msec): min=282, max=9348, avg=2652.38, stdev=3119.79 00:19:53.013 clat percentiles (msec): 00:19:53.013 | 1.00th=[ 284], 5.00th=[ 313], 10.00th=[ 334], 20.00th=[ 527], 00:19:53.013 | 30.00th=[ 827], 40.00th=[ 1036], 50.00th=[ 1351], 60.00th=[ 1552], 00:19:53.013 | 70.00th=[ 1636], 80.00th=[ 6409], 90.00th=[ 8658], 95.00th=[ 9060], 00:19:53.013 | 99.00th=[ 9329], 99.50th=[ 9329], 99.90th=[ 9329], 99.95th=[ 9329], 00:19:53.013 | 99.99th=[ 9329] 00:19:53.013 bw ( KiB/s): min= 2048, max=315392, per=2.97%, avg=79872.33, stdev=91763.72, samples=12 00:19:53.013 iops : min= 2, max= 308, avg=78.00, stdev=89.61, samples=12 00:19:53.013 lat (msec) : 500=18.66%, 750=9.08%, 1000=10.76%, 2000=38.49%, >=2000=23.03% 00:19:53.013 cpu : usr=0.03%, sys=1.01%, ctx=1010, majf=0, minf=32769 00:19:53.013 IO depths : 1=0.2%, 2=0.3%, 4=0.7%, 8=1.3%, 16=2.7%, 32=5.4%, >=64=89.4% 00:19:53.013 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.013 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:19:53.013 issued rwts: total=595,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.013 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.013 job2: (groupid=0, jobs=1): err= 0: pid=1588002: Sat Apr 27 02:39:24 2024 00:19:53.013 read: IOPS=2, BW=2640KiB/s (2704kB/s)(33.0MiB/12798msec) 00:19:53.013 slat (usec): min=855, max=2092.1k, avg=323251.91, stdev=748377.38 00:19:53.013 clat (msec): min=2129, max=12781, avg=9594.56, stdev=3209.44 00:19:53.013 lat (msec): min=4181, max=12797, avg=9917.82, stdev=2961.73 00:19:53.013 clat percentiles (msec): 00:19:53.013 | 1.00th=[ 2123], 5.00th=[ 4178], 10.00th=[ 4212], 20.00th=[ 6342], 00:19:53.013 | 30.00th=[ 8490], 40.00th=[10537], 50.00th=[10671], 60.00th=[10671], 00:19:53.013 | 70.00th=[12818], 80.00th=[12818], 90.00th=[12818], 95.00th=[12818], 00:19:53.013 | 99.00th=[12818], 99.50th=[12818], 99.90th=[12818], 99.95th=[12818], 00:19:53.013 | 99.99th=[12818] 00:19:53.013 lat (msec) : >=2000=100.00% 00:19:53.013 cpu : usr=0.01%, sys=0.22%, ctx=54, majf=0, minf=8449 00:19:53.013 IO depths : 1=3.0%, 2=6.1%, 4=12.1%, 8=24.2%, 16=48.5%, 32=6.1%, >=64=0.0% 00:19:53.013 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.013 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:19:53.013 issued rwts: total=33,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.013 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.013 job2: (groupid=0, jobs=1): err= 0: pid=1588003: Sat Apr 27 02:39:24 2024 00:19:53.013 read: IOPS=61, BW=61.3MiB/s (64.3MB/s)(663MiB/10814msec) 00:19:53.013 slat (usec): min=55, max=2088.1k, avg=16121.90, stdev=130053.06 00:19:53.013 clat (msec): min=120, max=6517, avg=1865.43, stdev=1869.18 00:19:53.013 lat (msec): min=245, max=8046, avg=1881.55, stdev=1885.57 00:19:53.013 clat percentiles (msec): 00:19:53.013 | 1.00th=[ 245], 5.00th=[ 255], 10.00th=[ 275], 20.00th=[ 321], 00:19:53.013 | 30.00th=[ 447], 40.00th=[ 498], 50.00th=[ 523], 60.00th=[ 2400], 00:19:53.013 | 70.00th=[ 2769], 80.00th=[ 2903], 90.00th=[ 5269], 95.00th=[ 5537], 00:19:53.013 | 99.00th=[ 5940], 99.50th=[ 5940], 99.90th=[ 6544], 99.95th=[ 6544], 00:19:53.013 | 99.99th=[ 6544] 00:19:53.013 bw ( KiB/s): min= 2048, max=403456, per=4.52%, avg=121742.22, stdev=142531.50, samples=9 00:19:53.013 iops : min= 2, max= 394, avg=118.89, stdev=139.19, samples=9 00:19:53.013 lat (msec) : 250=3.77%, 500=36.50%, 750=15.99%, 1000=0.15%, >=2000=43.59% 00:19:53.013 cpu : usr=0.05%, sys=1.17%, ctx=1151, majf=0, minf=32769 00:19:53.013 IO depths : 1=0.2%, 2=0.3%, 4=0.6%, 8=1.2%, 16=2.4%, 32=4.8%, >=64=90.5% 00:19:53.013 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.013 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:19:53.013 issued rwts: total=663,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.013 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.013 job2: (groupid=0, jobs=1): err= 0: pid=1588004: Sat Apr 27 02:39:24 2024 00:19:53.013 read: IOPS=8, BW=8845KiB/s (9058kB/s)(94.0MiB/10882msec) 00:19:53.013 slat (usec): min=455, max=2062.2k, avg=114510.18, stdev=439759.01 00:19:53.013 clat (msec): min=117, max=10878, avg=8845.24, stdev=2670.55 00:19:53.013 lat (msec): min=2155, max=10881, avg=8959.75, stdev=2518.74 00:19:53.013 clat percentiles (msec): 00:19:53.013 | 1.00th=[ 117], 5.00th=[ 2232], 10.00th=[ 6275], 20.00th=[ 6342], 00:19:53.013 | 30.00th=[ 8557], 40.00th=[10402], 50.00th=[10537], 60.00th=[10537], 00:19:53.013 | 70.00th=[10671], 80.00th=[10805], 90.00th=[10805], 95.00th=[10805], 00:19:53.013 | 99.00th=[10939], 99.50th=[10939], 99.90th=[10939], 99.95th=[10939], 00:19:53.013 | 99.99th=[10939] 00:19:53.013 lat (msec) : 250=1.06%, >=2000=98.94% 00:19:53.013 cpu : usr=0.00%, sys=0.65%, ctx=167, majf=0, minf=24065 00:19:53.013 IO depths : 1=1.1%, 2=2.1%, 4=4.3%, 8=8.5%, 16=17.0%, 32=34.0%, >=64=33.0% 00:19:53.013 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.013 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:19:53.013 issued rwts: total=94,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.013 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.013 job2: (groupid=0, jobs=1): err= 0: pid=1588005: Sat Apr 27 02:39:24 2024 00:19:53.013 read: IOPS=3, BW=3570KiB/s (3655kB/s)(45.0MiB/12909msec) 00:19:53.013 slat (usec): min=854, max=2096.2k, avg=239626.25, stdev=653407.79 00:19:53.013 clat (msec): min=2125, max=12905, avg=11100.71, stdev=2933.17 00:19:53.013 lat (msec): min=4171, max=12908, avg=11340.34, stdev=2605.39 00:19:53.013 clat percentiles (msec): 00:19:53.013 | 1.00th=[ 2123], 5.00th=[ 4212], 10.00th=[ 6342], 20.00th=[ 8557], 00:19:53.013 | 30.00th=[10537], 40.00th=[12818], 50.00th=[12818], 60.00th=[12818], 00:19:53.013 | 70.00th=[12818], 80.00th=[12953], 90.00th=[12953], 95.00th=[12953], 00:19:53.013 | 99.00th=[12953], 99.50th=[12953], 99.90th=[12953], 99.95th=[12953], 00:19:53.013 | 99.99th=[12953] 00:19:53.013 lat (msec) : >=2000=100.00% 00:19:53.013 cpu : usr=0.00%, sys=0.38%, ctx=81, majf=0, minf=11521 00:19:53.013 IO depths : 1=2.2%, 2=4.4%, 4=8.9%, 8=17.8%, 16=35.6%, 32=31.1%, >=64=0.0% 00:19:53.013 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.013 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:19:53.013 issued rwts: total=45,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.013 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.013 job2: (groupid=0, jobs=1): err= 0: pid=1588006: Sat Apr 27 02:39:24 2024 00:19:53.013 read: IOPS=27, BW=27.3MiB/s (28.6MB/s)(350MiB/12815msec) 00:19:53.013 slat (usec): min=74, max=2107.1k, avg=30557.86, stdev=221167.51 00:19:53.013 clat (msec): min=422, max=8484, avg=2554.71, stdev=2465.77 00:19:53.013 lat (msec): min=426, max=8495, avg=2585.27, stdev=2491.51 00:19:53.013 clat percentiles (msec): 00:19:53.013 | 1.00th=[ 426], 5.00th=[ 430], 10.00th=[ 435], 20.00th=[ 443], 00:19:53.013 | 30.00th=[ 451], 40.00th=[ 468], 50.00th=[ 506], 60.00th=[ 4178], 00:19:53.013 | 70.00th=[ 5134], 80.00th=[ 5269], 90.00th=[ 5403], 95.00th=[ 6409], 00:19:53.013 | 99.00th=[ 8490], 99.50th=[ 8490], 99.90th=[ 8490], 99.95th=[ 8490], 00:19:53.013 | 99.99th=[ 8490] 00:19:53.013 bw ( KiB/s): min= 2052, max=280576, per=3.39%, avg=91341.60, stdev=116911.16, samples=5 00:19:53.013 iops : min= 2, max= 274, avg=89.20, stdev=114.17, samples=5 00:19:53.013 lat (msec) : 500=49.14%, 750=4.86%, 2000=3.14%, >=2000=42.86% 00:19:53.013 cpu : usr=0.02%, sys=0.78%, ctx=625, majf=0, minf=32769 00:19:53.013 IO depths : 1=0.3%, 2=0.6%, 4=1.1%, 8=2.3%, 16=4.6%, 32=9.1%, >=64=82.0% 00:19:53.013 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.013 complete : 0=0.0%, 4=99.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.4% 00:19:53.013 issued rwts: total=350,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.013 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.013 job2: (groupid=0, jobs=1): err= 0: pid=1588007: Sat Apr 27 02:39:24 2024 00:19:53.013 read: IOPS=77, BW=77.6MiB/s (81.4MB/s)(1004MiB/12938msec) 00:19:53.013 slat (usec): min=44, max=2036.9k, avg=10788.09, stdev=91548.01 00:19:53.013 clat (msec): min=460, max=6806, avg=1587.68, stdev=1800.65 00:19:53.013 lat (msec): min=461, max=6814, avg=1598.47, stdev=1806.08 00:19:53.013 clat percentiles (msec): 00:19:53.013 | 1.00th=[ 468], 5.00th=[ 477], 10.00th=[ 493], 20.00th=[ 535], 00:19:53.013 | 30.00th=[ 659], 40.00th=[ 793], 50.00th=[ 936], 60.00th=[ 1083], 00:19:53.013 | 70.00th=[ 1301], 80.00th=[ 1418], 90.00th=[ 4279], 95.00th=[ 6611], 00:19:53.013 | 99.00th=[ 6812], 99.50th=[ 6812], 99.90th=[ 6812], 99.95th=[ 6812], 00:19:53.013 | 99.99th=[ 6812] 00:19:53.013 bw ( KiB/s): min= 2052, max=264192, per=4.45%, avg=119740.00, stdev=84843.84, samples=15 00:19:53.013 iops : min= 2, max= 258, avg=116.93, stdev=82.86, samples=15 00:19:53.013 lat (msec) : 500=12.95%, 750=22.41%, 1000=19.62%, 2000=29.58%, >=2000=15.44% 00:19:53.013 cpu : usr=0.03%, sys=1.60%, ctx=1276, majf=0, minf=32769 00:19:53.013 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.8%, 16=1.6%, 32=3.2%, >=64=93.7% 00:19:53.013 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.013 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:53.013 issued rwts: total=1004,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.013 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.013 job2: (groupid=0, jobs=1): err= 0: pid=1588008: Sat Apr 27 02:39:24 2024 00:19:53.013 read: IOPS=6, BW=6152KiB/s (6300kB/s)(65.0MiB/10819msec) 00:19:53.013 slat (usec): min=907, max=2057.4k, avg=164290.84, stdev=543817.83 00:19:53.013 clat (msec): min=139, max=10815, avg=7014.22, stdev=3422.61 00:19:53.013 lat (msec): min=2150, max=10818, avg=7178.51, stdev=3342.83 00:19:53.013 clat percentiles (msec): 00:19:53.013 | 1.00th=[ 140], 5.00th=[ 2165], 10.00th=[ 2198], 20.00th=[ 2232], 00:19:53.013 | 30.00th=[ 4329], 40.00th=[ 6477], 50.00th=[ 6544], 60.00th=[ 8658], 00:19:53.013 | 70.00th=[10671], 80.00th=[10805], 90.00th=[10805], 95.00th=[10805], 00:19:53.013 | 99.00th=[10805], 99.50th=[10805], 99.90th=[10805], 99.95th=[10805], 00:19:53.013 | 99.99th=[10805] 00:19:53.013 lat (msec) : 250=1.54%, >=2000=98.46% 00:19:53.013 cpu : usr=0.00%, sys=0.56%, ctx=73, majf=0, minf=16641 00:19:53.013 IO depths : 1=1.5%, 2=3.1%, 4=6.2%, 8=12.3%, 16=24.6%, 32=49.2%, >=64=3.1% 00:19:53.013 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.013 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:19:53.013 issued rwts: total=65,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.013 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.013 job2: (groupid=0, jobs=1): err= 0: pid=1588009: Sat Apr 27 02:39:24 2024 00:19:53.013 read: IOPS=4, BW=4925KiB/s (5044kB/s)(62.0MiB/12890msec) 00:19:53.013 slat (usec): min=719, max=2099.4k, avg=173835.60, stdev=563876.04 00:19:53.013 clat (msec): min=2111, max=12887, avg=9577.30, stdev=3429.70 00:19:53.013 lat (msec): min=4171, max=12889, avg=9751.13, stdev=3316.38 00:19:53.013 clat percentiles (msec): 00:19:53.014 | 1.00th=[ 2106], 5.00th=[ 4178], 10.00th=[ 4212], 20.00th=[ 6342], 00:19:53.014 | 30.00th=[ 6342], 40.00th=[ 8490], 50.00th=[10671], 60.00th=[12818], 00:19:53.014 | 70.00th=[12818], 80.00th=[12818], 90.00th=[12818], 95.00th=[12818], 00:19:53.014 | 99.00th=[12953], 99.50th=[12953], 99.90th=[12953], 99.95th=[12953], 00:19:53.014 | 99.99th=[12953] 00:19:53.014 lat (msec) : >=2000=100.00% 00:19:53.014 cpu : usr=0.01%, sys=0.43%, ctx=75, majf=0, minf=15873 00:19:53.014 IO depths : 1=1.6%, 2=3.2%, 4=6.5%, 8=12.9%, 16=25.8%, 32=50.0%, >=64=0.0% 00:19:53.014 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.014 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:19:53.014 issued rwts: total=62,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.014 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.014 job2: (groupid=0, jobs=1): err= 0: pid=1588010: Sat Apr 27 02:39:24 2024 00:19:53.014 read: IOPS=2, BW=2945KiB/s (3015kB/s)(37.0MiB/12867msec) 00:19:53.014 slat (usec): min=870, max=2100.1k, avg=291188.96, stdev=712869.92 00:19:53.014 clat (msec): min=2092, max=12809, avg=7558.36, stdev=3366.27 00:19:53.014 lat (msec): min=4168, max=12866, avg=7849.55, stdev=3346.24 00:19:53.014 clat percentiles (msec): 00:19:53.014 | 1.00th=[ 2089], 5.00th=[ 4178], 10.00th=[ 4178], 20.00th=[ 4212], 00:19:53.014 | 30.00th=[ 6275], 40.00th=[ 6342], 50.00th=[ 6342], 60.00th=[ 6409], 00:19:53.014 | 70.00th=[ 8490], 80.00th=[12684], 90.00th=[12818], 95.00th=[12818], 00:19:53.014 | 99.00th=[12818], 99.50th=[12818], 99.90th=[12818], 99.95th=[12818], 00:19:53.014 | 99.99th=[12818] 00:19:53.014 lat (msec) : >=2000=100.00% 00:19:53.014 cpu : usr=0.00%, sys=0.26%, ctx=72, majf=0, minf=9473 00:19:53.014 IO depths : 1=2.7%, 2=5.4%, 4=10.8%, 8=21.6%, 16=43.2%, 32=16.2%, >=64=0.0% 00:19:53.014 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.014 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:19:53.014 issued rwts: total=37,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.014 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.014 job3: (groupid=0, jobs=1): err= 0: pid=1588013: Sat Apr 27 02:39:24 2024 00:19:53.014 read: IOPS=2, BW=2163KiB/s (2215kB/s)(27.0MiB/12784msec) 00:19:53.014 slat (usec): min=943, max=2093.1k, avg=395281.90, stdev=806778.88 00:19:53.014 clat (msec): min=2110, max=12782, avg=8796.49, stdev=3329.06 00:19:53.014 lat (msec): min=4159, max=12783, avg=9191.77, stdev=3132.53 00:19:53.014 clat percentiles (msec): 00:19:53.014 | 1.00th=[ 2106], 5.00th=[ 4144], 10.00th=[ 4178], 20.00th=[ 6342], 00:19:53.014 | 30.00th=[ 6342], 40.00th=[ 8490], 50.00th=[ 8490], 60.00th=[10671], 00:19:53.014 | 70.00th=[10671], 80.00th=[12684], 90.00th=[12818], 95.00th=[12818], 00:19:53.014 | 99.00th=[12818], 99.50th=[12818], 99.90th=[12818], 99.95th=[12818], 00:19:53.014 | 99.99th=[12818] 00:19:53.014 lat (msec) : >=2000=100.00% 00:19:53.014 cpu : usr=0.02%, sys=0.16%, ctx=59, majf=0, minf=6913 00:19:53.014 IO depths : 1=3.7%, 2=7.4%, 4=14.8%, 8=29.6%, 16=44.4%, 32=0.0%, >=64=0.0% 00:19:53.014 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.014 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0% 00:19:53.014 issued rwts: total=27,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.014 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.014 job3: (groupid=0, jobs=1): err= 0: pid=1588014: Sat Apr 27 02:39:24 2024 00:19:53.014 read: IOPS=75, BW=75.0MiB/s (78.7MB/s)(966MiB/12878msec) 00:19:53.014 slat (usec): min=56, max=2104.1k, avg=11152.14, stdev=111618.15 00:19:53.014 clat (msec): min=372, max=8864, avg=1648.46, stdev=2646.34 00:19:53.014 lat (msec): min=375, max=8870, avg=1659.61, stdev=2654.93 00:19:53.014 clat percentiles (msec): 00:19:53.014 | 1.00th=[ 405], 5.00th=[ 456], 10.00th=[ 485], 20.00th=[ 493], 00:19:53.014 | 30.00th=[ 498], 40.00th=[ 510], 50.00th=[ 527], 60.00th=[ 625], 00:19:53.014 | 70.00th=[ 693], 80.00th=[ 1045], 90.00th=[ 8288], 95.00th=[ 8658], 00:19:53.014 | 99.00th=[ 8792], 99.50th=[ 8792], 99.90th=[ 8926], 99.95th=[ 8926], 00:19:53.014 | 99.99th=[ 8926] 00:19:53.014 bw ( KiB/s): min= 2043, max=290816, per=4.91%, avg=132174.69, stdev=108867.61, samples=13 00:19:53.014 iops : min= 1, max= 284, avg=129.00, stdev=106.42, samples=13 00:19:53.014 lat (msec) : 500=33.33%, 750=38.72%, 1000=6.21%, 2000=7.76%, >=2000=13.98% 00:19:53.014 cpu : usr=0.02%, sys=1.48%, ctx=1531, majf=0, minf=32769 00:19:53.014 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.8%, 16=1.7%, 32=3.3%, >=64=93.5% 00:19:53.014 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.014 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:53.014 issued rwts: total=966,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.014 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.014 job3: (groupid=0, jobs=1): err= 0: pid=1588015: Sat Apr 27 02:39:24 2024 00:19:53.014 read: IOPS=20, BW=20.1MiB/s (21.1MB/s)(217MiB/10770msec) 00:19:53.014 slat (usec): min=75, max=2173.2k, avg=48959.33, stdev=279588.17 00:19:53.014 clat (msec): min=144, max=6037, avg=1885.25, stdev=851.27 00:19:53.014 lat (msec): min=634, max=8210, avg=1934.21, stdev=941.87 00:19:53.014 clat percentiles (msec): 00:19:53.014 | 1.00th=[ 625], 5.00th=[ 659], 10.00th=[ 701], 20.00th=[ 818], 00:19:53.014 | 30.00th=[ 1167], 40.00th=[ 1854], 50.00th=[ 2299], 60.00th=[ 2366], 00:19:53.014 | 70.00th=[ 2433], 80.00th=[ 2534], 90.00th=[ 2668], 95.00th=[ 2735], 00:19:53.014 | 99.00th=[ 3876], 99.50th=[ 3943], 99.90th=[ 6007], 99.95th=[ 6007], 00:19:53.014 | 99.99th=[ 6007] 00:19:53.014 bw ( KiB/s): min= 2048, max=147456, per=2.28%, avg=61440.00, stdev=76272.54, samples=3 00:19:53.014 iops : min= 2, max= 144, avg=60.00, stdev=74.48, samples=3 00:19:53.014 lat (msec) : 250=0.46%, 750=15.21%, 1000=11.06%, 2000=13.36%, >=2000=59.91% 00:19:53.014 cpu : usr=0.00%, sys=1.04%, ctx=565, majf=0, minf=32769 00:19:53.014 IO depths : 1=0.5%, 2=0.9%, 4=1.8%, 8=3.7%, 16=7.4%, 32=14.7%, >=64=71.0% 00:19:53.014 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.014 complete : 0=0.0%, 4=98.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=1.1% 00:19:53.014 issued rwts: total=217,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.014 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.014 job3: (groupid=0, jobs=1): err= 0: pid=1588016: Sat Apr 27 02:39:24 2024 00:19:53.014 read: IOPS=12, BW=12.4MiB/s (13.0MB/s)(158MiB/12792msec) 00:19:53.014 slat (usec): min=94, max=2080.0k, avg=67571.60, stdev=330507.74 00:19:53.014 clat (msec): min=2115, max=12644, avg=7631.68, stdev=2231.99 00:19:53.014 lat (msec): min=4169, max=12651, avg=7699.26, stdev=2220.23 00:19:53.014 clat percentiles (msec): 00:19:53.014 | 1.00th=[ 4178], 5.00th=[ 4597], 10.00th=[ 4665], 20.00th=[ 6007], 00:19:53.014 | 30.00th=[ 6141], 40.00th=[ 6275], 50.00th=[ 6409], 60.00th=[ 8356], 00:19:53.014 | 70.00th=[10134], 80.00th=[10268], 90.00th=[10402], 95.00th=[10402], 00:19:53.014 | 99.00th=[10671], 99.50th=[12684], 99.90th=[12684], 99.95th=[12684], 00:19:53.014 | 99.99th=[12684] 00:19:53.014 bw ( KiB/s): min= 2052, max=49152, per=0.79%, avg=21164.00, stdev=24772.77, samples=3 00:19:53.014 iops : min= 2, max= 48, avg=20.67, stdev=24.19, samples=3 00:19:53.014 lat (msec) : >=2000=100.00% 00:19:53.014 cpu : usr=0.04%, sys=0.63%, ctx=295, majf=0, minf=32769 00:19:53.014 IO depths : 1=0.6%, 2=1.3%, 4=2.5%, 8=5.1%, 16=10.1%, 32=20.3%, >=64=60.1% 00:19:53.014 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.014 complete : 0=0.0%, 4=96.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=3.1% 00:19:53.014 issued rwts: total=158,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.014 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.014 job3: (groupid=0, jobs=1): err= 0: pid=1588017: Sat Apr 27 02:39:24 2024 00:19:53.014 read: IOPS=7, BW=7527KiB/s (7708kB/s)(94.0MiB/12788msec) 00:19:53.014 slat (usec): min=632, max=2042.7k, avg=113504.79, stdev=445409.68 00:19:53.014 clat (msec): min=2117, max=12785, avg=8961.78, stdev=2488.44 00:19:53.014 lat (msec): min=4160, max=12787, avg=9075.29, stdev=2415.15 00:19:53.014 clat percentiles (msec): 00:19:53.014 | 1.00th=[ 2123], 5.00th=[ 4245], 10.00th=[ 6342], 20.00th=[ 8356], 00:19:53.014 | 30.00th=[ 8356], 40.00th=[ 8423], 50.00th=[ 8423], 60.00th=[ 8557], 00:19:53.014 | 70.00th=[10537], 80.00th=[10671], 90.00th=[12684], 95.00th=[12818], 00:19:53.014 | 99.00th=[12818], 99.50th=[12818], 99.90th=[12818], 99.95th=[12818], 00:19:53.015 | 99.99th=[12818] 00:19:53.015 lat (msec) : >=2000=100.00% 00:19:53.015 cpu : usr=0.02%, sys=0.59%, ctx=84, majf=0, minf=24065 00:19:53.015 IO depths : 1=1.1%, 2=2.1%, 4=4.3%, 8=8.5%, 16=17.0%, 32=34.0%, >=64=33.0% 00:19:53.015 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.015 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:19:53.015 issued rwts: total=94,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.015 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.015 job3: (groupid=0, jobs=1): err= 0: pid=1588018: Sat Apr 27 02:39:24 2024 00:19:53.015 read: IOPS=1, BW=1684KiB/s (1724kB/s)(21.0MiB/12770msec) 00:19:53.015 slat (msec): min=7, max=2092, avg=507.24, stdev=888.70 00:19:53.015 clat (msec): min=2117, max=12714, avg=8379.01, stdev=3113.94 00:19:53.015 lat (msec): min=4171, max=12769, avg=8886.25, stdev=2903.51 00:19:53.015 clat percentiles (msec): 00:19:53.015 | 1.00th=[ 2123], 5.00th=[ 4178], 10.00th=[ 4212], 20.00th=[ 6342], 00:19:53.015 | 30.00th=[ 6342], 40.00th=[ 8490], 50.00th=[ 8490], 60.00th=[10537], 00:19:53.015 | 70.00th=[10671], 80.00th=[10671], 90.00th=[12684], 95.00th=[12684], 00:19:53.015 | 99.00th=[12684], 99.50th=[12684], 99.90th=[12684], 99.95th=[12684], 00:19:53.015 | 99.99th=[12684] 00:19:53.015 lat (msec) : >=2000=100.00% 00:19:53.015 cpu : usr=0.02%, sys=0.11%, ctx=57, majf=0, minf=5377 00:19:53.015 IO depths : 1=4.8%, 2=9.5%, 4=19.0%, 8=38.1%, 16=28.6%, 32=0.0%, >=64=0.0% 00:19:53.015 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.015 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0% 00:19:53.015 issued rwts: total=21,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.015 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.015 job3: (groupid=0, jobs=1): err= 0: pid=1588019: Sat Apr 27 02:39:24 2024 00:19:53.015 read: IOPS=9, BW=9461KiB/s (9689kB/s)(118MiB/12771msec) 00:19:53.015 slat (usec): min=417, max=2116.0k, avg=90313.79, stdev=400614.78 00:19:53.015 clat (msec): min=2113, max=12754, avg=11432.00, stdev=2302.84 00:19:53.015 lat (msec): min=4170, max=12770, avg=11522.31, stdev=2137.28 00:19:53.015 clat percentiles (msec): 00:19:53.015 | 1.00th=[ 4178], 5.00th=[ 6342], 10.00th=[ 8490], 20.00th=[10671], 00:19:53.015 | 30.00th=[12281], 40.00th=[12416], 50.00th=[12416], 60.00th=[12550], 00:19:53.015 | 70.00th=[12550], 80.00th=[12550], 90.00th=[12684], 95.00th=[12684], 00:19:53.015 | 99.00th=[12818], 99.50th=[12818], 99.90th=[12818], 99.95th=[12818], 00:19:53.015 | 99.99th=[12818] 00:19:53.015 lat (msec) : >=2000=100.00% 00:19:53.015 cpu : usr=0.00%, sys=0.67%, ctx=123, majf=0, minf=30209 00:19:53.015 IO depths : 1=0.8%, 2=1.7%, 4=3.4%, 8=6.8%, 16=13.6%, 32=27.1%, >=64=46.6% 00:19:53.015 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.015 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:19:53.015 issued rwts: total=118,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.015 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.015 job3: (groupid=0, jobs=1): err= 0: pid=1588020: Sat Apr 27 02:39:24 2024 00:19:53.015 read: IOPS=36, BW=36.2MiB/s (37.9MB/s)(464MiB/12829msec) 00:19:53.015 slat (usec): min=44, max=2085.0k, avg=23079.08, stdev=188979.79 00:19:53.015 clat (msec): min=232, max=7527, avg=1790.77, stdev=1937.60 00:19:53.015 lat (msec): min=233, max=7536, avg=1813.85, stdev=1957.56 00:19:53.015 clat percentiles (msec): 00:19:53.015 | 1.00th=[ 234], 5.00th=[ 247], 10.00th=[ 279], 20.00th=[ 334], 00:19:53.015 | 30.00th=[ 414], 40.00th=[ 502], 50.00th=[ 693], 60.00th=[ 919], 00:19:53.015 | 70.00th=[ 3272], 80.00th=[ 4396], 90.00th=[ 4463], 95.00th=[ 4530], 00:19:53.015 | 99.00th=[ 7483], 99.50th=[ 7483], 99.90th=[ 7550], 99.95th=[ 7550], 00:19:53.015 | 99.99th=[ 7550] 00:19:53.015 bw ( KiB/s): min= 2052, max=442368, per=5.12%, avg=137940.20, stdev=188129.98, samples=5 00:19:53.015 iops : min= 2, max= 432, avg=134.40, stdev=183.79, samples=5 00:19:53.015 lat (msec) : 250=5.39%, 500=34.48%, 750=13.58%, 1000=9.27%, 2000=6.03% 00:19:53.015 lat (msec) : >=2000=31.25% 00:19:53.015 cpu : usr=0.02%, sys=0.92%, ctx=576, majf=0, minf=32769 00:19:53.015 IO depths : 1=0.2%, 2=0.4%, 4=0.9%, 8=1.7%, 16=3.4%, 32=6.9%, >=64=86.4% 00:19:53.015 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.015 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:19:53.015 issued rwts: total=464,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.015 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.015 job3: (groupid=0, jobs=1): err= 0: pid=1588021: Sat Apr 27 02:39:24 2024 00:19:53.015 read: IOPS=10, BW=10.9MiB/s (11.4MB/s)(141MiB/12916msec) 00:19:53.015 slat (usec): min=81, max=2094.7k, avg=76660.83, stdev=363811.06 00:19:53.015 clat (msec): min=2105, max=12892, avg=8376.47, stdev=3161.74 00:19:53.015 lat (msec): min=4178, max=12895, avg=8453.13, stdev=3139.24 00:19:53.015 clat percentiles (msec): 00:19:53.015 | 1.00th=[ 4178], 5.00th=[ 5738], 10.00th=[ 5738], 20.00th=[ 5805], 00:19:53.015 | 30.00th=[ 5940], 40.00th=[ 6074], 50.00th=[ 6275], 60.00th=[ 7148], 00:19:53.015 | 70.00th=[12684], 80.00th=[12818], 90.00th=[12818], 95.00th=[12818], 00:19:53.015 | 99.00th=[12953], 99.50th=[12953], 99.90th=[12953], 99.95th=[12953], 00:19:53.015 | 99.99th=[12953] 00:19:53.015 bw ( KiB/s): min= 2052, max=20480, per=0.35%, avg=9558.67, stdev=9676.92, samples=3 00:19:53.015 iops : min= 2, max= 20, avg= 9.33, stdev= 9.45, samples=3 00:19:53.015 lat (msec) : >=2000=100.00% 00:19:53.015 cpu : usr=0.02%, sys=0.84%, ctx=193, majf=0, minf=32769 00:19:53.015 IO depths : 1=0.7%, 2=1.4%, 4=2.8%, 8=5.7%, 16=11.3%, 32=22.7%, >=64=55.3% 00:19:53.015 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.015 complete : 0=0.0%, 4=93.3%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=6.7% 00:19:53.015 issued rwts: total=141,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.015 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.015 job3: (groupid=0, jobs=1): err= 0: pid=1588022: Sat Apr 27 02:39:24 2024 00:19:53.015 read: IOPS=1, BW=1444KiB/s (1478kB/s)(18.0MiB/12766msec) 00:19:53.015 slat (msec): min=3, max=2115, avg=592.68, stdev=942.69 00:19:53.015 clat (msec): min=2097, max=12656, avg=7996.71, stdev=3057.85 00:19:53.015 lat (msec): min=4153, max=12765, avg=8589.39, stdev=2875.53 00:19:53.015 clat percentiles (msec): 00:19:53.015 | 1.00th=[ 2089], 5.00th=[ 2089], 10.00th=[ 4144], 20.00th=[ 6342], 00:19:53.015 | 30.00th=[ 6342], 40.00th=[ 6342], 50.00th=[ 6409], 60.00th=[ 8490], 00:19:53.015 | 70.00th=[10671], 80.00th=[10671], 90.00th=[12684], 95.00th=[12684], 00:19:53.015 | 99.00th=[12684], 99.50th=[12684], 99.90th=[12684], 99.95th=[12684], 00:19:53.015 | 99.99th=[12684] 00:19:53.015 lat (msec) : >=2000=100.00% 00:19:53.015 cpu : usr=0.01%, sys=0.11%, ctx=55, majf=0, minf=4609 00:19:53.015 IO depths : 1=5.6%, 2=11.1%, 4=22.2%, 8=44.4%, 16=16.7%, 32=0.0%, >=64=0.0% 00:19:53.015 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.015 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0% 00:19:53.015 issued rwts: total=18,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.015 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.015 job3: (groupid=0, jobs=1): err= 0: pid=1588023: Sat Apr 27 02:39:24 2024 00:19:53.015 read: IOPS=27, BW=27.0MiB/s (28.3MB/s)(347MiB/12845msec) 00:19:53.015 slat (usec): min=59, max=2131.8k, avg=30968.19, stdev=221070.63 00:19:53.015 clat (msec): min=192, max=7943, avg=2612.33, stdev=2220.66 00:19:53.015 lat (msec): min=196, max=7951, avg=2643.30, stdev=2236.41 00:19:53.015 clat percentiles (msec): 00:19:53.015 | 1.00th=[ 201], 5.00th=[ 247], 10.00th=[ 326], 20.00th=[ 489], 00:19:53.015 | 30.00th=[ 735], 40.00th=[ 1070], 50.00th=[ 1401], 60.00th=[ 4329], 00:19:53.015 | 70.00th=[ 4329], 80.00th=[ 4396], 90.00th=[ 4396], 95.00th=[ 7819], 00:19:53.015 | 99.00th=[ 7886], 99.50th=[ 7953], 99.90th=[ 7953], 99.95th=[ 7953], 00:19:53.015 | 99.99th=[ 7953] 00:19:53.015 bw ( KiB/s): min= 2052, max=317440, per=4.18%, avg=112641.00, stdev=140023.85, samples=4 00:19:53.015 iops : min= 2, max= 310, avg=110.00, stdev=136.74, samples=4 00:19:53.015 lat (msec) : 250=5.76%, 500=14.70%, 750=10.09%, 1000=5.76%, 2000=17.87% 00:19:53.015 lat (msec) : >=2000=45.82% 00:19:53.015 cpu : usr=0.02%, sys=1.07%, ctx=623, majf=0, minf=32769 00:19:53.015 IO depths : 1=0.3%, 2=0.6%, 4=1.2%, 8=2.3%, 16=4.6%, 32=9.2%, >=64=81.8% 00:19:53.015 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.015 complete : 0=0.0%, 4=99.5%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.5% 00:19:53.015 issued rwts: total=347,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.015 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.015 job3: (groupid=0, jobs=1): err= 0: pid=1588024: Sat Apr 27 02:39:24 2024 00:19:53.015 read: IOPS=125, BW=126MiB/s (132MB/s)(1621MiB/12911msec) 00:19:53.015 slat (usec): min=42, max=2065.0k, avg=6660.70, stdev=73489.64 00:19:53.015 clat (msec): min=122, max=6145, avg=986.57, stdev=1505.89 00:19:53.015 lat (msec): min=123, max=6146, avg=993.23, stdev=1510.09 00:19:53.015 clat percentiles (msec): 00:19:53.015 | 1.00th=[ 126], 5.00th=[ 131], 10.00th=[ 138], 20.00th=[ 232], 00:19:53.015 | 30.00th=[ 430], 40.00th=[ 514], 50.00th=[ 535], 60.00th=[ 600], 00:19:53.015 | 70.00th=[ 693], 80.00th=[ 986], 90.00th=[ 1351], 95.00th=[ 6074], 00:19:53.015 | 99.00th=[ 6141], 99.50th=[ 6141], 99.90th=[ 6141], 99.95th=[ 6141], 00:19:53.015 | 99.99th=[ 6141] 00:19:53.015 bw ( KiB/s): min= 2052, max=579584, per=8.74%, avg=235308.31, stdev=177249.89, samples=13 00:19:53.015 iops : min= 2, max= 566, avg=229.69, stdev=173.14, samples=13 00:19:53.015 lat (msec) : 250=21.16%, 500=15.48%, 750=36.83%, 1000=6.72%, 2000=11.91% 00:19:53.015 lat (msec) : >=2000=7.90% 00:19:53.015 cpu : usr=0.05%, sys=1.97%, ctx=2203, majf=0, minf=32769 00:19:53.015 IO depths : 1=0.1%, 2=0.1%, 4=0.2%, 8=0.5%, 16=1.0%, 32=2.0%, >=64=96.1% 00:19:53.015 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.015 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:53.015 issued rwts: total=1621,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.015 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.015 job3: (groupid=0, jobs=1): err= 0: pid=1588025: Sat Apr 27 02:39:24 2024 00:19:53.015 read: IOPS=42, BW=42.6MiB/s (44.6MB/s)(461MiB/10833msec) 00:19:53.015 slat (usec): min=56, max=2152.8k, avg=23205.15, stdev=190044.05 00:19:53.015 clat (msec): min=133, max=10680, avg=2428.77, stdev=2683.00 00:19:53.015 lat (msec): min=553, max=10683, avg=2451.97, stdev=2699.11 00:19:53.015 clat percentiles (msec): 00:19:53.015 | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 567], 00:19:53.015 | 30.00th=[ 592], 40.00th=[ 617], 50.00th=[ 625], 60.00th=[ 651], 00:19:53.015 | 70.00th=[ 2735], 80.00th=[ 6611], 90.00th=[ 6812], 95.00th=[ 6879], 00:19:53.015 | 99.00th=[ 8658], 99.50th=[10671], 99.90th=[10671], 99.95th=[10671], 00:19:53.015 | 99.99th=[10671] 00:19:53.015 bw ( KiB/s): min= 1625, max=190464, per=3.17%, avg=85451.12, stdev=80512.23, samples=8 00:19:53.016 iops : min= 1, max= 186, avg=83.38, stdev=78.71, samples=8 00:19:53.016 lat (msec) : 250=0.22%, 750=62.26%, >=2000=37.53% 00:19:53.016 cpu : usr=0.07%, sys=1.26%, ctx=360, majf=0, minf=32769 00:19:53.016 IO depths : 1=0.2%, 2=0.4%, 4=0.9%, 8=1.7%, 16=3.5%, 32=6.9%, >=64=86.3% 00:19:53.016 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.016 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:19:53.016 issued rwts: total=461,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.016 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.016 job4: (groupid=0, jobs=1): err= 0: pid=1588029: Sat Apr 27 02:39:24 2024 00:19:53.016 read: IOPS=3, BW=3223KiB/s (3301kB/s)(34.0MiB/10801msec) 00:19:53.016 slat (usec): min=875, max=2155.4k, avg=314439.83, stdev=731759.15 00:19:53.016 clat (msec): min=109, max=10799, avg=8111.74, stdev=3163.18 00:19:53.016 lat (msec): min=2116, max=10800, avg=8426.18, stdev=2860.47 00:19:53.016 clat percentiles (msec): 00:19:53.016 | 1.00th=[ 110], 5.00th=[ 2123], 10.00th=[ 2232], 20.00th=[ 6477], 00:19:53.016 | 30.00th=[ 6544], 40.00th=[ 8658], 50.00th=[ 8658], 60.00th=[10671], 00:19:53.016 | 70.00th=[10671], 80.00th=[10805], 90.00th=[10805], 95.00th=[10805], 00:19:53.016 | 99.00th=[10805], 99.50th=[10805], 99.90th=[10805], 99.95th=[10805], 00:19:53.016 | 99.99th=[10805] 00:19:53.016 lat (msec) : 250=2.94%, >=2000=97.06% 00:19:53.016 cpu : usr=0.01%, sys=0.26%, ctx=60, majf=0, minf=8705 00:19:53.016 IO depths : 1=2.9%, 2=5.9%, 4=11.8%, 8=23.5%, 16=47.1%, 32=8.8%, >=64=0.0% 00:19:53.016 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.016 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:19:53.016 issued rwts: total=34,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.016 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.016 job4: (groupid=0, jobs=1): err= 0: pid=1588030: Sat Apr 27 02:39:24 2024 00:19:53.016 read: IOPS=7, BW=8005KiB/s (8197kB/s)(85.0MiB/10873msec) 00:19:53.016 slat (usec): min=901, max=2122.9k, avg=126613.82, stdev=482892.35 00:19:53.016 clat (msec): min=109, max=10870, avg=9096.53, stdev=3010.22 00:19:53.016 lat (msec): min=2121, max=10872, avg=9223.14, stdev=2849.79 00:19:53.016 clat percentiles (msec): 00:19:53.016 | 1.00th=[ 110], 5.00th=[ 2165], 10.00th=[ 4279], 20.00th=[ 6544], 00:19:53.016 | 30.00th=[ 8658], 40.00th=[10671], 50.00th=[10805], 60.00th=[10805], 00:19:53.016 | 70.00th=[10805], 80.00th=[10805], 90.00th=[10805], 95.00th=[10805], 00:19:53.016 | 99.00th=[10805], 99.50th=[10805], 99.90th=[10805], 99.95th=[10805], 00:19:53.016 | 99.99th=[10805] 00:19:53.016 lat (msec) : 250=1.18%, >=2000=98.82% 00:19:53.016 cpu : usr=0.00%, sys=0.81%, ctx=110, majf=0, minf=21761 00:19:53.016 IO depths : 1=1.2%, 2=2.4%, 4=4.7%, 8=9.4%, 16=18.8%, 32=37.6%, >=64=25.9% 00:19:53.016 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.016 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:19:53.016 issued rwts: total=85,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.016 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.016 job4: (groupid=0, jobs=1): err= 0: pid=1588031: Sat Apr 27 02:39:24 2024 00:19:53.016 read: IOPS=39, BW=39.3MiB/s (41.2MB/s)(425MiB/10817msec) 00:19:53.016 slat (usec): min=36, max=2129.3k, avg=25129.63, stdev=197149.69 00:19:53.016 clat (msec): min=134, max=6796, avg=2445.30, stdev=2685.42 00:19:53.016 lat (msec): min=240, max=6801, avg=2470.43, stdev=2688.89 00:19:53.016 clat percentiles (msec): 00:19:53.016 | 1.00th=[ 249], 5.00th=[ 262], 10.00th=[ 264], 20.00th=[ 266], 00:19:53.016 | 30.00th=[ 279], 40.00th=[ 550], 50.00th=[ 911], 60.00th=[ 1351], 00:19:53.016 | 70.00th=[ 3507], 80.00th=[ 6611], 90.00th=[ 6678], 95.00th=[ 6745], 00:19:53.016 | 99.00th=[ 6812], 99.50th=[ 6812], 99.90th=[ 6812], 99.95th=[ 6812], 00:19:53.016 | 99.99th=[ 6812] 00:19:53.016 bw ( KiB/s): min= 1625, max=329728, per=3.78%, avg=101646.83, stdev=146002.36, samples=6 00:19:53.016 iops : min= 1, max= 322, avg=99.17, stdev=142.66, samples=6 00:19:53.016 lat (msec) : 250=1.41%, 500=37.41%, 750=7.53%, 1000=5.88%, 2000=11.29% 00:19:53.016 lat (msec) : >=2000=36.47% 00:19:53.016 cpu : usr=0.02%, sys=0.99%, ctx=543, majf=0, minf=32769 00:19:53.016 IO depths : 1=0.2%, 2=0.5%, 4=0.9%, 8=1.9%, 16=3.8%, 32=7.5%, >=64=85.2% 00:19:53.016 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.016 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:19:53.016 issued rwts: total=425,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.016 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.016 job4: (groupid=0, jobs=1): err= 0: pid=1588032: Sat Apr 27 02:39:24 2024 00:19:53.016 read: IOPS=47, BW=47.6MiB/s (49.9MB/s)(512MiB/10762msec) 00:19:53.016 slat (usec): min=45, max=2026.9k, avg=19534.42, stdev=171394.25 00:19:53.016 clat (msec): min=364, max=8761, avg=1926.94, stdev=2823.32 00:19:53.016 lat (msec): min=367, max=8763, avg=1946.47, stdev=2840.97 00:19:53.016 clat percentiles (msec): 00:19:53.016 | 1.00th=[ 372], 5.00th=[ 384], 10.00th=[ 397], 20.00th=[ 405], 00:19:53.016 | 30.00th=[ 409], 40.00th=[ 409], 50.00th=[ 409], 60.00th=[ 835], 00:19:53.016 | 70.00th=[ 978], 80.00th=[ 2534], 90.00th=[ 8557], 95.00th=[ 8658], 00:19:53.016 | 99.00th=[ 8792], 99.50th=[ 8792], 99.90th=[ 8792], 99.95th=[ 8792], 00:19:53.016 | 99.99th=[ 8792] 00:19:53.016 bw ( KiB/s): min=151552, max=322938, per=9.75%, avg=262402.67, stdev=96135.40, samples=3 00:19:53.016 iops : min= 148, max= 315, avg=256.00, stdev=93.66, samples=3 00:19:53.016 lat (msec) : 500=55.08%, 1000=16.21%, 2000=7.62%, >=2000=21.09% 00:19:53.016 cpu : usr=0.02%, sys=1.37%, ctx=481, majf=0, minf=32769 00:19:53.016 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.6%, 16=3.1%, 32=6.2%, >=64=87.7% 00:19:53.016 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.016 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:19:53.016 issued rwts: total=512,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.016 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.016 job4: (groupid=0, jobs=1): err= 0: pid=1588033: Sat Apr 27 02:39:24 2024 00:19:53.016 read: IOPS=26, BW=26.2MiB/s (27.5MB/s)(284MiB/10829msec) 00:19:53.016 slat (usec): min=88, max=2044.7k, avg=37758.30, stdev=243813.02 00:19:53.016 clat (msec): min=103, max=6952, avg=2679.54, stdev=1873.60 00:19:53.016 lat (msec): min=529, max=6955, avg=2717.30, stdev=1894.80 00:19:53.016 clat percentiles (msec): 00:19:53.016 | 1.00th=[ 527], 5.00th=[ 542], 10.00th=[ 558], 20.00th=[ 600], 00:19:53.016 | 30.00th=[ 667], 40.00th=[ 2123], 50.00th=[ 3306], 60.00th=[ 3440], 00:19:53.016 | 70.00th=[ 3540], 80.00th=[ 3675], 90.00th=[ 4933], 95.00th=[ 6879], 00:19:53.016 | 99.00th=[ 6946], 99.50th=[ 6946], 99.90th=[ 6946], 99.95th=[ 6946], 00:19:53.016 | 99.99th=[ 6946] 00:19:53.016 bw ( KiB/s): min= 6144, max=235520, per=2.97%, avg=79872.00, stdev=104908.79, samples=4 00:19:53.016 iops : min= 6, max= 230, avg=78.00, stdev=102.45, samples=4 00:19:53.016 lat (msec) : 250=0.35%, 750=32.39%, 2000=6.69%, >=2000=60.56% 00:19:53.016 cpu : usr=0.00%, sys=1.19%, ctx=245, majf=0, minf=32769 00:19:53.016 IO depths : 1=0.4%, 2=0.7%, 4=1.4%, 8=2.8%, 16=5.6%, 32=11.3%, >=64=77.8% 00:19:53.016 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.016 complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.6% 00:19:53.016 issued rwts: total=284,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.016 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.016 job4: (groupid=0, jobs=1): err= 0: pid=1588034: Sat Apr 27 02:39:24 2024 00:19:53.016 read: IOPS=22, BW=22.6MiB/s (23.7MB/s)(288MiB/12755msec) 00:19:53.016 slat (usec): min=45, max=2069.0k, avg=36838.20, stdev=243842.01 00:19:53.016 clat (msec): min=512, max=11917, avg=5456.39, stdev=4958.92 00:19:53.016 lat (msec): min=514, max=11917, avg=5493.23, stdev=4967.22 00:19:53.016 clat percentiles (msec): 00:19:53.016 | 1.00th=[ 514], 5.00th=[ 531], 10.00th=[ 550], 20.00th=[ 567], 00:19:53.016 | 30.00th=[ 584], 40.00th=[ 625], 50.00th=[ 3574], 60.00th=[ 7752], 00:19:53.016 | 70.00th=[11610], 80.00th=[11610], 90.00th=[11745], 95.00th=[11879], 00:19:53.016 | 99.00th=[11879], 99.50th=[11879], 99.90th=[11879], 99.95th=[11879], 00:19:53.016 | 99.99th=[11879] 00:19:53.016 bw ( KiB/s): min= 2048, max=151552, per=1.75%, avg=47075.29, stdev=56266.63, samples=7 00:19:53.016 iops : min= 2, max= 148, avg=45.86, stdev=54.82, samples=7 00:19:53.016 lat (msec) : 750=42.71%, 2000=3.12%, >=2000=54.17% 00:19:53.016 cpu : usr=0.02%, sys=0.89%, ctx=260, majf=0, minf=32769 00:19:53.016 IO depths : 1=0.3%, 2=0.7%, 4=1.4%, 8=2.8%, 16=5.6%, 32=11.1%, >=64=78.1% 00:19:53.016 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.016 complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.6% 00:19:53.016 issued rwts: total=288,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.016 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.016 job4: (groupid=0, jobs=1): err= 0: pid=1588035: Sat Apr 27 02:39:24 2024 00:19:53.016 read: IOPS=25, BW=25.5MiB/s (26.8MB/s)(278MiB/10882msec) 00:19:53.016 slat (usec): min=87, max=2064.5k, avg=38731.60, stdev=241937.84 00:19:53.016 clat (msec): min=112, max=7566, avg=2798.44, stdev=2020.70 00:19:53.016 lat (msec): min=665, max=7570, avg=2837.17, stdev=2029.76 00:19:53.016 clat percentiles (msec): 00:19:53.016 | 1.00th=[ 667], 5.00th=[ 735], 10.00th=[ 818], 20.00th=[ 1003], 00:19:53.016 | 30.00th=[ 1167], 40.00th=[ 2265], 50.00th=[ 2869], 60.00th=[ 2970], 00:19:53.016 | 70.00th=[ 3071], 80.00th=[ 3239], 90.00th=[ 7416], 95.00th=[ 7483], 00:19:53.016 | 99.00th=[ 7550], 99.50th=[ 7550], 99.90th=[ 7550], 99.95th=[ 7550], 00:19:53.016 | 99.99th=[ 7550] 00:19:53.016 bw ( KiB/s): min=30720, max=204800, per=2.85%, avg=76800.00, stdev=85404.30, samples=4 00:19:53.016 iops : min= 30, max= 200, avg=75.00, stdev=83.40, samples=4 00:19:53.016 lat (msec) : 250=0.36%, 750=6.47%, 1000=12.95%, 2000=17.63%, >=2000=62.59% 00:19:53.016 cpu : usr=0.00%, sys=1.32%, ctx=407, majf=0, minf=32769 00:19:53.016 IO depths : 1=0.4%, 2=0.7%, 4=1.4%, 8=2.9%, 16=5.8%, 32=11.5%, >=64=77.3% 00:19:53.016 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.016 complete : 0=0.0%, 4=99.3%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.7% 00:19:53.016 issued rwts: total=278,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.016 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.016 job4: (groupid=0, jobs=1): err= 0: pid=1588036: Sat Apr 27 02:39:24 2024 00:19:53.016 read: IOPS=2, BW=2475KiB/s (2535kB/s)(26.0MiB/10756msec) 00:19:53.016 slat (usec): min=1002, max=2176.8k, avg=409671.48, stdev=833870.91 00:19:53.016 clat (msec): min=103, max=10752, avg=6561.26, stdev=2940.37 00:19:53.016 lat (msec): min=2123, max=10755, avg=6970.93, stdev=2739.82 00:19:53.016 clat percentiles (msec): 00:19:53.016 | 1.00th=[ 104], 5.00th=[ 2123], 10.00th=[ 2123], 20.00th=[ 4329], 00:19:53.016 | 30.00th=[ 4329], 40.00th=[ 6477], 50.00th=[ 6477], 60.00th=[ 8658], 00:19:53.016 | 70.00th=[ 8658], 80.00th=[ 8658], 90.00th=[10805], 95.00th=[10805], 00:19:53.016 | 99.00th=[10805], 99.50th=[10805], 99.90th=[10805], 99.95th=[10805], 00:19:53.017 | 99.99th=[10805] 00:19:53.017 lat (msec) : 250=3.85%, >=2000=96.15% 00:19:53.017 cpu : usr=0.00%, sys=0.19%, ctx=57, majf=0, minf=6657 00:19:53.017 IO depths : 1=3.8%, 2=7.7%, 4=15.4%, 8=30.8%, 16=42.3%, 32=0.0%, >=64=0.0% 00:19:53.017 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.017 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0% 00:19:53.017 issued rwts: total=26,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.017 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.017 job4: (groupid=0, jobs=1): err= 0: pid=1588037: Sat Apr 27 02:39:24 2024 00:19:53.017 read: IOPS=29, BW=29.8MiB/s (31.3MB/s)(322MiB/10794msec) 00:19:53.017 slat (usec): min=73, max=2017.2k, avg=33076.90, stdev=188756.30 00:19:53.017 clat (msec): min=140, max=5078, avg=2824.80, stdev=874.39 00:19:53.017 lat (msec): min=1037, max=5092, avg=2857.87, stdev=866.41 00:19:53.017 clat percentiles (msec): 00:19:53.017 | 1.00th=[ 1028], 5.00th=[ 1133], 10.00th=[ 2165], 20.00th=[ 2232], 00:19:53.017 | 30.00th=[ 2265], 40.00th=[ 2299], 50.00th=[ 2735], 60.00th=[ 3171], 00:19:53.017 | 70.00th=[ 3406], 80.00th=[ 3641], 90.00th=[ 3809], 95.00th=[ 3943], 00:19:53.017 | 99.00th=[ 5067], 99.50th=[ 5067], 99.90th=[ 5067], 99.95th=[ 5067], 00:19:53.017 | 99.99th=[ 5067] 00:19:53.017 bw ( KiB/s): min= 1625, max=131072, per=2.12%, avg=56991.00, stdev=47752.43, samples=7 00:19:53.017 iops : min= 1, max= 128, avg=55.57, stdev=46.75, samples=7 00:19:53.017 lat (msec) : 250=0.31%, 2000=9.63%, >=2000=90.06% 00:19:53.017 cpu : usr=0.03%, sys=0.97%, ctx=636, majf=0, minf=32769 00:19:53.017 IO depths : 1=0.3%, 2=0.6%, 4=1.2%, 8=2.5%, 16=5.0%, 32=9.9%, >=64=80.4% 00:19:53.017 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.017 complete : 0=0.0%, 4=99.5%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.5% 00:19:53.017 issued rwts: total=322,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.017 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.017 job4: (groupid=0, jobs=1): err= 0: pid=1588038: Sat Apr 27 02:39:24 2024 00:19:53.017 read: IOPS=36, BW=36.2MiB/s (37.9MB/s)(395MiB/10922msec) 00:19:53.017 slat (usec): min=67, max=2040.3k, avg=27284.60, stdev=184343.96 00:19:53.017 clat (msec): min=140, max=6613, avg=2993.27, stdev=2195.32 00:19:53.017 lat (msec): min=766, max=6613, avg=3020.56, stdev=2193.20 00:19:53.017 clat percentiles (msec): 00:19:53.017 | 1.00th=[ 760], 5.00th=[ 785], 10.00th=[ 818], 20.00th=[ 902], 00:19:53.017 | 30.00th=[ 995], 40.00th=[ 1150], 50.00th=[ 2232], 60.00th=[ 3540], 00:19:53.017 | 70.00th=[ 4463], 80.00th=[ 5873], 90.00th=[ 6275], 95.00th=[ 6477], 00:19:53.017 | 99.00th=[ 6611], 99.50th=[ 6611], 99.90th=[ 6611], 99.95th=[ 6611], 00:19:53.017 | 99.99th=[ 6611] 00:19:53.017 bw ( KiB/s): min= 6144, max=153600, per=2.54%, avg=68352.00, stdev=60198.04, samples=8 00:19:53.017 iops : min= 6, max= 150, avg=66.75, stdev=58.79, samples=8 00:19:53.017 lat (msec) : 250=0.25%, 750=0.25%, 1000=29.87%, 2000=17.47%, >=2000=52.15% 00:19:53.017 cpu : usr=0.00%, sys=1.36%, ctx=645, majf=0, minf=32769 00:19:53.017 IO depths : 1=0.3%, 2=0.5%, 4=1.0%, 8=2.0%, 16=4.1%, 32=8.1%, >=64=84.1% 00:19:53.017 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.017 complete : 0=0.0%, 4=99.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.4% 00:19:53.017 issued rwts: total=395,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.017 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.017 job4: (groupid=0, jobs=1): err= 0: pid=1588039: Sat Apr 27 02:39:24 2024 00:19:53.017 read: IOPS=146, BW=146MiB/s (153MB/s)(1583MiB/10833msec) 00:19:53.017 slat (usec): min=52, max=2119.6k, avg=6750.02, stdev=88529.08 00:19:53.017 clat (msec): min=123, max=4882, avg=715.63, stdev=1194.68 00:19:53.017 lat (msec): min=124, max=4884, avg=722.38, stdev=1199.65 00:19:53.017 clat percentiles (msec): 00:19:53.017 | 1.00th=[ 125], 5.00th=[ 126], 10.00th=[ 127], 20.00th=[ 129], 00:19:53.017 | 30.00th=[ 213], 40.00th=[ 266], 50.00th=[ 338], 60.00th=[ 443], 00:19:53.017 | 70.00th=[ 493], 80.00th=[ 575], 90.00th=[ 726], 95.00th=[ 4597], 00:19:53.017 | 99.00th=[ 4799], 99.50th=[ 4866], 99.90th=[ 4866], 99.95th=[ 4866], 00:19:53.017 | 99.99th=[ 4866] 00:19:53.017 bw ( KiB/s): min= 1625, max=749568, per=11.07%, avg=298192.80, stdev=246252.06, samples=10 00:19:53.017 iops : min= 1, max= 732, avg=291.10, stdev=240.57, samples=10 00:19:53.017 lat (msec) : 250=34.11%, 500=36.64%, 750=19.27%, >=2000=9.98% 00:19:53.017 cpu : usr=0.06%, sys=2.34%, ctx=1367, majf=0, minf=32769 00:19:53.017 IO depths : 1=0.1%, 2=0.1%, 4=0.3%, 8=0.5%, 16=1.0%, 32=2.0%, >=64=96.0% 00:19:53.017 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.017 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:53.017 issued rwts: total=1583,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.017 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.017 job4: (groupid=0, jobs=1): err= 0: pid=1588040: Sat Apr 27 02:39:24 2024 00:19:53.017 read: IOPS=3, BW=3135KiB/s (3210kB/s)(33.0MiB/10779msec) 00:19:53.017 slat (usec): min=920, max=2100.0k, avg=322528.39, stdev=740022.62 00:19:53.017 clat (msec): min=134, max=10775, avg=5825.40, stdev=3506.54 00:19:53.017 lat (msec): min=2153, max=10778, avg=6147.93, stdev=3455.88 00:19:53.017 clat percentiles (msec): 00:19:53.017 | 1.00th=[ 136], 5.00th=[ 2165], 10.00th=[ 2198], 20.00th=[ 2232], 00:19:53.017 | 30.00th=[ 2232], 40.00th=[ 4329], 50.00th=[ 4396], 60.00th=[ 6477], 00:19:53.017 | 70.00th=[ 8658], 80.00th=[10671], 90.00th=[10805], 95.00th=[10805], 00:19:53.017 | 99.00th=[10805], 99.50th=[10805], 99.90th=[10805], 99.95th=[10805], 00:19:53.017 | 99.99th=[10805] 00:19:53.017 lat (msec) : 250=3.03%, >=2000=96.97% 00:19:53.017 cpu : usr=0.02%, sys=0.28%, ctx=69, majf=0, minf=8449 00:19:53.017 IO depths : 1=3.0%, 2=6.1%, 4=12.1%, 8=24.2%, 16=48.5%, 32=6.1%, >=64=0.0% 00:19:53.017 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.017 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:19:53.017 issued rwts: total=33,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.017 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.017 job4: (groupid=0, jobs=1): err= 0: pid=1588041: Sat Apr 27 02:39:24 2024 00:19:53.017 read: IOPS=8, BW=8257KiB/s (8455kB/s)(87.0MiB/10790msec) 00:19:53.017 slat (usec): min=640, max=2071.6k, avg=122465.68, stdev=464635.41 00:19:53.017 clat (msec): min=134, max=10785, avg=8152.10, stdev=2360.40 00:19:53.017 lat (msec): min=2152, max=10789, avg=8274.57, stdev=2211.28 00:19:53.017 clat percentiles (msec): 00:19:53.017 | 1.00th=[ 136], 5.00th=[ 2232], 10.00th=[ 4329], 20.00th=[ 8423], 00:19:53.017 | 30.00th=[ 8423], 40.00th=[ 8490], 50.00th=[ 8490], 60.00th=[ 8557], 00:19:53.017 | 70.00th=[ 8557], 80.00th=[10671], 90.00th=[10805], 95.00th=[10805], 00:19:53.017 | 99.00th=[10805], 99.50th=[10805], 99.90th=[10805], 99.95th=[10805], 00:19:53.017 | 99.99th=[10805] 00:19:53.017 lat (msec) : 250=1.15%, >=2000=98.85% 00:19:53.017 cpu : usr=0.00%, sys=0.71%, ctx=103, majf=0, minf=22273 00:19:53.017 IO depths : 1=1.1%, 2=2.3%, 4=4.6%, 8=9.2%, 16=18.4%, 32=36.8%, >=64=27.6% 00:19:53.017 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.017 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:19:53.017 issued rwts: total=87,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.017 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.017 job5: (groupid=0, jobs=1): err= 0: pid=1588042: Sat Apr 27 02:39:24 2024 00:19:53.017 read: IOPS=10, BW=10.9MiB/s (11.4MB/s)(119MiB/10911msec) 00:19:53.017 slat (usec): min=594, max=2010.4k, avg=90496.91, stdev=396498.81 00:19:53.017 clat (msec): min=141, max=10909, avg=7826.13, stdev=3375.39 00:19:53.017 lat (msec): min=2151, max=10910, avg=7916.63, stdev=3311.36 00:19:53.017 clat percentiles (msec): 00:19:53.017 | 1.00th=[ 2165], 5.00th=[ 2232], 10.00th=[ 2265], 20.00th=[ 4396], 00:19:53.017 | 30.00th=[ 6409], 40.00th=[ 6611], 50.00th=[ 8658], 60.00th=[10671], 00:19:53.017 | 70.00th=[10805], 80.00th=[10805], 90.00th=[10939], 95.00th=[10939], 00:19:53.017 | 99.00th=[10939], 99.50th=[10939], 99.90th=[10939], 99.95th=[10939], 00:19:53.017 | 99.99th=[10939] 00:19:53.017 lat (msec) : 250=0.84%, >=2000=99.16% 00:19:53.017 cpu : usr=0.02%, sys=1.04%, ctx=127, majf=0, minf=30465 00:19:53.017 IO depths : 1=0.8%, 2=1.7%, 4=3.4%, 8=6.7%, 16=13.4%, 32=26.9%, >=64=47.1% 00:19:53.017 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.017 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:19:53.017 issued rwts: total=119,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.017 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.017 job5: (groupid=0, jobs=1): err= 0: pid=1588043: Sat Apr 27 02:39:24 2024 00:19:53.017 read: IOPS=267, BW=268MiB/s (281MB/s)(2687MiB/10038msec) 00:19:53.017 slat (usec): min=43, max=2053.1k, avg=3719.79, stdev=54820.89 00:19:53.017 clat (msec): min=32, max=2803, avg=455.48, stdev=716.42 00:19:53.017 lat (msec): min=54, max=2805, avg=459.20, stdev=719.27 00:19:53.017 clat percentiles (msec): 00:19:53.017 | 1.00th=[ 104], 5.00th=[ 113], 10.00th=[ 125], 20.00th=[ 127], 00:19:53.017 | 30.00th=[ 128], 40.00th=[ 130], 50.00th=[ 174], 60.00th=[ 284], 00:19:53.017 | 70.00th=[ 388], 80.00th=[ 426], 90.00th=[ 609], 95.00th=[ 2635], 00:19:53.017 | 99.00th=[ 2735], 99.50th=[ 2769], 99.90th=[ 2802], 99.95th=[ 2802], 00:19:53.017 | 99.99th=[ 2802] 00:19:53.017 bw ( KiB/s): min= 2048, max=983040, per=15.34%, avg=413013.33, stdev=344687.73, samples=12 00:19:53.017 iops : min= 2, max= 960, avg=403.33, stdev=336.61, samples=12 00:19:53.017 lat (msec) : 50=0.04%, 100=0.52%, 250=58.69%, 500=30.03%, 750=1.27% 00:19:53.017 lat (msec) : >=2000=9.45% 00:19:53.017 cpu : usr=0.11%, sys=2.83%, ctx=2825, majf=0, minf=32769 00:19:53.017 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.3%, 16=0.6%, 32=1.2%, >=64=97.7% 00:19:53.017 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.017 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:53.017 issued rwts: total=2687,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.017 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.017 job5: (groupid=0, jobs=1): err= 0: pid=1588044: Sat Apr 27 02:39:24 2024 00:19:53.017 read: IOPS=147, BW=147MiB/s (154MB/s)(1475MiB/10011msec) 00:19:53.017 slat (usec): min=55, max=2087.6k, avg=6775.72, stdev=90043.51 00:19:53.017 clat (msec): min=10, max=6904, avg=371.34, stdev=644.30 00:19:53.017 lat (msec): min=11, max=6915, avg=378.11, stdev=666.52 00:19:53.017 clat percentiles (msec): 00:19:53.017 | 1.00th=[ 22], 5.00th=[ 96], 10.00th=[ 197], 20.00th=[ 236], 00:19:53.017 | 30.00th=[ 275], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 292], 00:19:53.017 | 70.00th=[ 300], 80.00th=[ 363], 90.00th=[ 447], 95.00th=[ 472], 00:19:53.017 | 99.00th=[ 4799], 99.50th=[ 4866], 99.90th=[ 6879], 99.95th=[ 6879], 00:19:53.017 | 99.99th=[ 6879] 00:19:53.017 bw ( KiB/s): min=81920, max=540672, per=13.64%, avg=367274.67, stdev=159437.38, samples=6 00:19:53.018 iops : min= 80, max= 528, avg=358.67, stdev=155.70, samples=6 00:19:53.018 lat (msec) : 20=0.88%, 50=2.31%, 100=2.03%, 250=17.63%, 500=74.37% 00:19:53.018 lat (msec) : 750=0.95%, >=2000=1.83% 00:19:53.018 cpu : usr=0.09%, sys=2.00%, ctx=1993, majf=0, minf=32769 00:19:53.018 IO depths : 1=0.1%, 2=0.1%, 4=0.3%, 8=0.5%, 16=1.1%, 32=2.2%, >=64=95.7% 00:19:53.018 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.018 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:53.018 issued rwts: total=1475,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.018 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.018 job5: (groupid=0, jobs=1): err= 0: pid=1588045: Sat Apr 27 02:39:24 2024 00:19:53.018 read: IOPS=86, BW=86.4MiB/s (90.6MB/s)(943MiB/10909msec) 00:19:53.018 slat (usec): min=60, max=2117.9k, avg=11411.12, stdev=119800.90 00:19:53.018 clat (msec): min=110, max=7540, avg=928.93, stdev=1626.29 00:19:53.018 lat (msec): min=110, max=7545, avg=940.34, stdev=1640.53 00:19:53.018 clat percentiles (msec): 00:19:53.018 | 1.00th=[ 117], 5.00th=[ 133], 10.00th=[ 140], 20.00th=[ 182], 00:19:53.018 | 30.00th=[ 253], 40.00th=[ 288], 50.00th=[ 313], 60.00th=[ 447], 00:19:53.018 | 70.00th=[ 634], 80.00th=[ 1284], 90.00th=[ 1569], 95.00th=[ 5470], 00:19:53.018 | 99.00th=[ 7550], 99.50th=[ 7550], 99.90th=[ 7550], 99.95th=[ 7550], 00:19:53.018 | 99.99th=[ 7550] 00:19:53.018 bw ( KiB/s): min=32768, max=518144, per=10.33%, avg=278186.67, stdev=225419.28, samples=6 00:19:53.018 iops : min= 32, max= 506, avg=271.67, stdev=220.14, samples=6 00:19:53.018 lat (msec) : 250=28.42%, 500=34.15%, 750=9.54%, 1000=3.61%, 2000=17.92% 00:19:53.018 lat (msec) : >=2000=6.36% 00:19:53.018 cpu : usr=0.04%, sys=1.73%, ctx=1101, majf=0, minf=32769 00:19:53.018 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.8%, 16=1.7%, 32=3.4%, >=64=93.3% 00:19:53.018 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.018 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:53.018 issued rwts: total=943,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.018 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.018 job5: (groupid=0, jobs=1): err= 0: pid=1588046: Sat Apr 27 02:39:24 2024 00:19:53.018 read: IOPS=129, BW=129MiB/s (135MB/s)(1392MiB/10784msec) 00:19:53.018 slat (usec): min=55, max=2087.7k, avg=7639.48, stdev=96326.68 00:19:53.018 clat (msec): min=144, max=6868, avg=422.93, stdev=522.99 00:19:53.018 lat (msec): min=145, max=6881, avg=430.57, stdev=551.16 00:19:53.018 clat percentiles (msec): 00:19:53.018 | 1.00th=[ 163], 5.00th=[ 209], 10.00th=[ 232], 20.00th=[ 239], 00:19:53.018 | 30.00th=[ 247], 40.00th=[ 255], 50.00th=[ 266], 60.00th=[ 292], 00:19:53.018 | 70.00th=[ 313], 80.00th=[ 447], 90.00th=[ 1062], 95.00th=[ 1183], 00:19:53.018 | 99.00th=[ 2702], 99.50th=[ 4799], 99.90th=[ 6812], 99.95th=[ 6879], 00:19:53.018 | 99.99th=[ 6879] 00:19:53.018 bw ( KiB/s): min= 1625, max=552960, per=12.00%, avg=322985.25, stdev=194685.31, samples=8 00:19:53.018 iops : min= 1, max= 540, avg=315.25, stdev=190.31, samples=8 00:19:53.018 lat (msec) : 250=33.19%, 500=48.64%, 750=7.83%, 2000=9.12%, >=2000=1.22% 00:19:53.018 cpu : usr=0.02%, sys=1.73%, ctx=2532, majf=0, minf=32769 00:19:53.018 IO depths : 1=0.1%, 2=0.1%, 4=0.3%, 8=0.6%, 16=1.1%, 32=2.3%, >=64=95.5% 00:19:53.018 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.018 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:53.018 issued rwts: total=1392,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.018 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.018 job5: (groupid=0, jobs=1): err= 0: pid=1588047: Sat Apr 27 02:39:24 2024 00:19:53.018 read: IOPS=202, BW=203MiB/s (213MB/s)(2217MiB/10926msec) 00:19:53.018 slat (usec): min=60, max=1975.4k, avg=4857.35, stdev=42567.92 00:19:53.018 clat (msec): min=143, max=2772, avg=603.78, stdev=506.53 00:19:53.018 lat (msec): min=240, max=2782, avg=608.64, stdev=508.11 00:19:53.018 clat percentiles (msec): 00:19:53.018 | 1.00th=[ 243], 5.00th=[ 245], 10.00th=[ 249], 20.00th=[ 288], 00:19:53.018 | 30.00th=[ 397], 40.00th=[ 439], 50.00th=[ 493], 60.00th=[ 592], 00:19:53.018 | 70.00th=[ 634], 80.00th=[ 667], 90.00th=[ 751], 95.00th=[ 2265], 00:19:53.018 | 99.00th=[ 2702], 99.50th=[ 2735], 99.90th=[ 2769], 99.95th=[ 2769], 00:19:53.018 | 99.99th=[ 2769] 00:19:53.018 bw ( KiB/s): min=86016, max=528384, per=9.35%, avg=251623.82, stdev=100649.01, samples=17 00:19:53.018 iops : min= 84, max= 516, avg=245.71, stdev=98.27, samples=17 00:19:53.018 lat (msec) : 250=12.13%, 500=37.98%, 750=39.83%, 1000=4.15%, >=2000=5.91% 00:19:53.018 cpu : usr=0.13%, sys=3.41%, ctx=2651, majf=0, minf=32205 00:19:53.018 IO depths : 1=0.1%, 2=0.1%, 4=0.2%, 8=0.4%, 16=0.7%, 32=1.4%, >=64=97.2% 00:19:53.018 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.018 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:53.018 issued rwts: total=2217,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.018 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.018 job5: (groupid=0, jobs=1): err= 0: pid=1588048: Sat Apr 27 02:39:24 2024 00:19:53.018 read: IOPS=146, BW=146MiB/s (153MB/s)(1881MiB/12863msec) 00:19:53.018 slat (usec): min=69, max=2076.9k, avg=5693.64, stdev=53095.23 00:19:53.018 clat (msec): min=230, max=3323, avg=831.78, stdev=913.70 00:19:53.018 lat (msec): min=232, max=3325, avg=837.47, stdev=916.21 00:19:53.018 clat percentiles (msec): 00:19:53.018 | 1.00th=[ 234], 5.00th=[ 247], 10.00th=[ 266], 20.00th=[ 284], 00:19:53.018 | 30.00th=[ 405], 40.00th=[ 430], 50.00th=[ 468], 60.00th=[ 558], 00:19:53.018 | 70.00th=[ 676], 80.00th=[ 718], 90.00th=[ 3004], 95.00th=[ 3205], 00:19:53.018 | 99.00th=[ 3306], 99.50th=[ 3306], 99.90th=[ 3306], 99.95th=[ 3339], 00:19:53.018 | 99.99th=[ 3339] 00:19:53.018 bw ( KiB/s): min= 1416, max=481280, per=7.85%, avg=211268.24, stdev=129732.78, samples=17 00:19:53.018 iops : min= 1, max= 470, avg=206.29, stdev=126.73, samples=17 00:19:53.018 lat (msec) : 250=5.58%, 500=48.59%, 750=27.96%, 1000=2.87%, 2000=1.49% 00:19:53.018 lat (msec) : >=2000=13.50% 00:19:53.018 cpu : usr=0.06%, sys=2.39%, ctx=2824, majf=0, minf=32769 00:19:53.018 IO depths : 1=0.1%, 2=0.1%, 4=0.2%, 8=0.4%, 16=0.9%, 32=1.7%, >=64=96.7% 00:19:53.018 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.018 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:53.018 issued rwts: total=1881,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.018 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.018 job5: (groupid=0, jobs=1): err= 0: pid=1588049: Sat Apr 27 02:39:24 2024 00:19:53.018 read: IOPS=21, BW=21.3MiB/s (22.3MB/s)(213MiB/10018msec) 00:19:53.018 slat (usec): min=54, max=2077.5k, avg=46945.47, stdev=276354.52 00:19:53.018 clat (msec): min=17, max=7553, avg=1310.11, stdev=2056.47 00:19:53.018 lat (msec): min=18, max=9617, avg=1357.05, stdev=2134.51 00:19:53.018 clat percentiles (msec): 00:19:53.018 | 1.00th=[ 21], 5.00th=[ 29], 10.00th=[ 50], 20.00th=[ 80], 00:19:53.018 | 30.00th=[ 184], 40.00th=[ 401], 50.00th=[ 667], 60.00th=[ 885], 00:19:53.018 | 70.00th=[ 1116], 80.00th=[ 1234], 90.00th=[ 5537], 95.00th=[ 7550], 00:19:53.018 | 99.00th=[ 7550], 99.50th=[ 7550], 99.90th=[ 7550], 99.95th=[ 7550], 00:19:53.018 | 99.99th=[ 7550] 00:19:53.018 lat (msec) : 20=0.94%, 50=9.39%, 100=11.74%, 250=10.33%, 500=10.80% 00:19:53.018 lat (msec) : 750=9.39%, 1000=12.21%, 2000=22.54%, >=2000=12.68% 00:19:53.018 cpu : usr=0.00%, sys=0.96%, ctx=514, majf=0, minf=32769 00:19:53.018 IO depths : 1=0.5%, 2=0.9%, 4=1.9%, 8=3.8%, 16=7.5%, 32=15.0%, >=64=70.4% 00:19:53.018 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.018 complete : 0=0.0%, 4=98.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=1.1% 00:19:53.018 issued rwts: total=213,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.018 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.018 job5: (groupid=0, jobs=1): err= 0: pid=1588050: Sat Apr 27 02:39:24 2024 00:19:53.018 read: IOPS=96, BW=96.8MiB/s (101MB/s)(1051MiB/10859msec) 00:19:53.018 slat (usec): min=50, max=2019.6k, avg=10193.77, stdev=89431.36 00:19:53.018 clat (msec): min=138, max=4810, avg=1273.07, stdev=1244.60 00:19:53.018 lat (msec): min=459, max=4810, avg=1283.26, stdev=1247.65 00:19:53.018 clat percentiles (msec): 00:19:53.018 | 1.00th=[ 460], 5.00th=[ 481], 10.00th=[ 493], 20.00th=[ 542], 00:19:53.018 | 30.00th=[ 609], 40.00th=[ 642], 50.00th=[ 667], 60.00th=[ 776], 00:19:53.018 | 70.00th=[ 1200], 80.00th=[ 1552], 90.00th=[ 4329], 95.00th=[ 4597], 00:19:53.018 | 99.00th=[ 4799], 99.50th=[ 4799], 99.90th=[ 4799], 99.95th=[ 4799], 00:19:53.018 | 99.99th=[ 4799] 00:19:53.018 bw ( KiB/s): min= 1625, max=282624, per=4.68%, avg=126128.60, stdev=87973.24, samples=15 00:19:53.018 iops : min= 1, max= 276, avg=123.13, stdev=85.97, samples=15 00:19:53.018 lat (msec) : 250=0.10%, 500=12.94%, 750=46.43%, 1000=5.42%, 2000=19.51% 00:19:53.018 lat (msec) : >=2000=15.60% 00:19:53.018 cpu : usr=0.03%, sys=1.86%, ctx=1094, majf=0, minf=32769 00:19:53.018 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.8%, 16=1.5%, 32=3.0%, >=64=94.0% 00:19:53.018 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.018 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:53.018 issued rwts: total=1051,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.018 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.018 job5: (groupid=0, jobs=1): err= 0: pid=1588051: Sat Apr 27 02:39:24 2024 00:19:53.018 read: IOPS=91, BW=91.3MiB/s (95.7MB/s)(915MiB/10025msec) 00:19:53.018 slat (usec): min=43, max=2081.1k, avg=10924.78, stdev=126404.67 00:19:53.018 clat (msec): min=23, max=4682, avg=842.86, stdev=1342.77 00:19:53.018 lat (msec): min=28, max=4684, avg=853.78, stdev=1352.24 00:19:53.018 clat percentiles (msec): 00:19:53.018 | 1.00th=[ 43], 5.00th=[ 99], 10.00th=[ 184], 20.00th=[ 266], 00:19:53.019 | 30.00th=[ 275], 40.00th=[ 279], 50.00th=[ 284], 60.00th=[ 284], 00:19:53.019 | 70.00th=[ 292], 80.00th=[ 321], 90.00th=[ 3876], 95.00th=[ 3910], 00:19:53.019 | 99.00th=[ 4597], 99.50th=[ 4665], 99.90th=[ 4665], 99.95th=[ 4665], 00:19:53.019 | 99.99th=[ 4665] 00:19:53.019 bw ( KiB/s): min= 4096, max=462848, per=6.98%, avg=188074.67, stdev=189854.87, samples=6 00:19:53.019 iops : min= 4, max= 452, avg=183.67, stdev=185.41, samples=6 00:19:53.019 lat (msec) : 50=1.75%, 100=3.28%, 250=10.38%, 500=68.42%, 2000=0.44% 00:19:53.019 lat (msec) : >=2000=15.74% 00:19:53.019 cpu : usr=0.05%, sys=1.62%, ctx=830, majf=0, minf=32769 00:19:53.019 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.9%, 16=1.7%, 32=3.5%, >=64=93.1% 00:19:53.019 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.019 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:53.019 issued rwts: total=915,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.019 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.019 job5: (groupid=0, jobs=1): err= 0: pid=1588052: Sat Apr 27 02:39:24 2024 00:19:53.019 read: IOPS=40, BW=40.7MiB/s (42.7MB/s)(409MiB/10041msec) 00:19:53.019 slat (usec): min=71, max=2073.9k, avg=24446.96, stdev=175131.18 00:19:53.019 clat (msec): min=39, max=7189, avg=2528.59, stdev=2136.40 00:19:53.019 lat (msec): min=42, max=7193, avg=2553.04, stdev=2140.08 00:19:53.019 clat percentiles (msec): 00:19:53.019 | 1.00th=[ 55], 5.00th=[ 163], 10.00th=[ 359], 20.00th=[ 718], 00:19:53.019 | 30.00th=[ 953], 40.00th=[ 1116], 50.00th=[ 1284], 60.00th=[ 3004], 00:19:53.019 | 70.00th=[ 3742], 80.00th=[ 5470], 90.00th=[ 5604], 95.00th=[ 5738], 00:19:53.019 | 99.00th=[ 5805], 99.50th=[ 7148], 99.90th=[ 7215], 99.95th=[ 7215], 00:19:53.019 | 99.99th=[ 7215] 00:19:53.019 bw ( KiB/s): min= 6144, max=143360, per=2.42%, avg=65243.43, stdev=55364.59, samples=7 00:19:53.019 iops : min= 6, max= 140, avg=63.71, stdev=54.07, samples=7 00:19:53.019 lat (msec) : 50=0.73%, 100=2.44%, 250=3.67%, 500=6.60%, 750=7.09% 00:19:53.019 lat (msec) : 1000=12.96%, 2000=25.18%, >=2000=41.32% 00:19:53.019 cpu : usr=0.04%, sys=1.19%, ctx=796, majf=0, minf=32769 00:19:53.019 IO depths : 1=0.2%, 2=0.5%, 4=1.0%, 8=2.0%, 16=3.9%, 32=7.8%, >=64=84.6% 00:19:53.019 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.019 complete : 0=0.0%, 4=99.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.4% 00:19:53.019 issued rwts: total=409,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.019 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.019 job5: (groupid=0, jobs=1): err= 0: pid=1588053: Sat Apr 27 02:39:24 2024 00:19:53.019 read: IOPS=113, BW=114MiB/s (119MB/s)(1140MiB/10043msec) 00:19:53.019 slat (usec): min=43, max=2045.7k, avg=8770.76, stdev=96219.16 00:19:53.019 clat (msec): min=39, max=4849, avg=1086.54, stdev=1354.58 00:19:53.019 lat (msec): min=48, max=4862, avg=1095.31, stdev=1359.12 00:19:53.019 clat percentiles (msec): 00:19:53.019 | 1.00th=[ 136], 5.00th=[ 159], 10.00th=[ 213], 20.00th=[ 271], 00:19:53.019 | 30.00th=[ 288], 40.00th=[ 330], 50.00th=[ 430], 60.00th=[ 518], 00:19:53.019 | 70.00th=[ 676], 80.00th=[ 2467], 90.00th=[ 3977], 95.00th=[ 4463], 00:19:53.019 | 99.00th=[ 4799], 99.50th=[ 4799], 99.90th=[ 4866], 99.95th=[ 4866], 00:19:53.019 | 99.99th=[ 4866] 00:19:53.019 bw ( KiB/s): min= 4096, max=471040, per=7.00%, avg=188581.36, stdev=169980.29, samples=11 00:19:53.019 iops : min= 4, max= 460, avg=184.09, stdev=166.03, samples=11 00:19:53.019 lat (msec) : 50=0.18%, 100=0.44%, 250=14.39%, 500=43.16%, 750=13.51% 00:19:53.019 lat (msec) : 1000=2.19%, 2000=3.86%, >=2000=22.28% 00:19:53.019 cpu : usr=0.03%, sys=2.03%, ctx=1448, majf=0, minf=32769 00:19:53.019 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.7%, 16=1.4%, 32=2.8%, >=64=94.5% 00:19:53.019 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.019 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:53.019 issued rwts: total=1140,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.019 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.019 job5: (groupid=0, jobs=1): err= 0: pid=1588054: Sat Apr 27 02:39:24 2024 00:19:53.019 read: IOPS=302, BW=302MiB/s (317MB/s)(3029MiB/10021msec) 00:19:53.019 slat (usec): min=39, max=2066.9k, avg=3297.64, stdev=44521.90 00:19:53.019 clat (msec): min=20, max=2647, avg=402.91, stdev=566.43 00:19:53.019 lat (msec): min=21, max=2649, avg=406.20, stdev=568.71 00:19:53.019 clat percentiles (msec): 00:19:53.019 | 1.00th=[ 62], 5.00th=[ 115], 10.00th=[ 117], 20.00th=[ 131], 00:19:53.019 | 30.00th=[ 140], 40.00th=[ 150], 50.00th=[ 201], 60.00th=[ 249], 00:19:53.019 | 70.00th=[ 296], 80.00th=[ 435], 90.00th=[ 743], 95.00th=[ 1854], 00:19:53.019 | 99.00th=[ 2601], 99.50th=[ 2635], 99.90th=[ 2635], 99.95th=[ 2635], 00:19:53.019 | 99.99th=[ 2635] 00:19:53.019 bw ( KiB/s): min=20480, max=1003520, per=15.77%, avg=424521.14, stdev=292772.47, samples=14 00:19:53.019 iops : min= 20, max= 980, avg=414.57, stdev=285.91, samples=14 00:19:53.019 lat (msec) : 50=0.66%, 100=1.12%, 250=58.50%, 500=23.57%, 750=6.31% 00:19:53.019 lat (msec) : 1000=1.45%, 2000=4.19%, >=2000=4.19% 00:19:53.019 cpu : usr=0.15%, sys=2.47%, ctx=3317, majf=0, minf=32769 00:19:53.019 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.3%, 16=0.5%, 32=1.1%, >=64=97.9% 00:19:53.019 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:53.019 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:53.019 issued rwts: total=3029,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:53.019 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:53.019 00:19:53.019 Run status group 0 (all jobs): 00:19:53.019 READ: bw=2629MiB/s (2757MB/s), 882KiB/s-302MiB/s (904kB/s-317MB/s), io=33.3GiB (35.7GB), run=10011-12963msec 00:19:53.019 00:19:53.019 Disk stats (read/write): 00:19:53.019 nvme0n1: ios=17969/0, merge=0/0, ticks=9989749/0, in_queue=9989749, util=98.57% 00:19:53.019 nvme1n1: ios=17273/0, merge=0/0, ticks=8138396/0, in_queue=8138396, util=98.77% 00:19:53.019 nvme2n1: ios=24719/0, merge=0/0, ticks=9823527/0, in_queue=9823527, util=98.89% 00:19:53.019 nvme3n1: ios=37105/0, merge=0/0, ticks=8470468/0, in_queue=8470468, util=98.83% 00:19:53.019 nvme4n1: ios=34815/0, merge=0/0, ticks=9399447/0, in_queue=9399447, util=99.19% 00:19:53.019 nvme5n1: ios=139767/0, merge=0/0, ticks=10417437/0, in_queue=10417437, util=99.39% 00:19:53.019 02:39:25 -- target/srq_overwhelm.sh@38 -- # sync 00:19:53.019 02:39:25 -- target/srq_overwhelm.sh@40 -- # seq 0 5 00:19:53.019 02:39:25 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:19:53.019 02:39:25 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode0 00:19:53.019 NQN:nqn.2016-06.io.spdk:cnode0 disconnected 1 controller(s) 00:19:53.019 02:39:26 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000000 00:19:53.019 02:39:26 -- common/autotest_common.sh@1205 -- # local i=0 00:19:53.019 02:39:26 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:19:53.019 02:39:26 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK00000000000000 00:19:53.019 02:39:26 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK00000000000000 00:19:53.019 02:39:26 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:19:53.019 02:39:26 -- common/autotest_common.sh@1217 -- # return 0 00:19:53.019 02:39:26 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:19:53.019 02:39:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:53.019 02:39:26 -- common/autotest_common.sh@10 -- # set +x 00:19:53.019 02:39:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:53.019 02:39:26 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:19:53.019 02:39:26 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:53.955 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:19:53.955 02:39:27 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000001 00:19:53.955 02:39:27 -- common/autotest_common.sh@1205 -- # local i=0 00:19:53.955 02:39:27 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:19:53.955 02:39:27 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK00000000000001 00:19:53.955 02:39:27 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK00000000000001 00:19:53.955 02:39:27 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:19:53.955 02:39:27 -- common/autotest_common.sh@1217 -- # return 0 00:19:53.955 02:39:27 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:53.955 02:39:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:53.955 02:39:27 -- common/autotest_common.sh@10 -- # set +x 00:19:53.955 02:39:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:53.955 02:39:27 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:19:53.955 02:39:27 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:19:54.889 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:19:54.889 02:39:28 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000002 00:19:54.889 02:39:28 -- common/autotest_common.sh@1205 -- # local i=0 00:19:54.889 02:39:28 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:19:54.889 02:39:28 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK00000000000002 00:19:54.889 02:39:28 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK00000000000002 00:19:54.889 02:39:28 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:19:55.148 02:39:28 -- common/autotest_common.sh@1217 -- # return 0 00:19:55.148 02:39:28 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:19:55.148 02:39:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:55.148 02:39:28 -- common/autotest_common.sh@10 -- # set +x 00:19:55.148 02:39:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:55.148 02:39:28 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:19:55.148 02:39:28 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:19:56.084 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:19:56.084 02:39:29 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000003 00:19:56.084 02:39:29 -- common/autotest_common.sh@1205 -- # local i=0 00:19:56.084 02:39:29 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:19:56.084 02:39:29 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK00000000000003 00:19:56.084 02:39:29 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK00000000000003 00:19:56.084 02:39:29 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:19:56.084 02:39:29 -- common/autotest_common.sh@1217 -- # return 0 00:19:56.084 02:39:29 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:19:56.084 02:39:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:56.084 02:39:29 -- common/autotest_common.sh@10 -- # set +x 00:19:56.084 02:39:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:56.084 02:39:29 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:19:56.084 02:39:29 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:19:57.021 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:19:57.021 02:39:30 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000004 00:19:57.021 02:39:30 -- common/autotest_common.sh@1205 -- # local i=0 00:19:57.021 02:39:30 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:19:57.021 02:39:30 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK00000000000004 00:19:57.021 02:39:30 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:19:57.021 02:39:30 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK00000000000004 00:19:57.021 02:39:30 -- common/autotest_common.sh@1217 -- # return 0 00:19:57.021 02:39:30 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:19:57.021 02:39:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:57.021 02:39:30 -- common/autotest_common.sh@10 -- # set +x 00:19:57.021 02:39:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:57.021 02:39:30 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:19:57.021 02:39:30 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:19:57.957 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:19:57.957 02:39:31 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000005 00:19:57.957 02:39:31 -- common/autotest_common.sh@1205 -- # local i=0 00:19:57.957 02:39:31 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:19:57.957 02:39:31 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK00000000000005 00:19:57.957 02:39:31 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:19:57.957 02:39:31 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK00000000000005 00:19:58.216 02:39:31 -- common/autotest_common.sh@1217 -- # return 0 00:19:58.216 02:39:31 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:19:58.216 02:39:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:58.216 02:39:31 -- common/autotest_common.sh@10 -- # set +x 00:19:58.216 02:39:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:58.216 02:39:31 -- target/srq_overwhelm.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:19:58.216 02:39:31 -- target/srq_overwhelm.sh@48 -- # nvmftestfini 00:19:58.216 02:39:31 -- nvmf/common.sh@477 -- # nvmfcleanup 00:19:58.216 02:39:31 -- nvmf/common.sh@117 -- # sync 00:19:58.216 02:39:31 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:19:58.216 02:39:31 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:19:58.216 02:39:31 -- nvmf/common.sh@120 -- # set +e 00:19:58.216 02:39:31 -- nvmf/common.sh@121 -- # for i in {1..20} 00:19:58.216 02:39:31 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:19:58.216 rmmod nvme_rdma 00:19:58.216 rmmod nvme_fabrics 00:19:58.217 02:39:31 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:19:58.217 02:39:31 -- nvmf/common.sh@124 -- # set -e 00:19:58.217 02:39:31 -- nvmf/common.sh@125 -- # return 0 00:19:58.217 02:39:31 -- nvmf/common.sh@478 -- # '[' -n 1586311 ']' 00:19:58.217 02:39:31 -- nvmf/common.sh@479 -- # killprocess 1586311 00:19:58.217 02:39:31 -- common/autotest_common.sh@936 -- # '[' -z 1586311 ']' 00:19:58.217 02:39:31 -- common/autotest_common.sh@940 -- # kill -0 1586311 00:19:58.217 02:39:31 -- common/autotest_common.sh@941 -- # uname 00:19:58.217 02:39:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:58.217 02:39:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1586311 00:19:58.217 02:39:31 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:58.217 02:39:31 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:58.217 02:39:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1586311' 00:19:58.217 killing process with pid 1586311 00:19:58.217 02:39:31 -- common/autotest_common.sh@955 -- # kill 1586311 00:19:58.217 02:39:31 -- common/autotest_common.sh@960 -- # wait 1586311 00:19:58.217 [2024-04-27 02:39:31.754575] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:19:58.476 02:39:32 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:19:58.476 02:39:32 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:19:58.476 00:19:58.476 real 0m33.896s 00:19:58.476 user 1m54.525s 00:19:58.476 sys 0m15.588s 00:19:58.476 02:39:32 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:19:58.476 02:39:32 -- common/autotest_common.sh@10 -- # set +x 00:19:58.476 ************************************ 00:19:58.476 END TEST nvmf_srq_overwhelm 00:19:58.476 ************************************ 00:19:58.735 02:39:32 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=rdma 00:19:58.735 02:39:32 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:58.735 02:39:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:58.735 02:39:32 -- common/autotest_common.sh@10 -- # set +x 00:19:58.735 ************************************ 00:19:58.735 START TEST nvmf_shutdown 00:19:58.735 ************************************ 00:19:58.735 02:39:32 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=rdma 00:19:58.995 * Looking for test storage... 00:19:58.995 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:19:58.995 02:39:32 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:19:58.995 02:39:32 -- nvmf/common.sh@7 -- # uname -s 00:19:58.995 02:39:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:58.995 02:39:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:58.995 02:39:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:58.995 02:39:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:58.995 02:39:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:58.995 02:39:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:58.995 02:39:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:58.995 02:39:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:58.995 02:39:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:58.995 02:39:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:58.995 02:39:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:19:58.995 02:39:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:19:58.995 02:39:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:58.995 02:39:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:58.995 02:39:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:58.995 02:39:32 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:19:58.995 02:39:32 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:19:58.995 02:39:32 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:58.995 02:39:32 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:58.995 02:39:32 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:58.995 02:39:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:58.995 02:39:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:58.995 02:39:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:58.995 02:39:32 -- paths/export.sh@5 -- # export PATH 00:19:58.995 02:39:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:58.995 02:39:32 -- nvmf/common.sh@47 -- # : 0 00:19:58.995 02:39:32 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:19:58.995 02:39:32 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:19:58.995 02:39:32 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:19:58.995 02:39:32 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:58.995 02:39:32 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:58.995 02:39:32 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:19:58.995 02:39:32 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:19:58.995 02:39:32 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:19:58.995 02:39:32 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:58.995 02:39:32 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:58.995 02:39:32 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:19:58.995 02:39:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:19:58.995 02:39:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:58.995 02:39:32 -- common/autotest_common.sh@10 -- # set +x 00:19:58.995 ************************************ 00:19:58.995 START TEST nvmf_shutdown_tc1 00:19:58.995 ************************************ 00:19:58.995 02:39:32 -- common/autotest_common.sh@1111 -- # nvmf_shutdown_tc1 00:19:58.995 02:39:32 -- target/shutdown.sh@74 -- # starttarget 00:19:58.995 02:39:32 -- target/shutdown.sh@15 -- # nvmftestinit 00:19:58.995 02:39:32 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:19:58.995 02:39:32 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:58.995 02:39:32 -- nvmf/common.sh@437 -- # prepare_net_devs 00:19:58.995 02:39:32 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:19:58.995 02:39:32 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:19:58.995 02:39:32 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:58.995 02:39:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:58.995 02:39:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:59.254 02:39:32 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:19:59.254 02:39:32 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:19:59.254 02:39:32 -- nvmf/common.sh@285 -- # xtrace_disable 00:19:59.254 02:39:32 -- common/autotest_common.sh@10 -- # set +x 00:20:05.821 02:39:38 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:05.821 02:39:38 -- nvmf/common.sh@291 -- # pci_devs=() 00:20:05.821 02:39:38 -- nvmf/common.sh@291 -- # local -a pci_devs 00:20:05.821 02:39:38 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:20:05.821 02:39:38 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:20:05.821 02:39:38 -- nvmf/common.sh@293 -- # pci_drivers=() 00:20:05.821 02:39:38 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:20:05.821 02:39:38 -- nvmf/common.sh@295 -- # net_devs=() 00:20:05.821 02:39:38 -- nvmf/common.sh@295 -- # local -ga net_devs 00:20:05.821 02:39:38 -- nvmf/common.sh@296 -- # e810=() 00:20:05.821 02:39:38 -- nvmf/common.sh@296 -- # local -ga e810 00:20:05.821 02:39:38 -- nvmf/common.sh@297 -- # x722=() 00:20:05.821 02:39:38 -- nvmf/common.sh@297 -- # local -ga x722 00:20:05.821 02:39:38 -- nvmf/common.sh@298 -- # mlx=() 00:20:05.821 02:39:38 -- nvmf/common.sh@298 -- # local -ga mlx 00:20:05.821 02:39:38 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:05.821 02:39:38 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:05.821 02:39:38 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:05.821 02:39:38 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:05.821 02:39:38 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:05.821 02:39:38 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:05.821 02:39:38 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:05.821 02:39:38 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:05.821 02:39:38 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:05.821 02:39:38 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:05.821 02:39:38 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:05.821 02:39:38 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:20:05.821 02:39:38 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:20:05.821 02:39:38 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:20:05.821 02:39:38 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:20:05.821 02:39:38 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:20:05.821 02:39:38 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:20:05.821 02:39:38 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:20:05.821 02:39:38 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:20:05.821 02:39:38 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:20:05.821 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:20:05.821 02:39:38 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:20:05.821 02:39:38 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:20:05.821 02:39:38 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:20:05.821 02:39:38 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:20:05.821 02:39:38 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:20:05.821 02:39:38 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:20:05.821 02:39:38 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:20:05.821 02:39:38 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:20:05.821 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:20:05.821 02:39:38 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:20:05.821 02:39:38 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:20:05.821 02:39:38 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:20:05.821 02:39:38 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:20:05.821 02:39:38 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:20:05.821 02:39:38 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:20:05.821 02:39:38 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:20:05.821 02:39:38 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:20:05.821 02:39:38 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:20:05.821 02:39:38 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:05.821 02:39:38 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:20:05.821 02:39:38 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:05.821 02:39:38 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:20:05.821 Found net devices under 0000:18:00.0: mlx_0_0 00:20:05.821 02:39:38 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:20:05.821 02:39:38 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:20:05.821 02:39:38 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:05.821 02:39:38 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:20:05.821 02:39:38 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:05.821 02:39:38 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:20:05.821 Found net devices under 0000:18:00.1: mlx_0_1 00:20:05.821 02:39:38 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:20:05.821 02:39:38 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:20:05.821 02:39:38 -- nvmf/common.sh@403 -- # is_hw=yes 00:20:05.821 02:39:38 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:20:05.821 02:39:38 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:20:05.821 02:39:38 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:20:05.821 02:39:38 -- nvmf/common.sh@409 -- # rdma_device_init 00:20:05.821 02:39:38 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:20:05.821 02:39:38 -- nvmf/common.sh@58 -- # uname 00:20:05.821 02:39:38 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:20:05.821 02:39:38 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:20:05.821 02:39:38 -- nvmf/common.sh@63 -- # modprobe ib_core 00:20:05.821 02:39:38 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:20:05.821 02:39:38 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:20:05.821 02:39:38 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:20:05.821 02:39:38 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:20:05.821 02:39:38 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:20:05.821 02:39:38 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:20:05.821 02:39:38 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:20:05.821 02:39:38 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:20:05.821 02:39:38 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:20:05.821 02:39:38 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:20:05.821 02:39:38 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:20:05.821 02:39:38 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:20:05.821 02:39:38 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:20:05.821 02:39:38 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:05.821 02:39:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:05.821 02:39:38 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:20:05.821 02:39:38 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:20:05.821 02:39:38 -- nvmf/common.sh@105 -- # continue 2 00:20:05.822 02:39:38 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:05.822 02:39:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:05.822 02:39:38 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:20:05.822 02:39:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:05.822 02:39:38 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:20:05.822 02:39:38 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:20:05.822 02:39:38 -- nvmf/common.sh@105 -- # continue 2 00:20:05.822 02:39:38 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:20:05.822 02:39:38 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:20:05.822 02:39:38 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:20:05.822 02:39:38 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:20:05.822 02:39:38 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:05.822 02:39:38 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:05.822 02:39:38 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:20:05.822 02:39:38 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:20:05.822 02:39:38 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:20:05.822 64: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:20:05.822 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:20:05.822 altname enp24s0f0np0 00:20:05.822 altname ens785f0np0 00:20:05.822 inet 192.168.100.8/24 scope global mlx_0_0 00:20:05.822 valid_lft forever preferred_lft forever 00:20:05.822 02:39:38 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:20:05.822 02:39:38 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:20:05.822 02:39:38 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:20:05.822 02:39:38 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:20:05.822 02:39:38 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:05.822 02:39:38 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:05.822 02:39:38 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:20:05.822 02:39:38 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:20:05.822 02:39:38 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:20:05.822 65: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:20:05.822 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:20:05.822 altname enp24s0f1np1 00:20:05.822 altname ens785f1np1 00:20:05.822 inet 192.168.100.9/24 scope global mlx_0_1 00:20:05.822 valid_lft forever preferred_lft forever 00:20:05.822 02:39:38 -- nvmf/common.sh@411 -- # return 0 00:20:05.822 02:39:38 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:20:05.822 02:39:38 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:20:05.822 02:39:38 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:20:05.822 02:39:38 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:20:05.822 02:39:38 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:20:05.822 02:39:38 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:20:05.822 02:39:38 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:20:05.822 02:39:38 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:20:05.822 02:39:38 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:20:05.822 02:39:38 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:20:05.822 02:39:38 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:05.822 02:39:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:05.822 02:39:38 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:20:05.822 02:39:38 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:20:05.822 02:39:38 -- nvmf/common.sh@105 -- # continue 2 00:20:05.822 02:39:38 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:05.822 02:39:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:05.822 02:39:38 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:20:05.822 02:39:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:05.822 02:39:38 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:20:05.822 02:39:38 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:20:05.822 02:39:38 -- nvmf/common.sh@105 -- # continue 2 00:20:05.822 02:39:38 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:20:05.822 02:39:38 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:20:05.822 02:39:38 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:20:05.822 02:39:38 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:20:05.822 02:39:38 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:05.822 02:39:38 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:05.822 02:39:38 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:20:05.822 02:39:38 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:20:05.822 02:39:38 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:20:05.822 02:39:38 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:20:05.822 02:39:38 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:05.822 02:39:38 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:05.822 02:39:38 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:20:05.822 192.168.100.9' 00:20:05.822 02:39:38 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:20:05.822 192.168.100.9' 00:20:05.822 02:39:38 -- nvmf/common.sh@446 -- # head -n 1 00:20:05.822 02:39:38 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:20:05.822 02:39:38 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:20:05.822 192.168.100.9' 00:20:05.822 02:39:38 -- nvmf/common.sh@447 -- # tail -n +2 00:20:05.822 02:39:38 -- nvmf/common.sh@447 -- # head -n 1 00:20:05.822 02:39:38 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:20:05.822 02:39:38 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:20:05.822 02:39:38 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:20:05.822 02:39:38 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:20:05.822 02:39:38 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:20:05.822 02:39:38 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:20:05.822 02:39:38 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:20:05.822 02:39:38 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:20:05.822 02:39:38 -- common/autotest_common.sh@710 -- # xtrace_disable 00:20:05.822 02:39:38 -- common/autotest_common.sh@10 -- # set +x 00:20:05.822 02:39:38 -- nvmf/common.sh@470 -- # nvmfpid=1593396 00:20:05.822 02:39:38 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:20:05.822 02:39:38 -- nvmf/common.sh@471 -- # waitforlisten 1593396 00:20:05.822 02:39:38 -- common/autotest_common.sh@817 -- # '[' -z 1593396 ']' 00:20:05.822 02:39:38 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:05.822 02:39:38 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:05.822 02:39:38 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:05.822 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:05.822 02:39:38 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:05.822 02:39:38 -- common/autotest_common.sh@10 -- # set +x 00:20:05.822 [2024-04-27 02:39:38.624590] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:20:05.822 [2024-04-27 02:39:38.624650] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:05.822 EAL: No free 2048 kB hugepages reported on node 1 00:20:05.822 [2024-04-27 02:39:38.697478] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:20:05.822 [2024-04-27 02:39:38.783975] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:05.822 [2024-04-27 02:39:38.784019] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:05.822 [2024-04-27 02:39:38.784028] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:20:05.822 [2024-04-27 02:39:38.784041] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:20:05.822 [2024-04-27 02:39:38.784049] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:05.822 [2024-04-27 02:39:38.784154] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:05.822 [2024-04-27 02:39:38.784234] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:05.822 [2024-04-27 02:39:38.784334] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:05.822 [2024-04-27 02:39:38.784354] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:20:05.822 02:39:39 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:05.822 02:39:39 -- common/autotest_common.sh@850 -- # return 0 00:20:05.822 02:39:39 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:20:05.822 02:39:39 -- common/autotest_common.sh@716 -- # xtrace_disable 00:20:05.822 02:39:39 -- common/autotest_common.sh@10 -- # set +x 00:20:06.082 02:39:39 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:06.082 02:39:39 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:20:06.082 02:39:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:06.082 02:39:39 -- common/autotest_common.sh@10 -- # set +x 00:20:06.082 [2024-04-27 02:39:39.515640] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x16cb7c0/0x16cfcb0) succeed. 00:20:06.082 [2024-04-27 02:39:39.526111] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x16cce00/0x1711340) succeed. 00:20:06.082 02:39:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:06.082 02:39:39 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:20:06.082 02:39:39 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:20:06.082 02:39:39 -- common/autotest_common.sh@710 -- # xtrace_disable 00:20:06.082 02:39:39 -- common/autotest_common.sh@10 -- # set +x 00:20:06.082 02:39:39 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:20:06.082 02:39:39 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:20:06.082 02:39:39 -- target/shutdown.sh@28 -- # cat 00:20:06.082 02:39:39 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:20:06.082 02:39:39 -- target/shutdown.sh@28 -- # cat 00:20:06.082 02:39:39 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:20:06.082 02:39:39 -- target/shutdown.sh@28 -- # cat 00:20:06.082 02:39:39 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:20:06.082 02:39:39 -- target/shutdown.sh@28 -- # cat 00:20:06.082 02:39:39 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:20:06.082 02:39:39 -- target/shutdown.sh@28 -- # cat 00:20:06.082 02:39:39 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:20:06.082 02:39:39 -- target/shutdown.sh@28 -- # cat 00:20:06.343 02:39:39 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:20:06.343 02:39:39 -- target/shutdown.sh@28 -- # cat 00:20:06.343 02:39:39 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:20:06.343 02:39:39 -- target/shutdown.sh@28 -- # cat 00:20:06.343 02:39:39 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:20:06.343 02:39:39 -- target/shutdown.sh@28 -- # cat 00:20:06.343 02:39:39 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:20:06.343 02:39:39 -- target/shutdown.sh@28 -- # cat 00:20:06.343 02:39:39 -- target/shutdown.sh@35 -- # rpc_cmd 00:20:06.343 02:39:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:06.343 02:39:39 -- common/autotest_common.sh@10 -- # set +x 00:20:06.343 Malloc1 00:20:06.343 [2024-04-27 02:39:39.774090] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:20:06.343 Malloc2 00:20:06.343 Malloc3 00:20:06.343 Malloc4 00:20:06.343 Malloc5 00:20:06.602 Malloc6 00:20:06.602 Malloc7 00:20:06.602 Malloc8 00:20:06.602 Malloc9 00:20:06.602 Malloc10 00:20:06.602 02:39:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:06.602 02:39:40 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:20:06.602 02:39:40 -- common/autotest_common.sh@716 -- # xtrace_disable 00:20:06.602 02:39:40 -- common/autotest_common.sh@10 -- # set +x 00:20:06.863 02:39:40 -- target/shutdown.sh@78 -- # perfpid=1593641 00:20:06.863 02:39:40 -- target/shutdown.sh@79 -- # waitforlisten 1593641 /var/tmp/bdevperf.sock 00:20:06.863 02:39:40 -- common/autotest_common.sh@817 -- # '[' -z 1593641 ']' 00:20:06.863 02:39:40 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:06.863 02:39:40 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:06.863 02:39:40 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:20:06.863 02:39:40 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:20:06.863 02:39:40 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:06.863 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:06.863 02:39:40 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:06.863 02:39:40 -- nvmf/common.sh@521 -- # config=() 00:20:06.863 02:39:40 -- common/autotest_common.sh@10 -- # set +x 00:20:06.863 02:39:40 -- nvmf/common.sh@521 -- # local subsystem config 00:20:06.863 02:39:40 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:20:06.863 02:39:40 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:20:06.863 { 00:20:06.863 "params": { 00:20:06.863 "name": "Nvme$subsystem", 00:20:06.863 "trtype": "$TEST_TRANSPORT", 00:20:06.863 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:06.863 "adrfam": "ipv4", 00:20:06.863 "trsvcid": "$NVMF_PORT", 00:20:06.863 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:06.863 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:06.863 "hdgst": ${hdgst:-false}, 00:20:06.863 "ddgst": ${ddgst:-false} 00:20:06.863 }, 00:20:06.863 "method": "bdev_nvme_attach_controller" 00:20:06.863 } 00:20:06.863 EOF 00:20:06.863 )") 00:20:06.863 02:39:40 -- nvmf/common.sh@543 -- # cat 00:20:06.863 02:39:40 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:20:06.863 02:39:40 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:20:06.863 { 00:20:06.863 "params": { 00:20:06.863 "name": "Nvme$subsystem", 00:20:06.863 "trtype": "$TEST_TRANSPORT", 00:20:06.863 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:06.863 "adrfam": "ipv4", 00:20:06.863 "trsvcid": "$NVMF_PORT", 00:20:06.863 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:06.863 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:06.863 "hdgst": ${hdgst:-false}, 00:20:06.863 "ddgst": ${ddgst:-false} 00:20:06.863 }, 00:20:06.863 "method": "bdev_nvme_attach_controller" 00:20:06.863 } 00:20:06.863 EOF 00:20:06.863 )") 00:20:06.863 02:39:40 -- nvmf/common.sh@543 -- # cat 00:20:06.863 02:39:40 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:20:06.863 02:39:40 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:20:06.863 { 00:20:06.863 "params": { 00:20:06.863 "name": "Nvme$subsystem", 00:20:06.863 "trtype": "$TEST_TRANSPORT", 00:20:06.863 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:06.863 "adrfam": "ipv4", 00:20:06.863 "trsvcid": "$NVMF_PORT", 00:20:06.863 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:06.863 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:06.863 "hdgst": ${hdgst:-false}, 00:20:06.863 "ddgst": ${ddgst:-false} 00:20:06.863 }, 00:20:06.863 "method": "bdev_nvme_attach_controller" 00:20:06.863 } 00:20:06.863 EOF 00:20:06.863 )") 00:20:06.863 02:39:40 -- nvmf/common.sh@543 -- # cat 00:20:06.863 02:39:40 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:20:06.863 02:39:40 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:20:06.863 { 00:20:06.863 "params": { 00:20:06.863 "name": "Nvme$subsystem", 00:20:06.863 "trtype": "$TEST_TRANSPORT", 00:20:06.863 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:06.863 "adrfam": "ipv4", 00:20:06.864 "trsvcid": "$NVMF_PORT", 00:20:06.864 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:06.864 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:06.864 "hdgst": ${hdgst:-false}, 00:20:06.864 "ddgst": ${ddgst:-false} 00:20:06.864 }, 00:20:06.864 "method": "bdev_nvme_attach_controller" 00:20:06.864 } 00:20:06.864 EOF 00:20:06.864 )") 00:20:06.864 02:39:40 -- nvmf/common.sh@543 -- # cat 00:20:06.864 02:39:40 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:20:06.864 02:39:40 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:20:06.864 { 00:20:06.864 "params": { 00:20:06.864 "name": "Nvme$subsystem", 00:20:06.864 "trtype": "$TEST_TRANSPORT", 00:20:06.864 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:06.864 "adrfam": "ipv4", 00:20:06.864 "trsvcid": "$NVMF_PORT", 00:20:06.864 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:06.864 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:06.864 "hdgst": ${hdgst:-false}, 00:20:06.864 "ddgst": ${ddgst:-false} 00:20:06.864 }, 00:20:06.864 "method": "bdev_nvme_attach_controller" 00:20:06.864 } 00:20:06.864 EOF 00:20:06.864 )") 00:20:06.864 02:39:40 -- nvmf/common.sh@543 -- # cat 00:20:06.864 02:39:40 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:20:06.864 02:39:40 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:20:06.864 { 00:20:06.864 "params": { 00:20:06.864 "name": "Nvme$subsystem", 00:20:06.864 "trtype": "$TEST_TRANSPORT", 00:20:06.864 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:06.864 "adrfam": "ipv4", 00:20:06.864 "trsvcid": "$NVMF_PORT", 00:20:06.864 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:06.864 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:06.864 "hdgst": ${hdgst:-false}, 00:20:06.864 "ddgst": ${ddgst:-false} 00:20:06.864 }, 00:20:06.864 "method": "bdev_nvme_attach_controller" 00:20:06.864 } 00:20:06.864 EOF 00:20:06.864 )") 00:20:06.864 [2024-04-27 02:39:40.281408] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:20:06.864 [2024-04-27 02:39:40.281467] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:20:06.864 02:39:40 -- nvmf/common.sh@543 -- # cat 00:20:06.864 02:39:40 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:20:06.864 02:39:40 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:20:06.864 { 00:20:06.864 "params": { 00:20:06.864 "name": "Nvme$subsystem", 00:20:06.864 "trtype": "$TEST_TRANSPORT", 00:20:06.864 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:06.864 "adrfam": "ipv4", 00:20:06.864 "trsvcid": "$NVMF_PORT", 00:20:06.864 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:06.864 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:06.864 "hdgst": ${hdgst:-false}, 00:20:06.864 "ddgst": ${ddgst:-false} 00:20:06.864 }, 00:20:06.864 "method": "bdev_nvme_attach_controller" 00:20:06.864 } 00:20:06.864 EOF 00:20:06.864 )") 00:20:06.864 02:39:40 -- nvmf/common.sh@543 -- # cat 00:20:06.864 02:39:40 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:20:06.864 02:39:40 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:20:06.864 { 00:20:06.864 "params": { 00:20:06.864 "name": "Nvme$subsystem", 00:20:06.864 "trtype": "$TEST_TRANSPORT", 00:20:06.864 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:06.864 "adrfam": "ipv4", 00:20:06.864 "trsvcid": "$NVMF_PORT", 00:20:06.864 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:06.864 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:06.864 "hdgst": ${hdgst:-false}, 00:20:06.864 "ddgst": ${ddgst:-false} 00:20:06.864 }, 00:20:06.864 "method": "bdev_nvme_attach_controller" 00:20:06.864 } 00:20:06.864 EOF 00:20:06.864 )") 00:20:06.864 02:39:40 -- nvmf/common.sh@543 -- # cat 00:20:06.864 02:39:40 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:20:06.864 02:39:40 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:20:06.864 { 00:20:06.864 "params": { 00:20:06.864 "name": "Nvme$subsystem", 00:20:06.864 "trtype": "$TEST_TRANSPORT", 00:20:06.864 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:06.864 "adrfam": "ipv4", 00:20:06.864 "trsvcid": "$NVMF_PORT", 00:20:06.864 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:06.864 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:06.864 "hdgst": ${hdgst:-false}, 00:20:06.864 "ddgst": ${ddgst:-false} 00:20:06.864 }, 00:20:06.864 "method": "bdev_nvme_attach_controller" 00:20:06.864 } 00:20:06.864 EOF 00:20:06.864 )") 00:20:06.864 02:39:40 -- nvmf/common.sh@543 -- # cat 00:20:06.864 02:39:40 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:20:06.864 02:39:40 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:20:06.864 { 00:20:06.864 "params": { 00:20:06.864 "name": "Nvme$subsystem", 00:20:06.864 "trtype": "$TEST_TRANSPORT", 00:20:06.864 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:06.864 "adrfam": "ipv4", 00:20:06.864 "trsvcid": "$NVMF_PORT", 00:20:06.864 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:06.864 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:06.864 "hdgst": ${hdgst:-false}, 00:20:06.864 "ddgst": ${ddgst:-false} 00:20:06.864 }, 00:20:06.864 "method": "bdev_nvme_attach_controller" 00:20:06.864 } 00:20:06.864 EOF 00:20:06.864 )") 00:20:06.864 02:39:40 -- nvmf/common.sh@543 -- # cat 00:20:06.864 02:39:40 -- nvmf/common.sh@545 -- # jq . 00:20:06.864 EAL: No free 2048 kB hugepages reported on node 1 00:20:06.864 02:39:40 -- nvmf/common.sh@546 -- # IFS=, 00:20:06.864 02:39:40 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:20:06.864 "params": { 00:20:06.864 "name": "Nvme1", 00:20:06.864 "trtype": "rdma", 00:20:06.864 "traddr": "192.168.100.8", 00:20:06.864 "adrfam": "ipv4", 00:20:06.864 "trsvcid": "4420", 00:20:06.864 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:06.864 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:06.864 "hdgst": false, 00:20:06.864 "ddgst": false 00:20:06.864 }, 00:20:06.864 "method": "bdev_nvme_attach_controller" 00:20:06.864 },{ 00:20:06.864 "params": { 00:20:06.864 "name": "Nvme2", 00:20:06.864 "trtype": "rdma", 00:20:06.864 "traddr": "192.168.100.8", 00:20:06.864 "adrfam": "ipv4", 00:20:06.864 "trsvcid": "4420", 00:20:06.864 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:20:06.864 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:20:06.864 "hdgst": false, 00:20:06.864 "ddgst": false 00:20:06.864 }, 00:20:06.864 "method": "bdev_nvme_attach_controller" 00:20:06.864 },{ 00:20:06.864 "params": { 00:20:06.864 "name": "Nvme3", 00:20:06.864 "trtype": "rdma", 00:20:06.864 "traddr": "192.168.100.8", 00:20:06.864 "adrfam": "ipv4", 00:20:06.864 "trsvcid": "4420", 00:20:06.864 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:20:06.864 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:20:06.864 "hdgst": false, 00:20:06.864 "ddgst": false 00:20:06.864 }, 00:20:06.864 "method": "bdev_nvme_attach_controller" 00:20:06.864 },{ 00:20:06.864 "params": { 00:20:06.864 "name": "Nvme4", 00:20:06.864 "trtype": "rdma", 00:20:06.864 "traddr": "192.168.100.8", 00:20:06.864 "adrfam": "ipv4", 00:20:06.864 "trsvcid": "4420", 00:20:06.864 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:20:06.864 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:20:06.864 "hdgst": false, 00:20:06.864 "ddgst": false 00:20:06.864 }, 00:20:06.864 "method": "bdev_nvme_attach_controller" 00:20:06.864 },{ 00:20:06.864 "params": { 00:20:06.864 "name": "Nvme5", 00:20:06.864 "trtype": "rdma", 00:20:06.864 "traddr": "192.168.100.8", 00:20:06.864 "adrfam": "ipv4", 00:20:06.864 "trsvcid": "4420", 00:20:06.864 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:20:06.864 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:20:06.864 "hdgst": false, 00:20:06.864 "ddgst": false 00:20:06.864 }, 00:20:06.864 "method": "bdev_nvme_attach_controller" 00:20:06.864 },{ 00:20:06.864 "params": { 00:20:06.864 "name": "Nvme6", 00:20:06.864 "trtype": "rdma", 00:20:06.864 "traddr": "192.168.100.8", 00:20:06.864 "adrfam": "ipv4", 00:20:06.864 "trsvcid": "4420", 00:20:06.864 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:20:06.864 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:20:06.864 "hdgst": false, 00:20:06.864 "ddgst": false 00:20:06.864 }, 00:20:06.864 "method": "bdev_nvme_attach_controller" 00:20:06.864 },{ 00:20:06.864 "params": { 00:20:06.864 "name": "Nvme7", 00:20:06.864 "trtype": "rdma", 00:20:06.864 "traddr": "192.168.100.8", 00:20:06.864 "adrfam": "ipv4", 00:20:06.864 "trsvcid": "4420", 00:20:06.864 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:20:06.864 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:20:06.864 "hdgst": false, 00:20:06.864 "ddgst": false 00:20:06.864 }, 00:20:06.864 "method": "bdev_nvme_attach_controller" 00:20:06.864 },{ 00:20:06.864 "params": { 00:20:06.864 "name": "Nvme8", 00:20:06.864 "trtype": "rdma", 00:20:06.864 "traddr": "192.168.100.8", 00:20:06.864 "adrfam": "ipv4", 00:20:06.864 "trsvcid": "4420", 00:20:06.864 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:20:06.864 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:20:06.864 "hdgst": false, 00:20:06.864 "ddgst": false 00:20:06.864 }, 00:20:06.864 "method": "bdev_nvme_attach_controller" 00:20:06.864 },{ 00:20:06.864 "params": { 00:20:06.864 "name": "Nvme9", 00:20:06.864 "trtype": "rdma", 00:20:06.865 "traddr": "192.168.100.8", 00:20:06.865 "adrfam": "ipv4", 00:20:06.865 "trsvcid": "4420", 00:20:06.865 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:20:06.865 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:20:06.865 "hdgst": false, 00:20:06.865 "ddgst": false 00:20:06.865 }, 00:20:06.865 "method": "bdev_nvme_attach_controller" 00:20:06.865 },{ 00:20:06.865 "params": { 00:20:06.865 "name": "Nvme10", 00:20:06.865 "trtype": "rdma", 00:20:06.865 "traddr": "192.168.100.8", 00:20:06.865 "adrfam": "ipv4", 00:20:06.865 "trsvcid": "4420", 00:20:06.865 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:20:06.865 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:20:06.865 "hdgst": false, 00:20:06.865 "ddgst": false 00:20:06.865 }, 00:20:06.865 "method": "bdev_nvme_attach_controller" 00:20:06.865 }' 00:20:06.865 [2024-04-27 02:39:40.358844] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:06.865 [2024-04-27 02:39:40.445216] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:07.803 02:39:41 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:07.803 02:39:41 -- common/autotest_common.sh@850 -- # return 0 00:20:07.803 02:39:41 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:20:07.803 02:39:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:07.804 02:39:41 -- common/autotest_common.sh@10 -- # set +x 00:20:07.804 02:39:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:07.804 02:39:41 -- target/shutdown.sh@83 -- # kill -9 1593641 00:20:07.804 02:39:41 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:20:07.804 02:39:41 -- target/shutdown.sh@87 -- # sleep 1 00:20:08.742 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 1593641 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:20:08.742 02:39:42 -- target/shutdown.sh@88 -- # kill -0 1593396 00:20:08.742 02:39:42 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:20:08.742 02:39:42 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:20:08.742 02:39:42 -- nvmf/common.sh@521 -- # config=() 00:20:08.742 02:39:42 -- nvmf/common.sh@521 -- # local subsystem config 00:20:08.742 02:39:42 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:20:08.742 02:39:42 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:20:08.742 { 00:20:08.742 "params": { 00:20:08.742 "name": "Nvme$subsystem", 00:20:08.742 "trtype": "$TEST_TRANSPORT", 00:20:08.742 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:08.742 "adrfam": "ipv4", 00:20:08.742 "trsvcid": "$NVMF_PORT", 00:20:08.742 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:08.742 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:08.742 "hdgst": ${hdgst:-false}, 00:20:08.742 "ddgst": ${ddgst:-false} 00:20:08.742 }, 00:20:08.742 "method": "bdev_nvme_attach_controller" 00:20:08.742 } 00:20:08.742 EOF 00:20:08.742 )") 00:20:08.742 02:39:42 -- nvmf/common.sh@543 -- # cat 00:20:08.742 02:39:42 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:20:08.742 02:39:42 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:20:08.742 { 00:20:08.742 "params": { 00:20:08.742 "name": "Nvme$subsystem", 00:20:08.742 "trtype": "$TEST_TRANSPORT", 00:20:08.742 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:08.742 "adrfam": "ipv4", 00:20:08.742 "trsvcid": "$NVMF_PORT", 00:20:08.742 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:08.743 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:08.743 "hdgst": ${hdgst:-false}, 00:20:08.743 "ddgst": ${ddgst:-false} 00:20:08.743 }, 00:20:08.743 "method": "bdev_nvme_attach_controller" 00:20:08.743 } 00:20:08.743 EOF 00:20:08.743 )") 00:20:08.743 02:39:42 -- nvmf/common.sh@543 -- # cat 00:20:08.743 02:39:42 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:20:08.743 02:39:42 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:20:08.743 { 00:20:08.743 "params": { 00:20:08.743 "name": "Nvme$subsystem", 00:20:08.743 "trtype": "$TEST_TRANSPORT", 00:20:08.743 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:08.743 "adrfam": "ipv4", 00:20:08.743 "trsvcid": "$NVMF_PORT", 00:20:08.743 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:08.743 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:08.743 "hdgst": ${hdgst:-false}, 00:20:08.743 "ddgst": ${ddgst:-false} 00:20:08.743 }, 00:20:08.743 "method": "bdev_nvme_attach_controller" 00:20:08.743 } 00:20:08.743 EOF 00:20:08.743 )") 00:20:08.743 02:39:42 -- nvmf/common.sh@543 -- # cat 00:20:08.743 02:39:42 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:20:08.743 02:39:42 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:20:08.743 { 00:20:08.743 "params": { 00:20:08.743 "name": "Nvme$subsystem", 00:20:08.743 "trtype": "$TEST_TRANSPORT", 00:20:08.743 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:08.743 "adrfam": "ipv4", 00:20:08.743 "trsvcid": "$NVMF_PORT", 00:20:08.743 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:08.743 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:08.743 "hdgst": ${hdgst:-false}, 00:20:08.743 "ddgst": ${ddgst:-false} 00:20:08.743 }, 00:20:08.743 "method": "bdev_nvme_attach_controller" 00:20:08.743 } 00:20:08.743 EOF 00:20:08.743 )") 00:20:08.743 02:39:42 -- nvmf/common.sh@543 -- # cat 00:20:08.743 02:39:42 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:20:08.743 02:39:42 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:20:08.743 { 00:20:08.743 "params": { 00:20:08.743 "name": "Nvme$subsystem", 00:20:08.743 "trtype": "$TEST_TRANSPORT", 00:20:08.743 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:08.743 "adrfam": "ipv4", 00:20:08.743 "trsvcid": "$NVMF_PORT", 00:20:08.743 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:08.743 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:08.743 "hdgst": ${hdgst:-false}, 00:20:08.743 "ddgst": ${ddgst:-false} 00:20:08.743 }, 00:20:08.743 "method": "bdev_nvme_attach_controller" 00:20:08.743 } 00:20:08.743 EOF 00:20:08.743 )") 00:20:08.743 02:39:42 -- nvmf/common.sh@543 -- # cat 00:20:08.743 02:39:42 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:20:08.743 02:39:42 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:20:08.743 { 00:20:08.743 "params": { 00:20:08.743 "name": "Nvme$subsystem", 00:20:08.743 "trtype": "$TEST_TRANSPORT", 00:20:08.743 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:08.743 "adrfam": "ipv4", 00:20:08.743 "trsvcid": "$NVMF_PORT", 00:20:08.743 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:08.743 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:08.743 "hdgst": ${hdgst:-false}, 00:20:08.743 "ddgst": ${ddgst:-false} 00:20:08.743 }, 00:20:08.743 "method": "bdev_nvme_attach_controller" 00:20:08.743 } 00:20:08.743 EOF 00:20:08.743 )") 00:20:08.743 [2024-04-27 02:39:42.362679] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:20:08.743 [2024-04-27 02:39:42.362743] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1594014 ] 00:20:09.031 02:39:42 -- nvmf/common.sh@543 -- # cat 00:20:09.031 02:39:42 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:20:09.032 02:39:42 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:20:09.032 { 00:20:09.032 "params": { 00:20:09.032 "name": "Nvme$subsystem", 00:20:09.032 "trtype": "$TEST_TRANSPORT", 00:20:09.032 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:09.032 "adrfam": "ipv4", 00:20:09.032 "trsvcid": "$NVMF_PORT", 00:20:09.032 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:09.032 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:09.032 "hdgst": ${hdgst:-false}, 00:20:09.032 "ddgst": ${ddgst:-false} 00:20:09.032 }, 00:20:09.032 "method": "bdev_nvme_attach_controller" 00:20:09.032 } 00:20:09.032 EOF 00:20:09.032 )") 00:20:09.032 02:39:42 -- nvmf/common.sh@543 -- # cat 00:20:09.032 02:39:42 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:20:09.032 02:39:42 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:20:09.032 { 00:20:09.032 "params": { 00:20:09.032 "name": "Nvme$subsystem", 00:20:09.032 "trtype": "$TEST_TRANSPORT", 00:20:09.032 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:09.032 "adrfam": "ipv4", 00:20:09.032 "trsvcid": "$NVMF_PORT", 00:20:09.032 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:09.032 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:09.032 "hdgst": ${hdgst:-false}, 00:20:09.032 "ddgst": ${ddgst:-false} 00:20:09.032 }, 00:20:09.032 "method": "bdev_nvme_attach_controller" 00:20:09.032 } 00:20:09.032 EOF 00:20:09.032 )") 00:20:09.032 02:39:42 -- nvmf/common.sh@543 -- # cat 00:20:09.032 02:39:42 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:20:09.032 02:39:42 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:20:09.032 { 00:20:09.032 "params": { 00:20:09.032 "name": "Nvme$subsystem", 00:20:09.032 "trtype": "$TEST_TRANSPORT", 00:20:09.032 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:09.032 "adrfam": "ipv4", 00:20:09.032 "trsvcid": "$NVMF_PORT", 00:20:09.032 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:09.032 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:09.032 "hdgst": ${hdgst:-false}, 00:20:09.032 "ddgst": ${ddgst:-false} 00:20:09.032 }, 00:20:09.032 "method": "bdev_nvme_attach_controller" 00:20:09.032 } 00:20:09.032 EOF 00:20:09.032 )") 00:20:09.032 02:39:42 -- nvmf/common.sh@543 -- # cat 00:20:09.032 02:39:42 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:20:09.032 02:39:42 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:20:09.032 { 00:20:09.032 "params": { 00:20:09.032 "name": "Nvme$subsystem", 00:20:09.032 "trtype": "$TEST_TRANSPORT", 00:20:09.032 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:09.032 "adrfam": "ipv4", 00:20:09.032 "trsvcid": "$NVMF_PORT", 00:20:09.032 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:09.032 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:09.032 "hdgst": ${hdgst:-false}, 00:20:09.032 "ddgst": ${ddgst:-false} 00:20:09.032 }, 00:20:09.032 "method": "bdev_nvme_attach_controller" 00:20:09.032 } 00:20:09.032 EOF 00:20:09.032 )") 00:20:09.032 02:39:42 -- nvmf/common.sh@543 -- # cat 00:20:09.032 EAL: No free 2048 kB hugepages reported on node 1 00:20:09.032 02:39:42 -- nvmf/common.sh@545 -- # jq . 00:20:09.032 02:39:42 -- nvmf/common.sh@546 -- # IFS=, 00:20:09.032 02:39:42 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:20:09.032 "params": { 00:20:09.032 "name": "Nvme1", 00:20:09.032 "trtype": "rdma", 00:20:09.032 "traddr": "192.168.100.8", 00:20:09.032 "adrfam": "ipv4", 00:20:09.032 "trsvcid": "4420", 00:20:09.032 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:09.032 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:09.032 "hdgst": false, 00:20:09.032 "ddgst": false 00:20:09.032 }, 00:20:09.032 "method": "bdev_nvme_attach_controller" 00:20:09.032 },{ 00:20:09.032 "params": { 00:20:09.032 "name": "Nvme2", 00:20:09.032 "trtype": "rdma", 00:20:09.032 "traddr": "192.168.100.8", 00:20:09.032 "adrfam": "ipv4", 00:20:09.032 "trsvcid": "4420", 00:20:09.032 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:20:09.032 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:20:09.032 "hdgst": false, 00:20:09.032 "ddgst": false 00:20:09.032 }, 00:20:09.032 "method": "bdev_nvme_attach_controller" 00:20:09.032 },{ 00:20:09.032 "params": { 00:20:09.032 "name": "Nvme3", 00:20:09.032 "trtype": "rdma", 00:20:09.032 "traddr": "192.168.100.8", 00:20:09.032 "adrfam": "ipv4", 00:20:09.032 "trsvcid": "4420", 00:20:09.032 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:20:09.032 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:20:09.032 "hdgst": false, 00:20:09.032 "ddgst": false 00:20:09.032 }, 00:20:09.032 "method": "bdev_nvme_attach_controller" 00:20:09.032 },{ 00:20:09.032 "params": { 00:20:09.032 "name": "Nvme4", 00:20:09.032 "trtype": "rdma", 00:20:09.032 "traddr": "192.168.100.8", 00:20:09.032 "adrfam": "ipv4", 00:20:09.032 "trsvcid": "4420", 00:20:09.032 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:20:09.032 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:20:09.032 "hdgst": false, 00:20:09.032 "ddgst": false 00:20:09.032 }, 00:20:09.032 "method": "bdev_nvme_attach_controller" 00:20:09.032 },{ 00:20:09.032 "params": { 00:20:09.032 "name": "Nvme5", 00:20:09.032 "trtype": "rdma", 00:20:09.032 "traddr": "192.168.100.8", 00:20:09.032 "adrfam": "ipv4", 00:20:09.032 "trsvcid": "4420", 00:20:09.032 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:20:09.032 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:20:09.032 "hdgst": false, 00:20:09.032 "ddgst": false 00:20:09.032 }, 00:20:09.032 "method": "bdev_nvme_attach_controller" 00:20:09.032 },{ 00:20:09.032 "params": { 00:20:09.032 "name": "Nvme6", 00:20:09.032 "trtype": "rdma", 00:20:09.032 "traddr": "192.168.100.8", 00:20:09.032 "adrfam": "ipv4", 00:20:09.032 "trsvcid": "4420", 00:20:09.032 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:20:09.032 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:20:09.032 "hdgst": false, 00:20:09.032 "ddgst": false 00:20:09.032 }, 00:20:09.032 "method": "bdev_nvme_attach_controller" 00:20:09.032 },{ 00:20:09.032 "params": { 00:20:09.032 "name": "Nvme7", 00:20:09.032 "trtype": "rdma", 00:20:09.032 "traddr": "192.168.100.8", 00:20:09.032 "adrfam": "ipv4", 00:20:09.032 "trsvcid": "4420", 00:20:09.032 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:20:09.032 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:20:09.032 "hdgst": false, 00:20:09.032 "ddgst": false 00:20:09.032 }, 00:20:09.032 "method": "bdev_nvme_attach_controller" 00:20:09.032 },{ 00:20:09.032 "params": { 00:20:09.032 "name": "Nvme8", 00:20:09.032 "trtype": "rdma", 00:20:09.032 "traddr": "192.168.100.8", 00:20:09.032 "adrfam": "ipv4", 00:20:09.032 "trsvcid": "4420", 00:20:09.032 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:20:09.032 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:20:09.032 "hdgst": false, 00:20:09.032 "ddgst": false 00:20:09.032 }, 00:20:09.032 "method": "bdev_nvme_attach_controller" 00:20:09.032 },{ 00:20:09.032 "params": { 00:20:09.032 "name": "Nvme9", 00:20:09.032 "trtype": "rdma", 00:20:09.032 "traddr": "192.168.100.8", 00:20:09.032 "adrfam": "ipv4", 00:20:09.032 "trsvcid": "4420", 00:20:09.032 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:20:09.032 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:20:09.032 "hdgst": false, 00:20:09.032 "ddgst": false 00:20:09.032 }, 00:20:09.032 "method": "bdev_nvme_attach_controller" 00:20:09.032 },{ 00:20:09.032 "params": { 00:20:09.032 "name": "Nvme10", 00:20:09.032 "trtype": "rdma", 00:20:09.032 "traddr": "192.168.100.8", 00:20:09.032 "adrfam": "ipv4", 00:20:09.032 "trsvcid": "4420", 00:20:09.032 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:20:09.032 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:20:09.032 "hdgst": false, 00:20:09.032 "ddgst": false 00:20:09.032 }, 00:20:09.032 "method": "bdev_nvme_attach_controller" 00:20:09.032 }' 00:20:09.032 [2024-04-27 02:39:42.440136] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:09.032 [2024-04-27 02:39:42.520284] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:09.969 Running I/O for 1 seconds... 00:20:11.345 00:20:11.345 Latency(us) 00:20:11.345 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:11.345 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:20:11.345 Verification LBA range: start 0x0 length 0x400 00:20:11.345 Nvme1n1 : 1.17 362.05 22.63 0.00 0.00 173818.55 6724.56 233422.14 00:20:11.345 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:20:11.345 Verification LBA range: start 0x0 length 0x400 00:20:11.345 Nvme2n1 : 1.17 382.11 23.88 0.00 0.00 162343.59 5755.77 165036.74 00:20:11.345 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:20:11.345 Verification LBA range: start 0x0 length 0x400 00:20:11.345 Nvme3n1 : 1.17 381.71 23.86 0.00 0.00 160357.38 8719.14 158654.11 00:20:11.345 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:20:11.345 Verification LBA range: start 0x0 length 0x400 00:20:11.345 Nvme4n1 : 1.17 381.30 23.83 0.00 0.00 158338.64 9004.08 151359.67 00:20:11.345 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:20:11.345 Verification LBA range: start 0x0 length 0x400 00:20:11.345 Nvme5n1 : 1.18 380.77 23.80 0.00 0.00 156883.54 9744.92 139506.20 00:20:11.345 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:20:11.345 Verification LBA range: start 0x0 length 0x400 00:20:11.345 Nvme6n1 : 1.18 380.38 23.77 0.00 0.00 154350.06 10200.82 132211.76 00:20:11.345 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:20:11.345 Verification LBA range: start 0x0 length 0x400 00:20:11.345 Nvme7n1 : 1.18 379.93 23.75 0.00 0.00 152655.31 10542.75 121270.09 00:20:11.345 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:20:11.345 Verification LBA range: start 0x0 length 0x400 00:20:11.345 Nvme8n1 : 1.18 379.56 23.72 0.00 0.00 150235.94 10770.70 114431.55 00:20:11.345 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:20:11.345 Verification LBA range: start 0x0 length 0x400 00:20:11.345 Nvme9n1 : 1.18 379.04 23.69 0.00 0.00 149025.33 11568.53 99842.67 00:20:11.345 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:20:11.345 Verification LBA range: start 0x0 length 0x400 00:20:11.345 Nvme10n1 : 1.19 323.80 20.24 0.00 0.00 171534.84 3063.10 237069.36 00:20:11.345 =================================================================================================================== 00:20:11.345 Total : 3730.66 233.17 0.00 0.00 158689.77 3063.10 237069.36 00:20:11.345 02:39:44 -- target/shutdown.sh@94 -- # stoptarget 00:20:11.345 02:39:44 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:20:11.345 02:39:44 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:20:11.345 02:39:44 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:20:11.345 02:39:44 -- target/shutdown.sh@45 -- # nvmftestfini 00:20:11.345 02:39:44 -- nvmf/common.sh@477 -- # nvmfcleanup 00:20:11.345 02:39:44 -- nvmf/common.sh@117 -- # sync 00:20:11.345 02:39:44 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:20:11.345 02:39:44 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:20:11.345 02:39:44 -- nvmf/common.sh@120 -- # set +e 00:20:11.345 02:39:44 -- nvmf/common.sh@121 -- # for i in {1..20} 00:20:11.345 02:39:44 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:20:11.345 rmmod nvme_rdma 00:20:11.345 rmmod nvme_fabrics 00:20:11.604 02:39:44 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:20:11.604 02:39:44 -- nvmf/common.sh@124 -- # set -e 00:20:11.604 02:39:44 -- nvmf/common.sh@125 -- # return 0 00:20:11.604 02:39:44 -- nvmf/common.sh@478 -- # '[' -n 1593396 ']' 00:20:11.604 02:39:44 -- nvmf/common.sh@479 -- # killprocess 1593396 00:20:11.604 02:39:44 -- common/autotest_common.sh@936 -- # '[' -z 1593396 ']' 00:20:11.604 02:39:44 -- common/autotest_common.sh@940 -- # kill -0 1593396 00:20:11.604 02:39:44 -- common/autotest_common.sh@941 -- # uname 00:20:11.604 02:39:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:11.604 02:39:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1593396 00:20:11.604 02:39:45 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:11.605 02:39:45 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:11.605 02:39:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1593396' 00:20:11.605 killing process with pid 1593396 00:20:11.605 02:39:45 -- common/autotest_common.sh@955 -- # kill 1593396 00:20:11.605 02:39:45 -- common/autotest_common.sh@960 -- # wait 1593396 00:20:11.605 [2024-04-27 02:39:45.115841] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:20:12.174 02:39:45 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:20:12.174 02:39:45 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:20:12.174 00:20:12.174 real 0m12.938s 00:20:12.174 user 0m31.471s 00:20:12.174 sys 0m5.693s 00:20:12.174 02:39:45 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:20:12.174 02:39:45 -- common/autotest_common.sh@10 -- # set +x 00:20:12.174 ************************************ 00:20:12.174 END TEST nvmf_shutdown_tc1 00:20:12.174 ************************************ 00:20:12.174 02:39:45 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:20:12.174 02:39:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:20:12.174 02:39:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:12.174 02:39:45 -- common/autotest_common.sh@10 -- # set +x 00:20:12.174 ************************************ 00:20:12.174 START TEST nvmf_shutdown_tc2 00:20:12.174 ************************************ 00:20:12.174 02:39:45 -- common/autotest_common.sh@1111 -- # nvmf_shutdown_tc2 00:20:12.174 02:39:45 -- target/shutdown.sh@99 -- # starttarget 00:20:12.174 02:39:45 -- target/shutdown.sh@15 -- # nvmftestinit 00:20:12.174 02:39:45 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:20:12.174 02:39:45 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:12.174 02:39:45 -- nvmf/common.sh@437 -- # prepare_net_devs 00:20:12.174 02:39:45 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:20:12.174 02:39:45 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:20:12.174 02:39:45 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:12.174 02:39:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:12.174 02:39:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:12.174 02:39:45 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:20:12.174 02:39:45 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:20:12.174 02:39:45 -- nvmf/common.sh@285 -- # xtrace_disable 00:20:12.174 02:39:45 -- common/autotest_common.sh@10 -- # set +x 00:20:12.174 02:39:45 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:12.174 02:39:45 -- nvmf/common.sh@291 -- # pci_devs=() 00:20:12.174 02:39:45 -- nvmf/common.sh@291 -- # local -a pci_devs 00:20:12.174 02:39:45 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:20:12.174 02:39:45 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:20:12.174 02:39:45 -- nvmf/common.sh@293 -- # pci_drivers=() 00:20:12.174 02:39:45 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:20:12.174 02:39:45 -- nvmf/common.sh@295 -- # net_devs=() 00:20:12.174 02:39:45 -- nvmf/common.sh@295 -- # local -ga net_devs 00:20:12.174 02:39:45 -- nvmf/common.sh@296 -- # e810=() 00:20:12.174 02:39:45 -- nvmf/common.sh@296 -- # local -ga e810 00:20:12.174 02:39:45 -- nvmf/common.sh@297 -- # x722=() 00:20:12.174 02:39:45 -- nvmf/common.sh@297 -- # local -ga x722 00:20:12.174 02:39:45 -- nvmf/common.sh@298 -- # mlx=() 00:20:12.174 02:39:45 -- nvmf/common.sh@298 -- # local -ga mlx 00:20:12.174 02:39:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:12.174 02:39:45 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:12.174 02:39:45 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:12.174 02:39:45 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:12.174 02:39:45 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:12.174 02:39:45 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:12.174 02:39:45 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:12.174 02:39:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:12.174 02:39:45 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:12.174 02:39:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:12.174 02:39:45 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:12.174 02:39:45 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:20:12.174 02:39:45 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:20:12.174 02:39:45 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:20:12.174 02:39:45 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:20:12.174 02:39:45 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:20:12.174 02:39:45 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:20:12.174 02:39:45 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:20:12.174 02:39:45 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:20:12.174 02:39:45 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:20:12.174 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:20:12.174 02:39:45 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:20:12.174 02:39:45 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:20:12.174 02:39:45 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:20:12.174 02:39:45 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:20:12.174 02:39:45 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:20:12.174 02:39:45 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:20:12.174 02:39:45 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:20:12.174 02:39:45 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:20:12.174 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:20:12.174 02:39:45 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:20:12.174 02:39:45 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:20:12.174 02:39:45 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:20:12.174 02:39:45 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:20:12.174 02:39:45 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:20:12.174 02:39:45 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:20:12.174 02:39:45 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:20:12.174 02:39:45 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:20:12.174 02:39:45 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:20:12.174 02:39:45 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:12.174 02:39:45 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:20:12.174 02:39:45 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:12.174 02:39:45 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:20:12.174 Found net devices under 0000:18:00.0: mlx_0_0 00:20:12.175 02:39:45 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:20:12.175 02:39:45 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:20:12.175 02:39:45 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:12.175 02:39:45 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:20:12.175 02:39:45 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:12.175 02:39:45 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:20:12.175 Found net devices under 0000:18:00.1: mlx_0_1 00:20:12.175 02:39:45 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:20:12.175 02:39:45 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:20:12.175 02:39:45 -- nvmf/common.sh@403 -- # is_hw=yes 00:20:12.175 02:39:45 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:20:12.175 02:39:45 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:20:12.175 02:39:45 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:20:12.175 02:39:45 -- nvmf/common.sh@409 -- # rdma_device_init 00:20:12.175 02:39:45 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:20:12.175 02:39:45 -- nvmf/common.sh@58 -- # uname 00:20:12.175 02:39:45 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:20:12.175 02:39:45 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:20:12.175 02:39:45 -- nvmf/common.sh@63 -- # modprobe ib_core 00:20:12.175 02:39:45 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:20:12.175 02:39:45 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:20:12.175 02:39:45 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:20:12.175 02:39:45 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:20:12.175 02:39:45 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:20:12.175 02:39:45 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:20:12.435 02:39:45 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:20:12.435 02:39:45 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:20:12.435 02:39:45 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:20:12.435 02:39:45 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:20:12.435 02:39:45 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:20:12.435 02:39:45 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:20:12.435 02:39:45 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:20:12.435 02:39:45 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:12.435 02:39:45 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:12.435 02:39:45 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:20:12.435 02:39:45 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:20:12.435 02:39:45 -- nvmf/common.sh@105 -- # continue 2 00:20:12.435 02:39:45 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:12.435 02:39:45 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:12.435 02:39:45 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:20:12.435 02:39:45 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:12.435 02:39:45 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:20:12.435 02:39:45 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:20:12.435 02:39:45 -- nvmf/common.sh@105 -- # continue 2 00:20:12.435 02:39:45 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:20:12.435 02:39:45 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:20:12.435 02:39:45 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:20:12.435 02:39:45 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:20:12.435 02:39:45 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:12.435 02:39:45 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:12.435 02:39:45 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:20:12.435 02:39:45 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:20:12.435 02:39:45 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:20:12.435 64: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:20:12.435 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:20:12.435 altname enp24s0f0np0 00:20:12.435 altname ens785f0np0 00:20:12.435 inet 192.168.100.8/24 scope global mlx_0_0 00:20:12.435 valid_lft forever preferred_lft forever 00:20:12.435 02:39:45 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:20:12.435 02:39:45 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:20:12.435 02:39:45 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:20:12.435 02:39:45 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:20:12.435 02:39:45 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:12.435 02:39:45 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:12.435 02:39:45 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:20:12.435 02:39:45 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:20:12.435 02:39:45 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:20:12.435 65: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:20:12.435 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:20:12.435 altname enp24s0f1np1 00:20:12.435 altname ens785f1np1 00:20:12.435 inet 192.168.100.9/24 scope global mlx_0_1 00:20:12.435 valid_lft forever preferred_lft forever 00:20:12.435 02:39:45 -- nvmf/common.sh@411 -- # return 0 00:20:12.435 02:39:45 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:20:12.435 02:39:45 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:20:12.435 02:39:45 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:20:12.435 02:39:45 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:20:12.435 02:39:45 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:20:12.435 02:39:45 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:20:12.435 02:39:45 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:20:12.435 02:39:45 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:20:12.435 02:39:45 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:20:12.435 02:39:45 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:20:12.435 02:39:45 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:12.435 02:39:45 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:12.435 02:39:45 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:20:12.435 02:39:45 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:20:12.435 02:39:45 -- nvmf/common.sh@105 -- # continue 2 00:20:12.435 02:39:45 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:12.435 02:39:45 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:12.435 02:39:45 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:20:12.435 02:39:45 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:12.435 02:39:45 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:20:12.435 02:39:45 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:20:12.435 02:39:45 -- nvmf/common.sh@105 -- # continue 2 00:20:12.435 02:39:45 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:20:12.435 02:39:45 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:20:12.435 02:39:45 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:20:12.435 02:39:45 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:12.435 02:39:45 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:12.435 02:39:45 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:20:12.435 02:39:45 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:20:12.435 02:39:45 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:20:12.435 02:39:45 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:20:12.435 02:39:45 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:12.435 02:39:45 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:20:12.435 02:39:45 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:12.435 02:39:45 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:20:12.435 192.168.100.9' 00:20:12.435 02:39:45 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:20:12.435 192.168.100.9' 00:20:12.435 02:39:45 -- nvmf/common.sh@446 -- # head -n 1 00:20:12.435 02:39:45 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:20:12.435 02:39:45 -- nvmf/common.sh@447 -- # head -n 1 00:20:12.435 02:39:45 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:20:12.435 192.168.100.9' 00:20:12.435 02:39:45 -- nvmf/common.sh@447 -- # tail -n +2 00:20:12.435 02:39:45 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:20:12.435 02:39:45 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:20:12.435 02:39:45 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:20:12.435 02:39:45 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:20:12.435 02:39:45 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:20:12.435 02:39:45 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:20:12.435 02:39:45 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:20:12.435 02:39:45 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:20:12.435 02:39:45 -- common/autotest_common.sh@710 -- # xtrace_disable 00:20:12.436 02:39:45 -- common/autotest_common.sh@10 -- # set +x 00:20:12.436 02:39:45 -- nvmf/common.sh@470 -- # nvmfpid=1594568 00:20:12.436 02:39:45 -- nvmf/common.sh@471 -- # waitforlisten 1594568 00:20:12.436 02:39:45 -- common/autotest_common.sh@817 -- # '[' -z 1594568 ']' 00:20:12.436 02:39:45 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:12.436 02:39:45 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:12.436 02:39:45 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:12.436 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:12.436 02:39:45 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:12.436 02:39:45 -- common/autotest_common.sh@10 -- # set +x 00:20:12.436 02:39:45 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:20:12.436 [2024-04-27 02:39:46.004109] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:20:12.436 [2024-04-27 02:39:46.004166] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:12.436 EAL: No free 2048 kB hugepages reported on node 1 00:20:12.695 [2024-04-27 02:39:46.077983] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:20:12.695 [2024-04-27 02:39:46.166620] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:12.695 [2024-04-27 02:39:46.166665] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:12.695 [2024-04-27 02:39:46.166675] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:20:12.695 [2024-04-27 02:39:46.166684] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:20:12.695 [2024-04-27 02:39:46.166692] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:12.695 [2024-04-27 02:39:46.166794] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:12.695 [2024-04-27 02:39:46.166876] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:12.695 [2024-04-27 02:39:46.166977] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:12.695 [2024-04-27 02:39:46.166978] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:20:13.263 02:39:46 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:13.263 02:39:46 -- common/autotest_common.sh@850 -- # return 0 00:20:13.263 02:39:46 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:20:13.263 02:39:46 -- common/autotest_common.sh@716 -- # xtrace_disable 00:20:13.263 02:39:46 -- common/autotest_common.sh@10 -- # set +x 00:20:13.263 02:39:46 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:13.263 02:39:46 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:20:13.263 02:39:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:13.263 02:39:46 -- common/autotest_common.sh@10 -- # set +x 00:20:13.523 [2024-04-27 02:39:46.888791] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x192e7c0/0x1932cb0) succeed. 00:20:13.523 [2024-04-27 02:39:46.899241] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x192fe00/0x1974340) succeed. 00:20:13.523 02:39:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:13.523 02:39:47 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:20:13.523 02:39:47 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:20:13.523 02:39:47 -- common/autotest_common.sh@710 -- # xtrace_disable 00:20:13.523 02:39:47 -- common/autotest_common.sh@10 -- # set +x 00:20:13.523 02:39:47 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:20:13.523 02:39:47 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:20:13.523 02:39:47 -- target/shutdown.sh@28 -- # cat 00:20:13.523 02:39:47 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:20:13.523 02:39:47 -- target/shutdown.sh@28 -- # cat 00:20:13.523 02:39:47 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:20:13.523 02:39:47 -- target/shutdown.sh@28 -- # cat 00:20:13.523 02:39:47 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:20:13.523 02:39:47 -- target/shutdown.sh@28 -- # cat 00:20:13.523 02:39:47 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:20:13.523 02:39:47 -- target/shutdown.sh@28 -- # cat 00:20:13.523 02:39:47 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:20:13.523 02:39:47 -- target/shutdown.sh@28 -- # cat 00:20:13.523 02:39:47 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:20:13.523 02:39:47 -- target/shutdown.sh@28 -- # cat 00:20:13.523 02:39:47 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:20:13.523 02:39:47 -- target/shutdown.sh@28 -- # cat 00:20:13.523 02:39:47 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:20:13.523 02:39:47 -- target/shutdown.sh@28 -- # cat 00:20:13.523 02:39:47 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:20:13.523 02:39:47 -- target/shutdown.sh@28 -- # cat 00:20:13.523 02:39:47 -- target/shutdown.sh@35 -- # rpc_cmd 00:20:13.523 02:39:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:13.523 02:39:47 -- common/autotest_common.sh@10 -- # set +x 00:20:13.523 Malloc1 00:20:13.523 [2024-04-27 02:39:47.125493] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:20:13.783 Malloc2 00:20:13.783 Malloc3 00:20:13.783 Malloc4 00:20:13.783 Malloc5 00:20:13.783 Malloc6 00:20:13.783 Malloc7 00:20:14.044 Malloc8 00:20:14.044 Malloc9 00:20:14.044 Malloc10 00:20:14.044 02:39:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:14.044 02:39:47 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:20:14.044 02:39:47 -- common/autotest_common.sh@716 -- # xtrace_disable 00:20:14.044 02:39:47 -- common/autotest_common.sh@10 -- # set +x 00:20:14.044 02:39:47 -- target/shutdown.sh@103 -- # perfpid=1594899 00:20:14.044 02:39:47 -- target/shutdown.sh@104 -- # waitforlisten 1594899 /var/tmp/bdevperf.sock 00:20:14.044 02:39:47 -- common/autotest_common.sh@817 -- # '[' -z 1594899 ']' 00:20:14.044 02:39:47 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:14.044 02:39:47 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:14.044 02:39:47 -- target/shutdown.sh@102 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:20:14.044 02:39:47 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:14.044 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:14.044 02:39:47 -- target/shutdown.sh@102 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:20:14.044 02:39:47 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:14.044 02:39:47 -- common/autotest_common.sh@10 -- # set +x 00:20:14.044 02:39:47 -- nvmf/common.sh@521 -- # config=() 00:20:14.044 02:39:47 -- nvmf/common.sh@521 -- # local subsystem config 00:20:14.044 02:39:47 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:20:14.044 02:39:47 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:20:14.044 { 00:20:14.044 "params": { 00:20:14.044 "name": "Nvme$subsystem", 00:20:14.044 "trtype": "$TEST_TRANSPORT", 00:20:14.044 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:14.044 "adrfam": "ipv4", 00:20:14.044 "trsvcid": "$NVMF_PORT", 00:20:14.044 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:14.044 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:14.044 "hdgst": ${hdgst:-false}, 00:20:14.044 "ddgst": ${ddgst:-false} 00:20:14.044 }, 00:20:14.044 "method": "bdev_nvme_attach_controller" 00:20:14.044 } 00:20:14.044 EOF 00:20:14.044 )") 00:20:14.044 02:39:47 -- nvmf/common.sh@543 -- # cat 00:20:14.044 02:39:47 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:20:14.044 02:39:47 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:20:14.044 { 00:20:14.044 "params": { 00:20:14.044 "name": "Nvme$subsystem", 00:20:14.044 "trtype": "$TEST_TRANSPORT", 00:20:14.044 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:14.044 "adrfam": "ipv4", 00:20:14.044 "trsvcid": "$NVMF_PORT", 00:20:14.044 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:14.044 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:14.044 "hdgst": ${hdgst:-false}, 00:20:14.044 "ddgst": ${ddgst:-false} 00:20:14.044 }, 00:20:14.044 "method": "bdev_nvme_attach_controller" 00:20:14.044 } 00:20:14.044 EOF 00:20:14.044 )") 00:20:14.044 02:39:47 -- nvmf/common.sh@543 -- # cat 00:20:14.044 02:39:47 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:20:14.044 02:39:47 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:20:14.044 { 00:20:14.044 "params": { 00:20:14.044 "name": "Nvme$subsystem", 00:20:14.044 "trtype": "$TEST_TRANSPORT", 00:20:14.044 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:14.044 "adrfam": "ipv4", 00:20:14.044 "trsvcid": "$NVMF_PORT", 00:20:14.044 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:14.044 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:14.044 "hdgst": ${hdgst:-false}, 00:20:14.044 "ddgst": ${ddgst:-false} 00:20:14.044 }, 00:20:14.044 "method": "bdev_nvme_attach_controller" 00:20:14.044 } 00:20:14.044 EOF 00:20:14.044 )") 00:20:14.044 02:39:47 -- nvmf/common.sh@543 -- # cat 00:20:14.044 02:39:47 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:20:14.044 02:39:47 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:20:14.044 { 00:20:14.044 "params": { 00:20:14.044 "name": "Nvme$subsystem", 00:20:14.044 "trtype": "$TEST_TRANSPORT", 00:20:14.044 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:14.044 "adrfam": "ipv4", 00:20:14.044 "trsvcid": "$NVMF_PORT", 00:20:14.044 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:14.044 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:14.044 "hdgst": ${hdgst:-false}, 00:20:14.044 "ddgst": ${ddgst:-false} 00:20:14.044 }, 00:20:14.044 "method": "bdev_nvme_attach_controller" 00:20:14.044 } 00:20:14.044 EOF 00:20:14.044 )") 00:20:14.044 02:39:47 -- nvmf/common.sh@543 -- # cat 00:20:14.044 02:39:47 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:20:14.044 02:39:47 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:20:14.044 { 00:20:14.044 "params": { 00:20:14.044 "name": "Nvme$subsystem", 00:20:14.044 "trtype": "$TEST_TRANSPORT", 00:20:14.044 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:14.044 "adrfam": "ipv4", 00:20:14.044 "trsvcid": "$NVMF_PORT", 00:20:14.044 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:14.044 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:14.044 "hdgst": ${hdgst:-false}, 00:20:14.044 "ddgst": ${ddgst:-false} 00:20:14.044 }, 00:20:14.044 "method": "bdev_nvme_attach_controller" 00:20:14.044 } 00:20:14.044 EOF 00:20:14.044 )") 00:20:14.044 02:39:47 -- nvmf/common.sh@543 -- # cat 00:20:14.044 [2024-04-27 02:39:47.612329] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:20:14.044 [2024-04-27 02:39:47.612396] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1594899 ] 00:20:14.044 02:39:47 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:20:14.044 02:39:47 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:20:14.044 { 00:20:14.044 "params": { 00:20:14.044 "name": "Nvme$subsystem", 00:20:14.044 "trtype": "$TEST_TRANSPORT", 00:20:14.044 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:14.044 "adrfam": "ipv4", 00:20:14.044 "trsvcid": "$NVMF_PORT", 00:20:14.044 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:14.044 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:14.044 "hdgst": ${hdgst:-false}, 00:20:14.044 "ddgst": ${ddgst:-false} 00:20:14.044 }, 00:20:14.044 "method": "bdev_nvme_attach_controller" 00:20:14.044 } 00:20:14.044 EOF 00:20:14.044 )") 00:20:14.044 02:39:47 -- nvmf/common.sh@543 -- # cat 00:20:14.044 02:39:47 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:20:14.044 02:39:47 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:20:14.044 { 00:20:14.044 "params": { 00:20:14.044 "name": "Nvme$subsystem", 00:20:14.044 "trtype": "$TEST_TRANSPORT", 00:20:14.044 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:14.044 "adrfam": "ipv4", 00:20:14.044 "trsvcid": "$NVMF_PORT", 00:20:14.044 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:14.044 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:14.044 "hdgst": ${hdgst:-false}, 00:20:14.044 "ddgst": ${ddgst:-false} 00:20:14.044 }, 00:20:14.044 "method": "bdev_nvme_attach_controller" 00:20:14.044 } 00:20:14.044 EOF 00:20:14.044 )") 00:20:14.044 02:39:47 -- nvmf/common.sh@543 -- # cat 00:20:14.044 02:39:47 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:20:14.044 02:39:47 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:20:14.044 { 00:20:14.044 "params": { 00:20:14.044 "name": "Nvme$subsystem", 00:20:14.044 "trtype": "$TEST_TRANSPORT", 00:20:14.044 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:14.044 "adrfam": "ipv4", 00:20:14.044 "trsvcid": "$NVMF_PORT", 00:20:14.044 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:14.045 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:14.045 "hdgst": ${hdgst:-false}, 00:20:14.045 "ddgst": ${ddgst:-false} 00:20:14.045 }, 00:20:14.045 "method": "bdev_nvme_attach_controller" 00:20:14.045 } 00:20:14.045 EOF 00:20:14.045 )") 00:20:14.045 02:39:47 -- nvmf/common.sh@543 -- # cat 00:20:14.045 02:39:47 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:20:14.045 02:39:47 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:20:14.045 { 00:20:14.045 "params": { 00:20:14.045 "name": "Nvme$subsystem", 00:20:14.045 "trtype": "$TEST_TRANSPORT", 00:20:14.045 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:14.045 "adrfam": "ipv4", 00:20:14.045 "trsvcid": "$NVMF_PORT", 00:20:14.045 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:14.045 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:14.045 "hdgst": ${hdgst:-false}, 00:20:14.045 "ddgst": ${ddgst:-false} 00:20:14.045 }, 00:20:14.045 "method": "bdev_nvme_attach_controller" 00:20:14.045 } 00:20:14.045 EOF 00:20:14.045 )") 00:20:14.045 02:39:47 -- nvmf/common.sh@543 -- # cat 00:20:14.045 02:39:47 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:20:14.045 02:39:47 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:20:14.045 { 00:20:14.045 "params": { 00:20:14.045 "name": "Nvme$subsystem", 00:20:14.045 "trtype": "$TEST_TRANSPORT", 00:20:14.045 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:14.045 "adrfam": "ipv4", 00:20:14.045 "trsvcid": "$NVMF_PORT", 00:20:14.045 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:14.045 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:14.045 "hdgst": ${hdgst:-false}, 00:20:14.045 "ddgst": ${ddgst:-false} 00:20:14.045 }, 00:20:14.045 "method": "bdev_nvme_attach_controller" 00:20:14.045 } 00:20:14.045 EOF 00:20:14.045 )") 00:20:14.045 EAL: No free 2048 kB hugepages reported on node 1 00:20:14.045 02:39:47 -- nvmf/common.sh@543 -- # cat 00:20:14.045 02:39:47 -- nvmf/common.sh@545 -- # jq . 00:20:14.045 02:39:47 -- nvmf/common.sh@546 -- # IFS=, 00:20:14.045 02:39:47 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:20:14.045 "params": { 00:20:14.045 "name": "Nvme1", 00:20:14.045 "trtype": "rdma", 00:20:14.045 "traddr": "192.168.100.8", 00:20:14.045 "adrfam": "ipv4", 00:20:14.045 "trsvcid": "4420", 00:20:14.045 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:14.045 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:14.045 "hdgst": false, 00:20:14.045 "ddgst": false 00:20:14.045 }, 00:20:14.045 "method": "bdev_nvme_attach_controller" 00:20:14.045 },{ 00:20:14.045 "params": { 00:20:14.045 "name": "Nvme2", 00:20:14.045 "trtype": "rdma", 00:20:14.045 "traddr": "192.168.100.8", 00:20:14.045 "adrfam": "ipv4", 00:20:14.045 "trsvcid": "4420", 00:20:14.045 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:20:14.045 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:20:14.045 "hdgst": false, 00:20:14.045 "ddgst": false 00:20:14.045 }, 00:20:14.045 "method": "bdev_nvme_attach_controller" 00:20:14.045 },{ 00:20:14.045 "params": { 00:20:14.045 "name": "Nvme3", 00:20:14.045 "trtype": "rdma", 00:20:14.045 "traddr": "192.168.100.8", 00:20:14.045 "adrfam": "ipv4", 00:20:14.045 "trsvcid": "4420", 00:20:14.045 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:20:14.045 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:20:14.045 "hdgst": false, 00:20:14.045 "ddgst": false 00:20:14.045 }, 00:20:14.045 "method": "bdev_nvme_attach_controller" 00:20:14.045 },{ 00:20:14.045 "params": { 00:20:14.045 "name": "Nvme4", 00:20:14.045 "trtype": "rdma", 00:20:14.045 "traddr": "192.168.100.8", 00:20:14.045 "adrfam": "ipv4", 00:20:14.045 "trsvcid": "4420", 00:20:14.045 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:20:14.045 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:20:14.045 "hdgst": false, 00:20:14.045 "ddgst": false 00:20:14.045 }, 00:20:14.045 "method": "bdev_nvme_attach_controller" 00:20:14.045 },{ 00:20:14.045 "params": { 00:20:14.045 "name": "Nvme5", 00:20:14.045 "trtype": "rdma", 00:20:14.045 "traddr": "192.168.100.8", 00:20:14.045 "adrfam": "ipv4", 00:20:14.045 "trsvcid": "4420", 00:20:14.045 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:20:14.045 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:20:14.045 "hdgst": false, 00:20:14.045 "ddgst": false 00:20:14.045 }, 00:20:14.045 "method": "bdev_nvme_attach_controller" 00:20:14.045 },{ 00:20:14.045 "params": { 00:20:14.045 "name": "Nvme6", 00:20:14.045 "trtype": "rdma", 00:20:14.045 "traddr": "192.168.100.8", 00:20:14.045 "adrfam": "ipv4", 00:20:14.045 "trsvcid": "4420", 00:20:14.045 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:20:14.045 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:20:14.045 "hdgst": false, 00:20:14.045 "ddgst": false 00:20:14.045 }, 00:20:14.045 "method": "bdev_nvme_attach_controller" 00:20:14.045 },{ 00:20:14.045 "params": { 00:20:14.045 "name": "Nvme7", 00:20:14.045 "trtype": "rdma", 00:20:14.045 "traddr": "192.168.100.8", 00:20:14.045 "adrfam": "ipv4", 00:20:14.045 "trsvcid": "4420", 00:20:14.045 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:20:14.045 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:20:14.045 "hdgst": false, 00:20:14.045 "ddgst": false 00:20:14.045 }, 00:20:14.045 "method": "bdev_nvme_attach_controller" 00:20:14.045 },{ 00:20:14.045 "params": { 00:20:14.045 "name": "Nvme8", 00:20:14.045 "trtype": "rdma", 00:20:14.045 "traddr": "192.168.100.8", 00:20:14.045 "adrfam": "ipv4", 00:20:14.045 "trsvcid": "4420", 00:20:14.045 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:20:14.045 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:20:14.045 "hdgst": false, 00:20:14.045 "ddgst": false 00:20:14.045 }, 00:20:14.045 "method": "bdev_nvme_attach_controller" 00:20:14.045 },{ 00:20:14.045 "params": { 00:20:14.045 "name": "Nvme9", 00:20:14.045 "trtype": "rdma", 00:20:14.045 "traddr": "192.168.100.8", 00:20:14.045 "adrfam": "ipv4", 00:20:14.045 "trsvcid": "4420", 00:20:14.045 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:20:14.045 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:20:14.045 "hdgst": false, 00:20:14.045 "ddgst": false 00:20:14.045 }, 00:20:14.045 "method": "bdev_nvme_attach_controller" 00:20:14.045 },{ 00:20:14.045 "params": { 00:20:14.045 "name": "Nvme10", 00:20:14.045 "trtype": "rdma", 00:20:14.045 "traddr": "192.168.100.8", 00:20:14.045 "adrfam": "ipv4", 00:20:14.045 "trsvcid": "4420", 00:20:14.045 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:20:14.045 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:20:14.045 "hdgst": false, 00:20:14.045 "ddgst": false 00:20:14.045 }, 00:20:14.045 "method": "bdev_nvme_attach_controller" 00:20:14.045 }' 00:20:14.305 [2024-04-27 02:39:47.687819] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:14.305 [2024-04-27 02:39:47.767616] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:15.242 Running I/O for 10 seconds... 00:20:15.243 02:39:48 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:15.243 02:39:48 -- common/autotest_common.sh@850 -- # return 0 00:20:15.243 02:39:48 -- target/shutdown.sh@105 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:20:15.243 02:39:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:15.243 02:39:48 -- common/autotest_common.sh@10 -- # set +x 00:20:15.243 02:39:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:15.243 02:39:48 -- target/shutdown.sh@107 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:20:15.243 02:39:48 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:20:15.243 02:39:48 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:20:15.243 02:39:48 -- target/shutdown.sh@57 -- # local ret=1 00:20:15.243 02:39:48 -- target/shutdown.sh@58 -- # local i 00:20:15.243 02:39:48 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:20:15.243 02:39:48 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:20:15.243 02:39:48 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:20:15.243 02:39:48 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:20:15.243 02:39:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:15.243 02:39:48 -- common/autotest_common.sh@10 -- # set +x 00:20:15.502 02:39:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:15.502 02:39:48 -- target/shutdown.sh@60 -- # read_io_count=35 00:20:15.502 02:39:48 -- target/shutdown.sh@63 -- # '[' 35 -ge 100 ']' 00:20:15.502 02:39:48 -- target/shutdown.sh@67 -- # sleep 0.25 00:20:15.761 02:39:49 -- target/shutdown.sh@59 -- # (( i-- )) 00:20:15.761 02:39:49 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:20:15.761 02:39:49 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:20:15.761 02:39:49 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:20:15.761 02:39:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:15.761 02:39:49 -- common/autotest_common.sh@10 -- # set +x 00:20:16.019 02:39:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:16.019 02:39:49 -- target/shutdown.sh@60 -- # read_io_count=187 00:20:16.019 02:39:49 -- target/shutdown.sh@63 -- # '[' 187 -ge 100 ']' 00:20:16.019 02:39:49 -- target/shutdown.sh@64 -- # ret=0 00:20:16.019 02:39:49 -- target/shutdown.sh@65 -- # break 00:20:16.019 02:39:49 -- target/shutdown.sh@69 -- # return 0 00:20:16.019 02:39:49 -- target/shutdown.sh@110 -- # killprocess 1594899 00:20:16.019 02:39:49 -- common/autotest_common.sh@936 -- # '[' -z 1594899 ']' 00:20:16.019 02:39:49 -- common/autotest_common.sh@940 -- # kill -0 1594899 00:20:16.019 02:39:49 -- common/autotest_common.sh@941 -- # uname 00:20:16.019 02:39:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:16.019 02:39:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1594899 00:20:16.019 02:39:49 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:20:16.019 02:39:49 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:20:16.019 02:39:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1594899' 00:20:16.019 killing process with pid 1594899 00:20:16.019 02:39:49 -- common/autotest_common.sh@955 -- # kill 1594899 00:20:16.019 02:39:49 -- common/autotest_common.sh@960 -- # wait 1594899 00:20:16.019 Received shutdown signal, test time was about 0.871222 seconds 00:20:16.019 00:20:16.019 Latency(us) 00:20:16.019 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:16.019 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:20:16.019 Verification LBA range: start 0x0 length 0x400 00:20:16.019 Nvme1n1 : 0.86 364.01 22.75 0.00 0.00 172164.06 7921.31 249834.63 00:20:16.019 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:20:16.019 Verification LBA range: start 0x0 length 0x400 00:20:16.019 Nvme2n1 : 0.86 372.82 23.30 0.00 0.00 164997.21 8890.10 173242.99 00:20:16.019 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:20:16.019 Verification LBA range: start 0x0 length 0x400 00:20:16.019 Nvme3n1 : 0.86 372.26 23.27 0.00 0.00 162213.53 9175.04 165948.55 00:20:16.019 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:20:16.019 Verification LBA range: start 0x0 length 0x400 00:20:16.019 Nvme4n1 : 0.86 376.51 23.53 0.00 0.00 156932.42 4957.94 159565.91 00:20:16.019 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:20:16.019 Verification LBA range: start 0x0 length 0x400 00:20:16.019 Nvme5n1 : 0.86 371.25 23.20 0.00 0.00 156982.58 9744.92 152271.47 00:20:16.019 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:20:16.019 Verification LBA range: start 0x0 length 0x400 00:20:16.019 Nvme6n1 : 0.86 370.74 23.17 0.00 0.00 153622.35 10086.85 144977.03 00:20:16.019 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:20:16.019 Verification LBA range: start 0x0 length 0x400 00:20:16.019 Nvme7n1 : 0.86 370.23 23.14 0.00 0.00 150709.47 10143.83 137682.59 00:20:16.019 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:20:16.019 Verification LBA range: start 0x0 length 0x400 00:20:16.019 Nvme8n1 : 0.87 369.79 23.11 0.00 0.00 147574.61 10257.81 133123.56 00:20:16.019 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:20:16.019 Verification LBA range: start 0x0 length 0x400 00:20:16.019 Nvme9n1 : 0.87 369.19 23.07 0.00 0.00 145503.81 10713.71 122181.90 00:20:16.020 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:20:16.020 Verification LBA range: start 0x0 length 0x400 00:20:16.020 Nvme10n1 : 0.87 367.57 22.97 0.00 0.00 143091.71 3063.10 105769.41 00:20:16.020 =================================================================================================================== 00:20:16.020 Total : 3704.36 231.52 0.00 0.00 155339.10 3063.10 249834.63 00:20:16.278 02:39:49 -- target/shutdown.sh@113 -- # sleep 1 00:20:17.653 02:39:50 -- target/shutdown.sh@114 -- # kill -0 1594568 00:20:17.653 02:39:50 -- target/shutdown.sh@116 -- # stoptarget 00:20:17.653 02:39:50 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:20:17.653 02:39:50 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:20:17.653 02:39:50 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:20:17.653 02:39:50 -- target/shutdown.sh@45 -- # nvmftestfini 00:20:17.653 02:39:50 -- nvmf/common.sh@477 -- # nvmfcleanup 00:20:17.653 02:39:50 -- nvmf/common.sh@117 -- # sync 00:20:17.653 02:39:50 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:20:17.653 02:39:50 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:20:17.653 02:39:50 -- nvmf/common.sh@120 -- # set +e 00:20:17.653 02:39:50 -- nvmf/common.sh@121 -- # for i in {1..20} 00:20:17.653 02:39:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:20:17.653 rmmod nvme_rdma 00:20:17.653 rmmod nvme_fabrics 00:20:17.653 02:39:50 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:20:17.653 02:39:50 -- nvmf/common.sh@124 -- # set -e 00:20:17.653 02:39:50 -- nvmf/common.sh@125 -- # return 0 00:20:17.653 02:39:50 -- nvmf/common.sh@478 -- # '[' -n 1594568 ']' 00:20:17.653 02:39:50 -- nvmf/common.sh@479 -- # killprocess 1594568 00:20:17.653 02:39:50 -- common/autotest_common.sh@936 -- # '[' -z 1594568 ']' 00:20:17.653 02:39:50 -- common/autotest_common.sh@940 -- # kill -0 1594568 00:20:17.654 02:39:50 -- common/autotest_common.sh@941 -- # uname 00:20:17.654 02:39:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:17.654 02:39:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1594568 00:20:17.654 02:39:50 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:17.654 02:39:50 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:17.654 02:39:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1594568' 00:20:17.654 killing process with pid 1594568 00:20:17.654 02:39:50 -- common/autotest_common.sh@955 -- # kill 1594568 00:20:17.654 02:39:50 -- common/autotest_common.sh@960 -- # wait 1594568 00:20:17.654 [2024-04-27 02:39:51.068903] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:20:17.913 02:39:51 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:20:17.913 02:39:51 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:20:17.913 00:20:17.913 real 0m5.790s 00:20:17.913 user 0m23.273s 00:20:17.913 sys 0m1.210s 00:20:17.913 02:39:51 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:20:17.913 02:39:51 -- common/autotest_common.sh@10 -- # set +x 00:20:17.913 ************************************ 00:20:17.913 END TEST nvmf_shutdown_tc2 00:20:17.913 ************************************ 00:20:18.172 02:39:51 -- target/shutdown.sh@149 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:20:18.172 02:39:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:20:18.172 02:39:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:18.172 02:39:51 -- common/autotest_common.sh@10 -- # set +x 00:20:18.172 ************************************ 00:20:18.172 START TEST nvmf_shutdown_tc3 00:20:18.172 ************************************ 00:20:18.172 02:39:51 -- common/autotest_common.sh@1111 -- # nvmf_shutdown_tc3 00:20:18.172 02:39:51 -- target/shutdown.sh@121 -- # starttarget 00:20:18.172 02:39:51 -- target/shutdown.sh@15 -- # nvmftestinit 00:20:18.172 02:39:51 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:20:18.172 02:39:51 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:18.172 02:39:51 -- nvmf/common.sh@437 -- # prepare_net_devs 00:20:18.172 02:39:51 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:20:18.172 02:39:51 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:20:18.172 02:39:51 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:18.172 02:39:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:18.172 02:39:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:18.172 02:39:51 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:20:18.172 02:39:51 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:20:18.172 02:39:51 -- nvmf/common.sh@285 -- # xtrace_disable 00:20:18.172 02:39:51 -- common/autotest_common.sh@10 -- # set +x 00:20:18.173 02:39:51 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:18.173 02:39:51 -- nvmf/common.sh@291 -- # pci_devs=() 00:20:18.173 02:39:51 -- nvmf/common.sh@291 -- # local -a pci_devs 00:20:18.173 02:39:51 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:20:18.173 02:39:51 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:20:18.173 02:39:51 -- nvmf/common.sh@293 -- # pci_drivers=() 00:20:18.173 02:39:51 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:20:18.173 02:39:51 -- nvmf/common.sh@295 -- # net_devs=() 00:20:18.173 02:39:51 -- nvmf/common.sh@295 -- # local -ga net_devs 00:20:18.173 02:39:51 -- nvmf/common.sh@296 -- # e810=() 00:20:18.173 02:39:51 -- nvmf/common.sh@296 -- # local -ga e810 00:20:18.173 02:39:51 -- nvmf/common.sh@297 -- # x722=() 00:20:18.173 02:39:51 -- nvmf/common.sh@297 -- # local -ga x722 00:20:18.173 02:39:51 -- nvmf/common.sh@298 -- # mlx=() 00:20:18.173 02:39:51 -- nvmf/common.sh@298 -- # local -ga mlx 00:20:18.173 02:39:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:18.173 02:39:51 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:18.173 02:39:51 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:18.173 02:39:51 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:18.173 02:39:51 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:18.173 02:39:51 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:18.173 02:39:51 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:18.173 02:39:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:18.173 02:39:51 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:18.173 02:39:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:18.173 02:39:51 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:18.173 02:39:51 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:20:18.173 02:39:51 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:20:18.173 02:39:51 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:20:18.173 02:39:51 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:20:18.173 02:39:51 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:20:18.173 02:39:51 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:20:18.173 02:39:51 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:20:18.173 02:39:51 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:20:18.173 02:39:51 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:20:18.173 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:20:18.173 02:39:51 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:20:18.173 02:39:51 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:20:18.173 02:39:51 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:20:18.173 02:39:51 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:20:18.173 02:39:51 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:20:18.173 02:39:51 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:20:18.173 02:39:51 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:20:18.173 02:39:51 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:20:18.173 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:20:18.173 02:39:51 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:20:18.173 02:39:51 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:20:18.173 02:39:51 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:20:18.173 02:39:51 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:20:18.173 02:39:51 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:20:18.173 02:39:51 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:20:18.173 02:39:51 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:20:18.173 02:39:51 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:20:18.173 02:39:51 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:20:18.173 02:39:51 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:18.173 02:39:51 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:20:18.173 02:39:51 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:18.173 02:39:51 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:20:18.173 Found net devices under 0000:18:00.0: mlx_0_0 00:20:18.173 02:39:51 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:20:18.173 02:39:51 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:20:18.173 02:39:51 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:18.173 02:39:51 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:20:18.173 02:39:51 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:18.173 02:39:51 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:20:18.173 Found net devices under 0000:18:00.1: mlx_0_1 00:20:18.173 02:39:51 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:20:18.173 02:39:51 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:20:18.173 02:39:51 -- nvmf/common.sh@403 -- # is_hw=yes 00:20:18.173 02:39:51 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:20:18.173 02:39:51 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:20:18.173 02:39:51 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:20:18.173 02:39:51 -- nvmf/common.sh@409 -- # rdma_device_init 00:20:18.173 02:39:51 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:20:18.173 02:39:51 -- nvmf/common.sh@58 -- # uname 00:20:18.173 02:39:51 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:20:18.173 02:39:51 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:20:18.433 02:39:51 -- nvmf/common.sh@63 -- # modprobe ib_core 00:20:18.433 02:39:51 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:20:18.433 02:39:51 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:20:18.433 02:39:51 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:20:18.433 02:39:51 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:20:18.433 02:39:51 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:20:18.433 02:39:51 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:20:18.433 02:39:51 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:20:18.433 02:39:51 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:20:18.433 02:39:51 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:20:18.433 02:39:51 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:20:18.433 02:39:51 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:20:18.433 02:39:51 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:20:18.433 02:39:51 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:20:18.433 02:39:51 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:18.433 02:39:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:18.433 02:39:51 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:20:18.433 02:39:51 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:20:18.433 02:39:51 -- nvmf/common.sh@105 -- # continue 2 00:20:18.433 02:39:51 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:18.433 02:39:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:18.433 02:39:51 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:20:18.433 02:39:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:18.433 02:39:51 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:20:18.433 02:39:51 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:20:18.433 02:39:51 -- nvmf/common.sh@105 -- # continue 2 00:20:18.433 02:39:51 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:20:18.433 02:39:51 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:20:18.433 02:39:51 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:20:18.433 02:39:51 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:20:18.433 02:39:51 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:18.433 02:39:51 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:18.433 02:39:51 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:20:18.433 02:39:51 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:20:18.433 02:39:51 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:20:18.433 64: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:20:18.433 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:20:18.433 altname enp24s0f0np0 00:20:18.433 altname ens785f0np0 00:20:18.433 inet 192.168.100.8/24 scope global mlx_0_0 00:20:18.433 valid_lft forever preferred_lft forever 00:20:18.433 02:39:51 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:20:18.433 02:39:51 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:20:18.433 02:39:51 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:20:18.433 02:39:51 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:20:18.433 02:39:51 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:18.433 02:39:51 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:18.433 02:39:51 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:20:18.433 02:39:51 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:20:18.433 02:39:51 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:20:18.433 65: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:20:18.433 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:20:18.433 altname enp24s0f1np1 00:20:18.433 altname ens785f1np1 00:20:18.433 inet 192.168.100.9/24 scope global mlx_0_1 00:20:18.433 valid_lft forever preferred_lft forever 00:20:18.433 02:39:51 -- nvmf/common.sh@411 -- # return 0 00:20:18.433 02:39:51 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:20:18.433 02:39:51 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:20:18.433 02:39:51 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:20:18.433 02:39:51 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:20:18.433 02:39:51 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:20:18.433 02:39:51 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:20:18.433 02:39:51 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:20:18.433 02:39:51 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:20:18.433 02:39:51 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:20:18.433 02:39:51 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:20:18.433 02:39:51 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:18.433 02:39:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:18.433 02:39:51 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:20:18.433 02:39:51 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:20:18.433 02:39:51 -- nvmf/common.sh@105 -- # continue 2 00:20:18.433 02:39:51 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:18.433 02:39:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:18.433 02:39:51 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:20:18.433 02:39:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:18.433 02:39:51 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:20:18.433 02:39:51 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:20:18.433 02:39:51 -- nvmf/common.sh@105 -- # continue 2 00:20:18.433 02:39:51 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:20:18.433 02:39:51 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:20:18.433 02:39:51 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:20:18.433 02:39:51 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:20:18.433 02:39:51 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:18.433 02:39:51 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:18.433 02:39:51 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:20:18.433 02:39:51 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:20:18.433 02:39:51 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:20:18.433 02:39:51 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:20:18.433 02:39:51 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:18.433 02:39:51 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:18.433 02:39:51 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:20:18.433 192.168.100.9' 00:20:18.433 02:39:51 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:20:18.433 192.168.100.9' 00:20:18.433 02:39:51 -- nvmf/common.sh@446 -- # head -n 1 00:20:18.433 02:39:51 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:20:18.433 02:39:51 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:20:18.433 192.168.100.9' 00:20:18.433 02:39:51 -- nvmf/common.sh@447 -- # tail -n +2 00:20:18.433 02:39:51 -- nvmf/common.sh@447 -- # head -n 1 00:20:18.433 02:39:51 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:20:18.433 02:39:51 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:20:18.434 02:39:51 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:20:18.434 02:39:51 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:20:18.434 02:39:51 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:20:18.434 02:39:51 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:20:18.434 02:39:52 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:20:18.434 02:39:52 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:20:18.434 02:39:52 -- common/autotest_common.sh@710 -- # xtrace_disable 00:20:18.434 02:39:52 -- common/autotest_common.sh@10 -- # set +x 00:20:18.434 02:39:52 -- nvmf/common.sh@470 -- # nvmfpid=1595571 00:20:18.434 02:39:52 -- nvmf/common.sh@471 -- # waitforlisten 1595571 00:20:18.434 02:39:52 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:20:18.434 02:39:52 -- common/autotest_common.sh@817 -- # '[' -z 1595571 ']' 00:20:18.434 02:39:52 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:18.434 02:39:52 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:18.434 02:39:52 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:18.434 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:18.434 02:39:52 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:18.434 02:39:52 -- common/autotest_common.sh@10 -- # set +x 00:20:18.693 [2024-04-27 02:39:52.076484] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:20:18.693 [2024-04-27 02:39:52.076544] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:18.693 EAL: No free 2048 kB hugepages reported on node 1 00:20:18.693 [2024-04-27 02:39:52.150548] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:20:18.693 [2024-04-27 02:39:52.235868] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:18.693 [2024-04-27 02:39:52.235911] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:18.693 [2024-04-27 02:39:52.235921] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:20:18.693 [2024-04-27 02:39:52.235929] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:20:18.693 [2024-04-27 02:39:52.235937] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:18.693 [2024-04-27 02:39:52.236036] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:18.693 [2024-04-27 02:39:52.236057] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:18.693 [2024-04-27 02:39:52.236147] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:18.693 [2024-04-27 02:39:52.236149] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:20:19.631 02:39:52 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:19.631 02:39:52 -- common/autotest_common.sh@850 -- # return 0 00:20:19.631 02:39:52 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:20:19.631 02:39:52 -- common/autotest_common.sh@716 -- # xtrace_disable 00:20:19.631 02:39:52 -- common/autotest_common.sh@10 -- # set +x 00:20:19.631 02:39:52 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:19.631 02:39:52 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:20:19.631 02:39:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:19.631 02:39:52 -- common/autotest_common.sh@10 -- # set +x 00:20:19.631 [2024-04-27 02:39:52.973039] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xd6c7c0/0xd70cb0) succeed. 00:20:19.631 [2024-04-27 02:39:52.983552] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xd6de00/0xdb2340) succeed. 00:20:19.631 02:39:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:19.631 02:39:53 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:20:19.631 02:39:53 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:20:19.631 02:39:53 -- common/autotest_common.sh@710 -- # xtrace_disable 00:20:19.631 02:39:53 -- common/autotest_common.sh@10 -- # set +x 00:20:19.631 02:39:53 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:20:19.631 02:39:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:20:19.631 02:39:53 -- target/shutdown.sh@28 -- # cat 00:20:19.631 02:39:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:20:19.631 02:39:53 -- target/shutdown.sh@28 -- # cat 00:20:19.631 02:39:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:20:19.631 02:39:53 -- target/shutdown.sh@28 -- # cat 00:20:19.631 02:39:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:20:19.631 02:39:53 -- target/shutdown.sh@28 -- # cat 00:20:19.631 02:39:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:20:19.631 02:39:53 -- target/shutdown.sh@28 -- # cat 00:20:19.631 02:39:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:20:19.631 02:39:53 -- target/shutdown.sh@28 -- # cat 00:20:19.631 02:39:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:20:19.631 02:39:53 -- target/shutdown.sh@28 -- # cat 00:20:19.631 02:39:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:20:19.631 02:39:53 -- target/shutdown.sh@28 -- # cat 00:20:19.631 02:39:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:20:19.631 02:39:53 -- target/shutdown.sh@28 -- # cat 00:20:19.631 02:39:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:20:19.631 02:39:53 -- target/shutdown.sh@28 -- # cat 00:20:19.631 02:39:53 -- target/shutdown.sh@35 -- # rpc_cmd 00:20:19.631 02:39:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:19.631 02:39:53 -- common/autotest_common.sh@10 -- # set +x 00:20:19.631 Malloc1 00:20:19.631 [2024-04-27 02:39:53.223269] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:20:19.631 Malloc2 00:20:19.890 Malloc3 00:20:19.890 Malloc4 00:20:19.890 Malloc5 00:20:19.890 Malloc6 00:20:19.890 Malloc7 00:20:20.150 Malloc8 00:20:20.150 Malloc9 00:20:20.150 Malloc10 00:20:20.150 02:39:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:20.150 02:39:53 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:20:20.150 02:39:53 -- common/autotest_common.sh@716 -- # xtrace_disable 00:20:20.150 02:39:53 -- common/autotest_common.sh@10 -- # set +x 00:20:20.150 02:39:53 -- target/shutdown.sh@125 -- # perfpid=1595811 00:20:20.150 02:39:53 -- target/shutdown.sh@126 -- # waitforlisten 1595811 /var/tmp/bdevperf.sock 00:20:20.150 02:39:53 -- common/autotest_common.sh@817 -- # '[' -z 1595811 ']' 00:20:20.151 02:39:53 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:20.151 02:39:53 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:20.151 02:39:53 -- target/shutdown.sh@124 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:20:20.151 02:39:53 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:20.151 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:20.151 02:39:53 -- target/shutdown.sh@124 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:20:20.151 02:39:53 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:20.151 02:39:53 -- common/autotest_common.sh@10 -- # set +x 00:20:20.151 02:39:53 -- nvmf/common.sh@521 -- # config=() 00:20:20.151 02:39:53 -- nvmf/common.sh@521 -- # local subsystem config 00:20:20.151 02:39:53 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:20:20.151 02:39:53 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:20:20.151 { 00:20:20.151 "params": { 00:20:20.151 "name": "Nvme$subsystem", 00:20:20.151 "trtype": "$TEST_TRANSPORT", 00:20:20.151 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:20.151 "adrfam": "ipv4", 00:20:20.151 "trsvcid": "$NVMF_PORT", 00:20:20.151 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:20.151 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:20.151 "hdgst": ${hdgst:-false}, 00:20:20.151 "ddgst": ${ddgst:-false} 00:20:20.151 }, 00:20:20.151 "method": "bdev_nvme_attach_controller" 00:20:20.151 } 00:20:20.151 EOF 00:20:20.151 )") 00:20:20.151 02:39:53 -- nvmf/common.sh@543 -- # cat 00:20:20.151 02:39:53 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:20:20.151 02:39:53 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:20:20.151 { 00:20:20.151 "params": { 00:20:20.151 "name": "Nvme$subsystem", 00:20:20.151 "trtype": "$TEST_TRANSPORT", 00:20:20.151 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:20.151 "adrfam": "ipv4", 00:20:20.151 "trsvcid": "$NVMF_PORT", 00:20:20.151 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:20.151 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:20.151 "hdgst": ${hdgst:-false}, 00:20:20.151 "ddgst": ${ddgst:-false} 00:20:20.151 }, 00:20:20.151 "method": "bdev_nvme_attach_controller" 00:20:20.151 } 00:20:20.151 EOF 00:20:20.151 )") 00:20:20.151 02:39:53 -- nvmf/common.sh@543 -- # cat 00:20:20.151 02:39:53 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:20:20.151 02:39:53 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:20:20.151 { 00:20:20.151 "params": { 00:20:20.151 "name": "Nvme$subsystem", 00:20:20.151 "trtype": "$TEST_TRANSPORT", 00:20:20.151 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:20.151 "adrfam": "ipv4", 00:20:20.151 "trsvcid": "$NVMF_PORT", 00:20:20.151 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:20.151 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:20.151 "hdgst": ${hdgst:-false}, 00:20:20.151 "ddgst": ${ddgst:-false} 00:20:20.151 }, 00:20:20.151 "method": "bdev_nvme_attach_controller" 00:20:20.151 } 00:20:20.151 EOF 00:20:20.151 )") 00:20:20.151 02:39:53 -- nvmf/common.sh@543 -- # cat 00:20:20.151 02:39:53 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:20:20.151 02:39:53 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:20:20.151 { 00:20:20.151 "params": { 00:20:20.151 "name": "Nvme$subsystem", 00:20:20.151 "trtype": "$TEST_TRANSPORT", 00:20:20.151 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:20.151 "adrfam": "ipv4", 00:20:20.151 "trsvcid": "$NVMF_PORT", 00:20:20.151 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:20.151 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:20.151 "hdgst": ${hdgst:-false}, 00:20:20.151 "ddgst": ${ddgst:-false} 00:20:20.151 }, 00:20:20.151 "method": "bdev_nvme_attach_controller" 00:20:20.151 } 00:20:20.151 EOF 00:20:20.151 )") 00:20:20.151 02:39:53 -- nvmf/common.sh@543 -- # cat 00:20:20.151 02:39:53 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:20:20.151 02:39:53 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:20:20.151 { 00:20:20.151 "params": { 00:20:20.151 "name": "Nvme$subsystem", 00:20:20.151 "trtype": "$TEST_TRANSPORT", 00:20:20.151 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:20.151 "adrfam": "ipv4", 00:20:20.151 "trsvcid": "$NVMF_PORT", 00:20:20.151 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:20.151 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:20.151 "hdgst": ${hdgst:-false}, 00:20:20.151 "ddgst": ${ddgst:-false} 00:20:20.151 }, 00:20:20.151 "method": "bdev_nvme_attach_controller" 00:20:20.151 } 00:20:20.151 EOF 00:20:20.151 )") 00:20:20.151 02:39:53 -- nvmf/common.sh@543 -- # cat 00:20:20.151 [2024-04-27 02:39:53.726258] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:20:20.151 [2024-04-27 02:39:53.726317] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1595811 ] 00:20:20.151 02:39:53 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:20:20.151 02:39:53 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:20:20.151 { 00:20:20.151 "params": { 00:20:20.151 "name": "Nvme$subsystem", 00:20:20.151 "trtype": "$TEST_TRANSPORT", 00:20:20.151 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:20.151 "adrfam": "ipv4", 00:20:20.151 "trsvcid": "$NVMF_PORT", 00:20:20.151 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:20.151 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:20.151 "hdgst": ${hdgst:-false}, 00:20:20.151 "ddgst": ${ddgst:-false} 00:20:20.151 }, 00:20:20.151 "method": "bdev_nvme_attach_controller" 00:20:20.151 } 00:20:20.151 EOF 00:20:20.151 )") 00:20:20.151 02:39:53 -- nvmf/common.sh@543 -- # cat 00:20:20.151 02:39:53 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:20:20.151 02:39:53 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:20:20.151 { 00:20:20.151 "params": { 00:20:20.151 "name": "Nvme$subsystem", 00:20:20.151 "trtype": "$TEST_TRANSPORT", 00:20:20.151 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:20.151 "adrfam": "ipv4", 00:20:20.151 "trsvcid": "$NVMF_PORT", 00:20:20.151 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:20.151 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:20.151 "hdgst": ${hdgst:-false}, 00:20:20.151 "ddgst": ${ddgst:-false} 00:20:20.151 }, 00:20:20.151 "method": "bdev_nvme_attach_controller" 00:20:20.151 } 00:20:20.151 EOF 00:20:20.151 )") 00:20:20.151 02:39:53 -- nvmf/common.sh@543 -- # cat 00:20:20.151 02:39:53 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:20:20.151 02:39:53 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:20:20.151 { 00:20:20.151 "params": { 00:20:20.151 "name": "Nvme$subsystem", 00:20:20.151 "trtype": "$TEST_TRANSPORT", 00:20:20.151 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:20.151 "adrfam": "ipv4", 00:20:20.151 "trsvcid": "$NVMF_PORT", 00:20:20.151 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:20.151 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:20.151 "hdgst": ${hdgst:-false}, 00:20:20.151 "ddgst": ${ddgst:-false} 00:20:20.151 }, 00:20:20.151 "method": "bdev_nvme_attach_controller" 00:20:20.151 } 00:20:20.151 EOF 00:20:20.151 )") 00:20:20.151 02:39:53 -- nvmf/common.sh@543 -- # cat 00:20:20.151 02:39:53 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:20:20.151 02:39:53 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:20:20.151 { 00:20:20.151 "params": { 00:20:20.151 "name": "Nvme$subsystem", 00:20:20.151 "trtype": "$TEST_TRANSPORT", 00:20:20.151 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:20.151 "adrfam": "ipv4", 00:20:20.151 "trsvcid": "$NVMF_PORT", 00:20:20.151 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:20.151 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:20.151 "hdgst": ${hdgst:-false}, 00:20:20.151 "ddgst": ${ddgst:-false} 00:20:20.151 }, 00:20:20.151 "method": "bdev_nvme_attach_controller" 00:20:20.151 } 00:20:20.151 EOF 00:20:20.151 )") 00:20:20.151 02:39:53 -- nvmf/common.sh@543 -- # cat 00:20:20.151 02:39:53 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:20:20.151 02:39:53 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:20:20.151 { 00:20:20.151 "params": { 00:20:20.151 "name": "Nvme$subsystem", 00:20:20.151 "trtype": "$TEST_TRANSPORT", 00:20:20.151 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:20.151 "adrfam": "ipv4", 00:20:20.151 "trsvcid": "$NVMF_PORT", 00:20:20.151 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:20.151 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:20.151 "hdgst": ${hdgst:-false}, 00:20:20.151 "ddgst": ${ddgst:-false} 00:20:20.151 }, 00:20:20.151 "method": "bdev_nvme_attach_controller" 00:20:20.151 } 00:20:20.151 EOF 00:20:20.151 )") 00:20:20.151 EAL: No free 2048 kB hugepages reported on node 1 00:20:20.151 02:39:53 -- nvmf/common.sh@543 -- # cat 00:20:20.151 02:39:53 -- nvmf/common.sh@545 -- # jq . 00:20:20.151 02:39:53 -- nvmf/common.sh@546 -- # IFS=, 00:20:20.151 02:39:53 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:20:20.151 "params": { 00:20:20.151 "name": "Nvme1", 00:20:20.151 "trtype": "rdma", 00:20:20.151 "traddr": "192.168.100.8", 00:20:20.151 "adrfam": "ipv4", 00:20:20.151 "trsvcid": "4420", 00:20:20.151 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:20.151 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:20.151 "hdgst": false, 00:20:20.151 "ddgst": false 00:20:20.151 }, 00:20:20.151 "method": "bdev_nvme_attach_controller" 00:20:20.151 },{ 00:20:20.151 "params": { 00:20:20.151 "name": "Nvme2", 00:20:20.151 "trtype": "rdma", 00:20:20.151 "traddr": "192.168.100.8", 00:20:20.151 "adrfam": "ipv4", 00:20:20.151 "trsvcid": "4420", 00:20:20.151 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:20:20.152 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:20:20.152 "hdgst": false, 00:20:20.152 "ddgst": false 00:20:20.152 }, 00:20:20.152 "method": "bdev_nvme_attach_controller" 00:20:20.152 },{ 00:20:20.152 "params": { 00:20:20.152 "name": "Nvme3", 00:20:20.152 "trtype": "rdma", 00:20:20.152 "traddr": "192.168.100.8", 00:20:20.152 "adrfam": "ipv4", 00:20:20.152 "trsvcid": "4420", 00:20:20.152 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:20:20.152 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:20:20.152 "hdgst": false, 00:20:20.152 "ddgst": false 00:20:20.152 }, 00:20:20.152 "method": "bdev_nvme_attach_controller" 00:20:20.152 },{ 00:20:20.152 "params": { 00:20:20.152 "name": "Nvme4", 00:20:20.152 "trtype": "rdma", 00:20:20.152 "traddr": "192.168.100.8", 00:20:20.152 "adrfam": "ipv4", 00:20:20.152 "trsvcid": "4420", 00:20:20.152 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:20:20.152 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:20:20.152 "hdgst": false, 00:20:20.152 "ddgst": false 00:20:20.152 }, 00:20:20.152 "method": "bdev_nvme_attach_controller" 00:20:20.152 },{ 00:20:20.152 "params": { 00:20:20.152 "name": "Nvme5", 00:20:20.152 "trtype": "rdma", 00:20:20.152 "traddr": "192.168.100.8", 00:20:20.152 "adrfam": "ipv4", 00:20:20.152 "trsvcid": "4420", 00:20:20.152 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:20:20.152 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:20:20.152 "hdgst": false, 00:20:20.152 "ddgst": false 00:20:20.152 }, 00:20:20.152 "method": "bdev_nvme_attach_controller" 00:20:20.152 },{ 00:20:20.152 "params": { 00:20:20.152 "name": "Nvme6", 00:20:20.152 "trtype": "rdma", 00:20:20.152 "traddr": "192.168.100.8", 00:20:20.152 "adrfam": "ipv4", 00:20:20.152 "trsvcid": "4420", 00:20:20.152 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:20:20.152 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:20:20.152 "hdgst": false, 00:20:20.152 "ddgst": false 00:20:20.152 }, 00:20:20.152 "method": "bdev_nvme_attach_controller" 00:20:20.152 },{ 00:20:20.152 "params": { 00:20:20.152 "name": "Nvme7", 00:20:20.152 "trtype": "rdma", 00:20:20.152 "traddr": "192.168.100.8", 00:20:20.152 "adrfam": "ipv4", 00:20:20.152 "trsvcid": "4420", 00:20:20.152 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:20:20.152 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:20:20.152 "hdgst": false, 00:20:20.152 "ddgst": false 00:20:20.152 }, 00:20:20.152 "method": "bdev_nvme_attach_controller" 00:20:20.152 },{ 00:20:20.152 "params": { 00:20:20.152 "name": "Nvme8", 00:20:20.152 "trtype": "rdma", 00:20:20.152 "traddr": "192.168.100.8", 00:20:20.152 "adrfam": "ipv4", 00:20:20.152 "trsvcid": "4420", 00:20:20.152 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:20:20.152 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:20:20.152 "hdgst": false, 00:20:20.152 "ddgst": false 00:20:20.152 }, 00:20:20.152 "method": "bdev_nvme_attach_controller" 00:20:20.152 },{ 00:20:20.152 "params": { 00:20:20.152 "name": "Nvme9", 00:20:20.152 "trtype": "rdma", 00:20:20.152 "traddr": "192.168.100.8", 00:20:20.152 "adrfam": "ipv4", 00:20:20.152 "trsvcid": "4420", 00:20:20.152 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:20:20.152 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:20:20.152 "hdgst": false, 00:20:20.152 "ddgst": false 00:20:20.152 }, 00:20:20.152 "method": "bdev_nvme_attach_controller" 00:20:20.152 },{ 00:20:20.152 "params": { 00:20:20.152 "name": "Nvme10", 00:20:20.152 "trtype": "rdma", 00:20:20.152 "traddr": "192.168.100.8", 00:20:20.152 "adrfam": "ipv4", 00:20:20.152 "trsvcid": "4420", 00:20:20.152 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:20:20.152 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:20:20.152 "hdgst": false, 00:20:20.152 "ddgst": false 00:20:20.152 }, 00:20:20.152 "method": "bdev_nvme_attach_controller" 00:20:20.152 }' 00:20:20.411 [2024-04-27 02:39:53.801986] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:20.411 [2024-04-27 02:39:53.881713] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:21.346 Running I/O for 10 seconds... 00:20:21.346 02:39:54 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:21.346 02:39:54 -- common/autotest_common.sh@850 -- # return 0 00:20:21.346 02:39:54 -- target/shutdown.sh@127 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:20:21.346 02:39:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:21.346 02:39:54 -- common/autotest_common.sh@10 -- # set +x 00:20:21.346 02:39:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:21.346 02:39:54 -- target/shutdown.sh@130 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:21.346 02:39:54 -- target/shutdown.sh@132 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:20:21.346 02:39:54 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:20:21.346 02:39:54 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:20:21.346 02:39:54 -- target/shutdown.sh@57 -- # local ret=1 00:20:21.346 02:39:54 -- target/shutdown.sh@58 -- # local i 00:20:21.346 02:39:54 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:20:21.346 02:39:54 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:20:21.346 02:39:54 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:20:21.346 02:39:54 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:20:21.346 02:39:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:21.346 02:39:54 -- common/autotest_common.sh@10 -- # set +x 00:20:21.605 02:39:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:21.605 02:39:55 -- target/shutdown.sh@60 -- # read_io_count=34 00:20:21.605 02:39:55 -- target/shutdown.sh@63 -- # '[' 34 -ge 100 ']' 00:20:21.605 02:39:55 -- target/shutdown.sh@67 -- # sleep 0.25 00:20:21.862 02:39:55 -- target/shutdown.sh@59 -- # (( i-- )) 00:20:21.862 02:39:55 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:20:21.862 02:39:55 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:20:21.862 02:39:55 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:20:21.862 02:39:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:21.862 02:39:55 -- common/autotest_common.sh@10 -- # set +x 00:20:21.862 02:39:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:21.862 02:39:55 -- target/shutdown.sh@60 -- # read_io_count=188 00:20:21.862 02:39:55 -- target/shutdown.sh@63 -- # '[' 188 -ge 100 ']' 00:20:21.862 02:39:55 -- target/shutdown.sh@64 -- # ret=0 00:20:21.862 02:39:55 -- target/shutdown.sh@65 -- # break 00:20:21.862 02:39:55 -- target/shutdown.sh@69 -- # return 0 00:20:21.862 02:39:55 -- target/shutdown.sh@135 -- # killprocess 1595571 00:20:21.862 02:39:55 -- common/autotest_common.sh@936 -- # '[' -z 1595571 ']' 00:20:21.862 02:39:55 -- common/autotest_common.sh@940 -- # kill -0 1595571 00:20:21.862 02:39:55 -- common/autotest_common.sh@941 -- # uname 00:20:22.120 02:39:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:22.120 02:39:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1595571 00:20:22.120 02:39:55 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:22.120 02:39:55 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:22.120 02:39:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1595571' 00:20:22.120 killing process with pid 1595571 00:20:22.120 02:39:55 -- common/autotest_common.sh@955 -- # kill 1595571 00:20:22.120 02:39:55 -- common/autotest_common.sh@960 -- # wait 1595571 00:20:22.120 [2024-04-27 02:39:55.646805] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:20:22.685 02:39:56 -- target/shutdown.sh@136 -- # nvmfpid= 00:20:22.685 02:39:56 -- target/shutdown.sh@139 -- # sleep 1 00:20:23.254 [2024-04-27 02:39:56.580140] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256f00 was disconnected and freed. reset controller. 00:20:23.254 [2024-04-27 02:39:56.582621] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256cc0 was disconnected and freed. reset controller. 00:20:23.254 [2024-04-27 02:39:56.584777] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256a80 was disconnected and freed. reset controller. 00:20:23.254 [2024-04-27 02:39:56.587080] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256840 was disconnected and freed. reset controller. 00:20:23.254 [2024-04-27 02:39:56.589191] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256600 was disconnected and freed. reset controller. 00:20:23.254 [2024-04-27 02:39:56.591838] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192563c0 was disconnected and freed. reset controller. 00:20:23.254 [2024-04-27 02:39:56.593900] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256180 was disconnected and freed. reset controller. 00:20:23.254 [2024-04-27 02:39:56.596111] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x20001b806c00 was disconnected and freed. reset controller. 00:20:23.254 [2024-04-27 02:39:56.596204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:34816 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b0ef800 len:0x10000 key:0x183400 00:20:23.254 [2024-04-27 02:39:56.596247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.254 [2024-04-27 02:39:56.596296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:34944 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b0df780 len:0x10000 key:0x183400 00:20:23.254 [2024-04-27 02:39:56.596329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.254 [2024-04-27 02:39:56.596383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:35072 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b0cf700 len:0x10000 key:0x183400 00:20:23.254 [2024-04-27 02:39:56.596416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.254 [2024-04-27 02:39:56.596456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:35200 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b0bf680 len:0x10000 key:0x183400 00:20:23.255 [2024-04-27 02:39:56.596487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.255 [2024-04-27 02:39:56.596528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:35328 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b0af600 len:0x10000 key:0x183400 00:20:23.255 [2024-04-27 02:39:56.596558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.255 [2024-04-27 02:39:56.596576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:35456 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b09f580 len:0x10000 key:0x183400 00:20:23.255 [2024-04-27 02:39:56.596591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.255 [2024-04-27 02:39:56.596608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:35584 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b08f500 len:0x10000 key:0x183400 00:20:23.255 [2024-04-27 02:39:56.596628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.255 [2024-04-27 02:39:56.596647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:35712 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b07f480 len:0x10000 key:0x183400 00:20:23.255 [2024-04-27 02:39:56.596661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.255 [2024-04-27 02:39:56.596679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:35840 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b06f400 len:0x10000 key:0x183400 00:20:23.255 [2024-04-27 02:39:56.596694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.255 [2024-04-27 02:39:56.596712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:35968 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b05f380 len:0x10000 key:0x183400 00:20:23.255 [2024-04-27 02:39:56.596725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.255 [2024-04-27 02:39:56.596742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:36096 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b04f300 len:0x10000 key:0x183400 00:20:23.255 [2024-04-27 02:39:56.596758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.255 [2024-04-27 02:39:56.596775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:36224 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b03f280 len:0x10000 key:0x183400 00:20:23.255 [2024-04-27 02:39:56.596789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.255 [2024-04-27 02:39:56.596806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:36352 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b02f200 len:0x10000 key:0x183400 00:20:23.255 [2024-04-27 02:39:56.596821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.255 [2024-04-27 02:39:56.596838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:36480 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b01f180 len:0x10000 key:0x183400 00:20:23.255 [2024-04-27 02:39:56.596852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.255 [2024-04-27 02:39:56.596869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:36608 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b00f100 len:0x10000 key:0x183400 00:20:23.255 [2024-04-27 02:39:56.596884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.255 [2024-04-27 02:39:56.596901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:36736 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b3f0000 len:0x10000 key:0x183600 00:20:23.255 [2024-04-27 02:39:56.596915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.255 [2024-04-27 02:39:56.596932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:36864 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b3dff80 len:0x10000 key:0x183600 00:20:23.255 [2024-04-27 02:39:56.596947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.255 [2024-04-27 02:39:56.596965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:36992 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b3cff00 len:0x10000 key:0x183600 00:20:23.255 [2024-04-27 02:39:56.596980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.255 [2024-04-27 02:39:56.596998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:37120 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b3bfe80 len:0x10000 key:0x183600 00:20:23.255 [2024-04-27 02:39:56.597013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.255 [2024-04-27 02:39:56.597030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:37248 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b3afe00 len:0x10000 key:0x183600 00:20:23.255 [2024-04-27 02:39:56.597044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.255 [2024-04-27 02:39:56.597062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:37376 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b39fd80 len:0x10000 key:0x183600 00:20:23.255 [2024-04-27 02:39:56.597077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.255 [2024-04-27 02:39:56.597094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:37504 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b38fd00 len:0x10000 key:0x183600 00:20:23.255 [2024-04-27 02:39:56.597107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.255 [2024-04-27 02:39:56.597125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:37632 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b37fc80 len:0x10000 key:0x183600 00:20:23.255 [2024-04-27 02:39:56.597139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.255 [2024-04-27 02:39:56.597157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:37760 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b36fc00 len:0x10000 key:0x183600 00:20:23.255 [2024-04-27 02:39:56.597170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.255 [2024-04-27 02:39:56.597188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:37888 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b35fb80 len:0x10000 key:0x183600 00:20:23.255 [2024-04-27 02:39:56.597202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.255 [2024-04-27 02:39:56.597219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:38016 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b34fb00 len:0x10000 key:0x183600 00:20:23.255 [2024-04-27 02:39:56.597233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.255 [2024-04-27 02:39:56.597251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:38144 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b33fa80 len:0x10000 key:0x183600 00:20:23.255 [2024-04-27 02:39:56.597265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.255 [2024-04-27 02:39:56.597282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:38272 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b32fa00 len:0x10000 key:0x183600 00:20:23.255 [2024-04-27 02:39:56.597295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.255 [2024-04-27 02:39:56.597314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:38400 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b31f980 len:0x10000 key:0x183600 00:20:23.255 [2024-04-27 02:39:56.597328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.255 [2024-04-27 02:39:56.597352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:38528 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b30f900 len:0x10000 key:0x183600 00:20:23.255 [2024-04-27 02:39:56.597366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.255 [2024-04-27 02:39:56.597384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:38656 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2ff880 len:0x10000 key:0x183600 00:20:23.255 [2024-04-27 02:39:56.597398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.255 [2024-04-27 02:39:56.597416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:38784 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2ef800 len:0x10000 key:0x183600 00:20:23.255 [2024-04-27 02:39:56.597429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.255 [2024-04-27 02:39:56.597447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:38912 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2df780 len:0x10000 key:0x183600 00:20:23.255 [2024-04-27 02:39:56.597461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.255 [2024-04-27 02:39:56.597479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:39040 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2cf700 len:0x10000 key:0x183600 00:20:23.255 [2024-04-27 02:39:56.597492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.255 [2024-04-27 02:39:56.597510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:39168 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2bf680 len:0x10000 key:0x183600 00:20:23.255 [2024-04-27 02:39:56.597525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.255 [2024-04-27 02:39:56.597542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:39296 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2af600 len:0x10000 key:0x183600 00:20:23.255 [2024-04-27 02:39:56.597557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.255 [2024-04-27 02:39:56.597575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:39424 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b29f580 len:0x10000 key:0x183600 00:20:23.255 [2024-04-27 02:39:56.597590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.255 [2024-04-27 02:39:56.597608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:39552 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b28f500 len:0x10000 key:0x183600 00:20:23.255 [2024-04-27 02:39:56.597623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.255 [2024-04-27 02:39:56.597640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:39680 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b27f480 len:0x10000 key:0x183600 00:20:23.255 [2024-04-27 02:39:56.597654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.256 [2024-04-27 02:39:56.597671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:39808 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b26f400 len:0x10000 key:0x183600 00:20:23.256 [2024-04-27 02:39:56.597685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.256 [2024-04-27 02:39:56.597704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:39936 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b25f380 len:0x10000 key:0x183600 00:20:23.256 [2024-04-27 02:39:56.597718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.256 [2024-04-27 02:39:56.597736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:40064 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b24f300 len:0x10000 key:0x183600 00:20:23.256 [2024-04-27 02:39:56.597750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.256 [2024-04-27 02:39:56.597768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:40192 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b23f280 len:0x10000 key:0x183600 00:20:23.256 [2024-04-27 02:39:56.597782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.256 [2024-04-27 02:39:56.597799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:40320 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b22f200 len:0x10000 key:0x183600 00:20:23.256 [2024-04-27 02:39:56.597814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.256 [2024-04-27 02:39:56.597833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:40448 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b21f180 len:0x10000 key:0x183600 00:20:23.256 [2024-04-27 02:39:56.597847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.256 [2024-04-27 02:39:56.597865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:40576 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b20f100 len:0x10000 key:0x183600 00:20:23.256 [2024-04-27 02:39:56.597879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.256 [2024-04-27 02:39:56.597896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:40704 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b5f0000 len:0x10000 key:0x183f00 00:20:23.256 [2024-04-27 02:39:56.597909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.256 [2024-04-27 02:39:56.597927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:40832 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ae0f700 len:0x10000 key:0x183100 00:20:23.256 [2024-04-27 02:39:56.597941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.256 [2024-04-27 02:39:56.600483] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x20001b8069c0 was disconnected and freed. reset controller. 00:20:23.256 [2024-04-27 02:39:56.601067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:24576 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b4cfd00 len:0x10000 key:0x183f00 00:20:23.256 [2024-04-27 02:39:56.601104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.256 [2024-04-27 02:39:56.601147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:24704 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b4bfc80 len:0x10000 key:0x183f00 00:20:23.256 [2024-04-27 02:39:56.601179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.256 [2024-04-27 02:39:56.601217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:24832 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b4afc00 len:0x10000 key:0x183f00 00:20:23.256 [2024-04-27 02:39:56.601256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.256 [2024-04-27 02:39:56.601294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:24960 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b49fb80 len:0x10000 key:0x183f00 00:20:23.256 [2024-04-27 02:39:56.601325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.256 [2024-04-27 02:39:56.601376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:25088 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b48fb00 len:0x10000 key:0x183f00 00:20:23.256 [2024-04-27 02:39:56.601409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.256 [2024-04-27 02:39:56.601446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:25216 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b47fa80 len:0x10000 key:0x183f00 00:20:23.256 [2024-04-27 02:39:56.601481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.256 [2024-04-27 02:39:56.601498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25344 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b46fa00 len:0x10000 key:0x183f00 00:20:23.256 [2024-04-27 02:39:56.601514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.256 [2024-04-27 02:39:56.601531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:25472 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b45f980 len:0x10000 key:0x183f00 00:20:23.256 [2024-04-27 02:39:56.601545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.256 [2024-04-27 02:39:56.601562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:25600 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b44f900 len:0x10000 key:0x183f00 00:20:23.256 [2024-04-27 02:39:56.601576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.256 [2024-04-27 02:39:56.601593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:25728 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b43f880 len:0x10000 key:0x183f00 00:20:23.256 [2024-04-27 02:39:56.601607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.256 [2024-04-27 02:39:56.601624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:25856 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b42f800 len:0x10000 key:0x183f00 00:20:23.256 [2024-04-27 02:39:56.601638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.256 [2024-04-27 02:39:56.601654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:25984 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b41f780 len:0x10000 key:0x183f00 00:20:23.256 [2024-04-27 02:39:56.601667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.256 [2024-04-27 02:39:56.601683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:26112 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b40f700 len:0x10000 key:0x183f00 00:20:23.256 [2024-04-27 02:39:56.601698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.256 [2024-04-27 02:39:56.601714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:26240 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b7f0000 len:0x10000 key:0x184100 00:20:23.256 [2024-04-27 02:39:56.601730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.256 [2024-04-27 02:39:56.601747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:26368 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b7dff80 len:0x10000 key:0x184100 00:20:23.256 [2024-04-27 02:39:56.601761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.256 [2024-04-27 02:39:56.601777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:26496 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b7cff00 len:0x10000 key:0x184100 00:20:23.256 [2024-04-27 02:39:56.601791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.256 [2024-04-27 02:39:56.601807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:26624 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b7bfe80 len:0x10000 key:0x184100 00:20:23.256 [2024-04-27 02:39:56.601821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.256 [2024-04-27 02:39:56.601838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:26752 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b7afe00 len:0x10000 key:0x184100 00:20:23.256 [2024-04-27 02:39:56.601851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.256 [2024-04-27 02:39:56.601867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:26880 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b79fd80 len:0x10000 key:0x184100 00:20:23.256 [2024-04-27 02:39:56.601882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.256 [2024-04-27 02:39:56.601898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:27008 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b78fd00 len:0x10000 key:0x184100 00:20:23.256 [2024-04-27 02:39:56.601912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.256 [2024-04-27 02:39:56.601928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:27136 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b77fc80 len:0x10000 key:0x184100 00:20:23.256 [2024-04-27 02:39:56.601942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.256 [2024-04-27 02:39:56.601959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:27264 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b76fc00 len:0x10000 key:0x184100 00:20:23.256 [2024-04-27 02:39:56.601972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.256 [2024-04-27 02:39:56.601988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:27392 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b75fb80 len:0x10000 key:0x184100 00:20:23.256 [2024-04-27 02:39:56.602003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.256 [2024-04-27 02:39:56.602019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:27520 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b74fb00 len:0x10000 key:0x184100 00:20:23.256 [2024-04-27 02:39:56.602033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.256 [2024-04-27 02:39:56.602050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:27648 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b73fa80 len:0x10000 key:0x184100 00:20:23.256 [2024-04-27 02:39:56.602065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.256 [2024-04-27 02:39:56.602083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:27776 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b72fa00 len:0x10000 key:0x184100 00:20:23.256 [2024-04-27 02:39:56.602096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.257 [2024-04-27 02:39:56.602113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:27904 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b71f980 len:0x10000 key:0x184100 00:20:23.257 [2024-04-27 02:39:56.602127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.257 [2024-04-27 02:39:56.602144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:28032 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b70f900 len:0x10000 key:0x184100 00:20:23.257 [2024-04-27 02:39:56.602157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.257 [2024-04-27 02:39:56.602174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:28160 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6ff880 len:0x10000 key:0x184100 00:20:23.257 [2024-04-27 02:39:56.602189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.257 [2024-04-27 02:39:56.602205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:28288 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6ef800 len:0x10000 key:0x184100 00:20:23.257 [2024-04-27 02:39:56.602219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.257 [2024-04-27 02:39:56.602236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:28416 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6df780 len:0x10000 key:0x184100 00:20:23.257 [2024-04-27 02:39:56.602250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.257 [2024-04-27 02:39:56.602267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:28544 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6cf700 len:0x10000 key:0x184100 00:20:23.257 [2024-04-27 02:39:56.602281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.257 [2024-04-27 02:39:56.602298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:28672 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6bf680 len:0x10000 key:0x184100 00:20:23.257 [2024-04-27 02:39:56.602313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.257 [2024-04-27 02:39:56.602329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:28800 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6af600 len:0x10000 key:0x184100 00:20:23.257 [2024-04-27 02:39:56.602350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.257 [2024-04-27 02:39:56.602367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:28928 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b69f580 len:0x10000 key:0x184100 00:20:23.257 [2024-04-27 02:39:56.602381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.257 [2024-04-27 02:39:56.602397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:29056 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b68f500 len:0x10000 key:0x184100 00:20:23.257 [2024-04-27 02:39:56.602411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.257 [2024-04-27 02:39:56.602430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:29184 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b67f480 len:0x10000 key:0x184100 00:20:23.257 [2024-04-27 02:39:56.602444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.257 [2024-04-27 02:39:56.602461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:29312 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b66f400 len:0x10000 key:0x184100 00:20:23.257 [2024-04-27 02:39:56.602474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.257 [2024-04-27 02:39:56.602491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:29440 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b65f380 len:0x10000 key:0x184100 00:20:23.257 [2024-04-27 02:39:56.602505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.257 [2024-04-27 02:39:56.602522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:29568 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b64f300 len:0x10000 key:0x184100 00:20:23.257 [2024-04-27 02:39:56.602535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.257 [2024-04-27 02:39:56.602551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:29696 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b63f280 len:0x10000 key:0x184100 00:20:23.257 [2024-04-27 02:39:56.602566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.257 [2024-04-27 02:39:56.602582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:29824 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b62f200 len:0x10000 key:0x184100 00:20:23.257 [2024-04-27 02:39:56.602596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.257 [2024-04-27 02:39:56.602611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:29952 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b61f180 len:0x10000 key:0x184100 00:20:23.257 [2024-04-27 02:39:56.602626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.257 [2024-04-27 02:39:56.602642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:30080 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b60f100 len:0x10000 key:0x184100 00:20:23.257 [2024-04-27 02:39:56.602655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.257 [2024-04-27 02:39:56.602672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:30208 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b9f0000 len:0x10000 key:0x182300 00:20:23.257 [2024-04-27 02:39:56.602686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.257 [2024-04-27 02:39:56.602702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:30336 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b9dff80 len:0x10000 key:0x182300 00:20:23.257 [2024-04-27 02:39:56.602715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.257 [2024-04-27 02:39:56.602732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:30464 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b9cff00 len:0x10000 key:0x182300 00:20:23.257 [2024-04-27 02:39:56.602746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.257 [2024-04-27 02:39:56.602765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:30592 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b9bfe80 len:0x10000 key:0x182300 00:20:23.257 [2024-04-27 02:39:56.602778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.257 [2024-04-27 02:39:56.602795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:30720 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b9afe00 len:0x10000 key:0x182300 00:20:23.257 [2024-04-27 02:39:56.602809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.257 [2024-04-27 02:39:56.602825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:30848 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b99fd80 len:0x10000 key:0x182300 00:20:23.257 [2024-04-27 02:39:56.602838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.257 [2024-04-27 02:39:56.602855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:30976 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b98fd00 len:0x10000 key:0x182300 00:20:23.257 [2024-04-27 02:39:56.602870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.257 [2024-04-27 02:39:56.602886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:31104 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b97fc80 len:0x10000 key:0x182300 00:20:23.257 [2024-04-27 02:39:56.602899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.257 [2024-04-27 02:39:56.602916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:31232 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b96fc00 len:0x10000 key:0x182300 00:20:23.257 [2024-04-27 02:39:56.602930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.257 [2024-04-27 02:39:56.602946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:31360 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b95fb80 len:0x10000 key:0x182300 00:20:23.257 [2024-04-27 02:39:56.602960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.257 [2024-04-27 02:39:56.602976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:31488 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b94fb00 len:0x10000 key:0x182300 00:20:23.257 [2024-04-27 02:39:56.602990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.257 [2024-04-27 02:39:56.603006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:31616 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b93fa80 len:0x10000 key:0x182300 00:20:23.257 [2024-04-27 02:39:56.603020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.257 [2024-04-27 02:39:56.603036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:31744 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b92fa00 len:0x10000 key:0x182300 00:20:23.257 [2024-04-27 02:39:56.603050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.257 [2024-04-27 02:39:56.603066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:31872 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b91f980 len:0x10000 key:0x182300 00:20:23.257 [2024-04-27 02:39:56.603080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.257 [2024-04-27 02:39:56.603098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:32000 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b90f900 len:0x10000 key:0x182300 00:20:23.257 [2024-04-27 02:39:56.603112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.257 [2024-04-27 02:39:56.603128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:32128 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b8ff880 len:0x10000 key:0x182300 00:20:23.257 [2024-04-27 02:39:56.603141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.257 [2024-04-27 02:39:56.603158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:32256 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b8ef800 len:0x10000 key:0x182300 00:20:23.257 [2024-04-27 02:39:56.603172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.257 [2024-04-27 02:39:56.603188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:32384 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b8df780 len:0x10000 key:0x182300 00:20:23.257 [2024-04-27 02:39:56.603202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.257 [2024-04-27 02:39:56.603219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:32512 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b8cf700 len:0x10000 key:0x182300 00:20:23.258 [2024-04-27 02:39:56.603233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.258 [2024-04-27 02:39:56.603249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:32640 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b4dfd80 len:0x10000 key:0x183f00 00:20:23.258 [2024-04-27 02:39:56.603263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32606 cdw0:43aa7920 sqhd:a46e p:0 m:0 dnr:0 00:20:23.258 [2024-04-27 02:39:56.606534] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x20001b806780 was disconnected and freed. reset controller. 00:20:23.258 [2024-04-27 02:39:56.606634] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:20:23.258 [2024-04-27 02:39:56.606654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:20:23.258 [2024-04-27 02:39:56.606670] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:20:23.258 [2024-04-27 02:39:56.606685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:20:23.258 [2024-04-27 02:39:56.606700] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:20:23.258 [2024-04-27 02:39:56.606714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:20:23.258 [2024-04-27 02:39:56.606729] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:20:23.258 [2024-04-27 02:39:56.606743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:20:23.258 [2024-04-27 02:39:56.609088] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:20:23.258 [2024-04-27 02:39:56.609129] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:20:23.258 [2024-04-27 02:39:56.609161] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:20:23.258 [2024-04-27 02:39:56.609215] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:20:23.258 [2024-04-27 02:39:56.609250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:24983 cdw0:0 sqhd:6700 p:1 m:1 dnr:0 00:20:23.258 [2024-04-27 02:39:56.609284] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:20:23.258 [2024-04-27 02:39:56.609318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:24983 cdw0:0 sqhd:6700 p:1 m:1 dnr:0 00:20:23.258 [2024-04-27 02:39:56.609361] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:20:23.258 [2024-04-27 02:39:56.609394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:24983 cdw0:0 sqhd:6700 p:1 m:1 dnr:0 00:20:23.258 [2024-04-27 02:39:56.609427] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:20:23.258 [2024-04-27 02:39:56.609459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:24983 cdw0:0 sqhd:6700 p:1 m:1 dnr:0 00:20:23.258 [2024-04-27 02:39:56.611425] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:20:23.258 [2024-04-27 02:39:56.611483] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:20:23.258 [2024-04-27 02:39:56.611514] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:20:23.258 [2024-04-27 02:39:56.611561] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:20:23.258 [2024-04-27 02:39:56.611595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:24983 cdw0:0 sqhd:6700 p:1 m:1 dnr:0 00:20:23.258 [2024-04-27 02:39:56.611628] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:20:23.258 [2024-04-27 02:39:56.611659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:24983 cdw0:0 sqhd:6700 p:1 m:1 dnr:0 00:20:23.258 [2024-04-27 02:39:56.611691] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:20:23.258 [2024-04-27 02:39:56.611722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:24983 cdw0:0 sqhd:6700 p:1 m:1 dnr:0 00:20:23.258 [2024-04-27 02:39:56.611756] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:20:23.258 [2024-04-27 02:39:56.611786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:24983 cdw0:0 sqhd:6700 p:1 m:1 dnr:0 00:20:23.258 [2024-04-27 02:39:56.614164] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:20:23.258 [2024-04-27 02:39:56.614205] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:23.258 [2024-04-27 02:39:56.614235] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:20:23.258 [2024-04-27 02:39:56.614279] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:20:23.258 [2024-04-27 02:39:56.614312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:24983 cdw0:0 sqhd:6700 p:1 m:1 dnr:0 00:20:23.258 [2024-04-27 02:39:56.614354] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:20:23.258 [2024-04-27 02:39:56.614387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:24983 cdw0:0 sqhd:6700 p:1 m:1 dnr:0 00:20:23.258 [2024-04-27 02:39:56.614421] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:20:23.258 [2024-04-27 02:39:56.614459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:24983 cdw0:0 sqhd:6700 p:1 m:1 dnr:0 00:20:23.258 [2024-04-27 02:39:56.614492] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:20:23.258 [2024-04-27 02:39:56.614523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:24983 cdw0:0 sqhd:6700 p:1 m:1 dnr:0 00:20:23.258 [2024-04-27 02:39:56.616707] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:20:23.258 [2024-04-27 02:39:56.616748] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:20:23.258 [2024-04-27 02:39:56.616778] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:20:23.258 [2024-04-27 02:39:56.616821] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:20:23.258 [2024-04-27 02:39:56.616854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:24983 cdw0:0 sqhd:6700 p:1 m:1 dnr:0 00:20:23.258 [2024-04-27 02:39:56.616887] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:20:23.258 [2024-04-27 02:39:56.616919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:24983 cdw0:0 sqhd:6700 p:1 m:1 dnr:0 00:20:23.258 [2024-04-27 02:39:56.616951] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:20:23.258 [2024-04-27 02:39:56.616982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:24983 cdw0:0 sqhd:6700 p:1 m:1 dnr:0 00:20:23.258 [2024-04-27 02:39:56.617015] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:20:23.258 [2024-04-27 02:39:56.617047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:24983 cdw0:0 sqhd:6700 p:1 m:1 dnr:0 00:20:23.258 [2024-04-27 02:39:56.619120] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:20:23.258 [2024-04-27 02:39:56.619160] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:20:23.258 [2024-04-27 02:39:56.619188] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:20:23.258 [2024-04-27 02:39:56.619235] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:20:23.258 [2024-04-27 02:39:56.619268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:24983 cdw0:0 sqhd:6700 p:1 m:1 dnr:0 00:20:23.258 [2024-04-27 02:39:56.619301] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:20:23.258 [2024-04-27 02:39:56.619332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:24983 cdw0:0 sqhd:6700 p:1 m:1 dnr:0 00:20:23.258 [2024-04-27 02:39:56.619429] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:20:23.258 [2024-04-27 02:39:56.619460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:24983 cdw0:0 sqhd:6700 p:1 m:1 dnr:0 00:20:23.258 [2024-04-27 02:39:56.619494] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:20:23.258 [2024-04-27 02:39:56.619525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:24983 cdw0:0 sqhd:6700 p:1 m:1 dnr:0 00:20:23.258 [2024-04-27 02:39:56.621569] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:20:23.258 [2024-04-27 02:39:56.621623] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:20:23.258 [2024-04-27 02:39:56.621637] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:20:23.258 [2024-04-27 02:39:56.621658] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:20:23.258 [2024-04-27 02:39:56.621673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:24983 cdw0:0 sqhd:6700 p:1 m:1 dnr:0 00:20:23.258 [2024-04-27 02:39:56.621688] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:20:23.258 [2024-04-27 02:39:56.621703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:24983 cdw0:0 sqhd:6700 p:1 m:1 dnr:0 00:20:23.258 [2024-04-27 02:39:56.621717] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:20:23.258 [2024-04-27 02:39:56.621732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:24983 cdw0:0 sqhd:6700 p:1 m:1 dnr:0 00:20:23.258 [2024-04-27 02:39:56.621746] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:20:23.258 [2024-04-27 02:39:56.621760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:24983 cdw0:0 sqhd:6700 p:1 m:1 dnr:0 00:20:23.258 [2024-04-27 02:39:56.623804] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:20:23.258 [2024-04-27 02:39:56.623844] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:20:23.258 [2024-04-27 02:39:56.623873] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:20:23.258 [2024-04-27 02:39:56.623919] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:20:23.259 [2024-04-27 02:39:56.623952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:24983 cdw0:0 sqhd:6700 p:1 m:1 dnr:0 00:20:23.259 [2024-04-27 02:39:56.623985] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:20:23.259 [2024-04-27 02:39:56.624016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:24983 cdw0:0 sqhd:6700 p:1 m:1 dnr:0 00:20:23.259 [2024-04-27 02:39:56.624048] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:20:23.259 [2024-04-27 02:39:56.624087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:24983 cdw0:0 sqhd:6700 p:1 m:1 dnr:0 00:20:23.259 [2024-04-27 02:39:56.624120] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:20:23.259 [2024-04-27 02:39:56.624152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:24983 cdw0:0 sqhd:6700 p:1 m:1 dnr:0 00:20:23.259 [2024-04-27 02:39:56.626203] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:20:23.259 [2024-04-27 02:39:56.626243] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:20:23.259 [2024-04-27 02:39:56.626272] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:20:23.259 [2024-04-27 02:39:56.626317] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:20:23.259 [2024-04-27 02:39:56.626360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:24983 cdw0:0 sqhd:6700 p:1 m:1 dnr:0 00:20:23.259 [2024-04-27 02:39:56.626401] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:20:23.259 [2024-04-27 02:39:56.626432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:24983 cdw0:0 sqhd:6700 p:1 m:1 dnr:0 00:20:23.259 [2024-04-27 02:39:56.626464] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:20:23.259 [2024-04-27 02:39:56.626496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:24983 cdw0:0 sqhd:6700 p:1 m:1 dnr:0 00:20:23.259 [2024-04-27 02:39:56.626529] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:20:23.259 [2024-04-27 02:39:56.626560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:24983 cdw0:0 sqhd:6700 p:1 m:1 dnr:0 00:20:23.259 [2024-04-27 02:39:56.628520] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:20:23.259 [2024-04-27 02:39:56.628561] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:20:23.259 [2024-04-27 02:39:56.628590] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:20:23.259 [2024-04-27 02:39:56.628637] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:20:23.259 [2024-04-27 02:39:56.628671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:24983 cdw0:0 sqhd:6700 p:1 m:1 dnr:0 00:20:23.259 [2024-04-27 02:39:56.628703] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:20:23.259 [2024-04-27 02:39:56.628734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:24983 cdw0:0 sqhd:6700 p:1 m:1 dnr:0 00:20:23.259 [2024-04-27 02:39:56.628767] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:20:23.259 [2024-04-27 02:39:56.628799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:24983 cdw0:0 sqhd:6700 p:1 m:1 dnr:0 00:20:23.259 [2024-04-27 02:39:56.628832] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:20:23.259 [2024-04-27 02:39:56.628863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:24983 cdw0:0 sqhd:6700 p:1 m:1 dnr:0 00:20:23.259 [2024-04-27 02:39:56.648893] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:20:23.259 [2024-04-27 02:39:56.648945] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:20:23.259 [2024-04-27 02:39:56.648977] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:20:23.259 [2024-04-27 02:39:56.651529] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:20:23.259 [2024-04-27 02:39:56.651553] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:20:23.259 [2024-04-27 02:39:56.651564] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:20:23.259 [2024-04-27 02:39:56.651575] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:20:23.259 [2024-04-27 02:39:56.651586] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:20:23.259 [2024-04-27 02:39:56.651596] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:20:23.259 [2024-04-27 02:39:56.651662] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:20:23.259 [2024-04-27 02:39:56.651677] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:20:23.259 [2024-04-27 02:39:56.651693] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:20:23.259 [2024-04-27 02:39:56.651705] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:20:23.259 [2024-04-27 02:39:56.651800] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:20:23.259 [2024-04-27 02:39:56.651814] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:20:23.259 [2024-04-27 02:39:56.651825] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:20:23.259 [2024-04-27 02:39:56.651840] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:20:23.259 task offset: 40960 on job bdev=Nvme7n1 fails 00:20:23.259 00:20:23.259 Latency(us) 00:20:23.259 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:23.259 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:20:23.259 Job: Nvme1n1 ended in about 1.92 seconds with error 00:20:23.259 Verification LBA range: start 0x0 length 0x400 00:20:23.259 Nvme1n1 : 1.92 149.58 9.35 33.36 0.00 346339.01 7151.97 1064988.49 00:20:23.259 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:20:23.259 Job: Nvme2n1 ended in about 1.92 seconds with error 00:20:23.259 Verification LBA range: start 0x0 length 0x400 00:20:23.259 Nvme2n1 : 1.92 150.00 9.37 33.33 0.00 342497.48 9402.99 1064988.49 00:20:23.259 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:20:23.259 Job: Nvme3n1 ended in about 1.92 seconds with error 00:20:23.259 Verification LBA range: start 0x0 length 0x400 00:20:23.259 Nvme3n1 : 1.92 149.91 9.37 33.31 0.00 340025.96 20743.57 1064988.49 00:20:23.259 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:20:23.259 Job: Nvme4n1 ended in about 1.92 seconds with error 00:20:23.259 Verification LBA range: start 0x0 length 0x400 00:20:23.259 Nvme4n1 : 1.92 151.91 9.49 33.29 0.00 333736.40 4758.48 1064988.49 00:20:23.259 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:20:23.259 Job: Nvme5n1 ended in about 1.92 seconds with error 00:20:23.259 Verification LBA range: start 0x0 length 0x400 00:20:23.259 Nvme5n1 : 1.92 140.90 8.81 33.28 0.00 351789.76 35560.40 1064988.49 00:20:23.259 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:20:23.259 Job: Nvme6n1 ended in about 1.92 seconds with error 00:20:23.259 Verification LBA range: start 0x0 length 0x400 00:20:23.259 Nvme6n1 : 1.92 149.65 9.35 33.26 0.00 332057.05 39891.48 1064988.49 00:20:23.259 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:20:23.259 Job: Nvme7n1 ended in about 1.93 seconds with error 00:20:23.259 Verification LBA range: start 0x0 length 0x400 00:20:23.259 Nvme7n1 : 1.93 149.57 9.35 33.24 0.00 328947.33 49921.34 1057694.05 00:20:23.259 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:20:23.259 Job: Nvme8n1 ended in about 1.93 seconds with error 00:20:23.259 Verification LBA range: start 0x0 length 0x400 00:20:23.259 Nvme8n1 : 1.93 147.41 9.21 33.22 0.00 329891.72 51516.99 1057694.05 00:20:23.259 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:20:23.259 Job: Nvme9n1 ended in about 1.91 seconds with error 00:20:23.259 Verification LBA range: start 0x0 length 0x400 00:20:23.259 Nvme9n1 : 1.91 134.11 8.38 33.53 0.00 346355.98 51289.04 1057694.05 00:20:23.259 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:20:23.259 Job: Nvme10n1 ended in about 1.91 seconds with error 00:20:23.260 Verification LBA range: start 0x0 length 0x400 00:20:23.260 Nvme10n1 : 1.91 100.54 6.28 33.51 0.00 439128.60 64738.17 1101460.70 00:20:23.260 =================================================================================================================== 00:20:23.260 Total : 1423.58 88.97 333.33 0.00 346532.21 4758.48 1101460.70 00:20:23.260 [2024-04-27 02:39:56.692820] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:20:23.260 [2024-04-27 02:39:56.698532] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:20:23.260 [2024-04-27 02:39:56.698562] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:20:23.260 [2024-04-27 02:39:56.698575] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192bd440 00:20:23.260 [2024-04-27 02:39:56.698667] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:20:23.260 [2024-04-27 02:39:56.698683] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:20:23.260 [2024-04-27 02:39:56.698695] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192c60c0 00:20:23.260 [2024-04-27 02:39:56.698785] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:20:23.260 [2024-04-27 02:39:56.698801] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:20:23.260 [2024-04-27 02:39:56.698812] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192d9c00 00:20:23.260 [2024-04-27 02:39:56.698945] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:20:23.260 [2024-04-27 02:39:56.698961] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:20:23.260 [2024-04-27 02:39:56.698973] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ba540 00:20:23.260 [2024-04-27 02:39:56.699069] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:20:23.260 [2024-04-27 02:39:56.699085] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:20:23.260 [2024-04-27 02:39:56.699096] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e5380 00:20:23.260 [2024-04-27 02:39:56.699165] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:20:23.260 [2024-04-27 02:39:56.699181] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:20:23.260 [2024-04-27 02:39:56.699192] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:20:23.260 [2024-04-27 02:39:56.700543] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:20:23.260 [2024-04-27 02:39:56.700587] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:20:23.260 [2024-04-27 02:39:56.700613] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192b54c0 00:20:23.260 [2024-04-27 02:39:56.700716] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:20:23.260 [2024-04-27 02:39:56.700750] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:20:23.260 [2024-04-27 02:39:56.700774] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x20001929c140 00:20:23.260 [2024-04-27 02:39:56.700892] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:20:23.260 [2024-04-27 02:39:56.700908] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:20:23.260 [2024-04-27 02:39:56.700923] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x200019298cc0 00:20:23.260 [2024-04-27 02:39:56.701007] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:20:23.260 [2024-04-27 02:39:56.701023] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:20:23.260 [2024-04-27 02:39:56.701035] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x20001928f280 00:20:23.518 02:39:57 -- target/shutdown.sh@142 -- # kill -9 1595811 00:20:23.518 02:39:57 -- target/shutdown.sh@144 -- # stoptarget 00:20:23.518 02:39:57 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:20:23.518 02:39:57 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:20:23.518 02:39:57 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:20:23.518 02:39:57 -- target/shutdown.sh@45 -- # nvmftestfini 00:20:23.518 02:39:57 -- nvmf/common.sh@477 -- # nvmfcleanup 00:20:23.518 02:39:57 -- nvmf/common.sh@117 -- # sync 00:20:23.518 02:39:57 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:20:23.518 02:39:57 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:20:23.518 02:39:57 -- nvmf/common.sh@120 -- # set +e 00:20:23.518 02:39:57 -- nvmf/common.sh@121 -- # for i in {1..20} 00:20:23.518 02:39:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:20:23.518 rmmod nvme_rdma 00:20:23.518 rmmod nvme_fabrics 00:20:23.518 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh: line 121: 1595811 Killed $rootdir/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") -q 64 -o 65536 -w verify -t 10 00:20:23.518 02:39:57 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:20:23.518 02:39:57 -- nvmf/common.sh@124 -- # set -e 00:20:23.518 02:39:57 -- nvmf/common.sh@125 -- # return 0 00:20:23.518 02:39:57 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:20:23.518 02:39:57 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:20:23.518 02:39:57 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:20:23.518 00:20:23.518 real 0m5.371s 00:20:23.518 user 0m18.042s 00:20:23.518 sys 0m1.438s 00:20:23.518 02:39:57 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:20:23.518 02:39:57 -- common/autotest_common.sh@10 -- # set +x 00:20:23.518 ************************************ 00:20:23.518 END TEST nvmf_shutdown_tc3 00:20:23.518 ************************************ 00:20:23.777 02:39:57 -- target/shutdown.sh@151 -- # trap - SIGINT SIGTERM EXIT 00:20:23.777 00:20:23.777 real 0m24.861s 00:20:23.778 user 1m13.026s 00:20:23.778 sys 0m8.817s 00:20:23.778 02:39:57 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:20:23.778 02:39:57 -- common/autotest_common.sh@10 -- # set +x 00:20:23.778 ************************************ 00:20:23.778 END TEST nvmf_shutdown 00:20:23.778 ************************************ 00:20:23.778 02:39:57 -- nvmf/nvmf.sh@84 -- # timing_exit target 00:20:23.778 02:39:57 -- common/autotest_common.sh@716 -- # xtrace_disable 00:20:23.778 02:39:57 -- common/autotest_common.sh@10 -- # set +x 00:20:23.778 02:39:57 -- nvmf/nvmf.sh@86 -- # timing_enter host 00:20:23.778 02:39:57 -- common/autotest_common.sh@710 -- # xtrace_disable 00:20:23.778 02:39:57 -- common/autotest_common.sh@10 -- # set +x 00:20:23.778 02:39:57 -- nvmf/nvmf.sh@88 -- # [[ 0 -eq 0 ]] 00:20:23.778 02:39:57 -- nvmf/nvmf.sh@89 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=rdma 00:20:23.778 02:39:57 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:23.778 02:39:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:23.778 02:39:57 -- common/autotest_common.sh@10 -- # set +x 00:20:24.037 ************************************ 00:20:24.037 START TEST nvmf_multicontroller 00:20:24.037 ************************************ 00:20:24.037 02:39:57 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=rdma 00:20:24.037 * Looking for test storage... 00:20:24.037 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:20:24.037 02:39:57 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:20:24.037 02:39:57 -- nvmf/common.sh@7 -- # uname -s 00:20:24.037 02:39:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:24.037 02:39:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:24.037 02:39:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:24.037 02:39:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:24.037 02:39:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:24.037 02:39:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:24.037 02:39:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:24.037 02:39:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:24.037 02:39:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:24.037 02:39:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:24.037 02:39:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:20:24.037 02:39:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:20:24.037 02:39:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:24.037 02:39:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:24.037 02:39:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:24.037 02:39:57 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:20:24.037 02:39:57 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:20:24.037 02:39:57 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:24.037 02:39:57 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:24.037 02:39:57 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:24.037 02:39:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:24.037 02:39:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:24.037 02:39:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:24.037 02:39:57 -- paths/export.sh@5 -- # export PATH 00:20:24.037 02:39:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:24.037 02:39:57 -- nvmf/common.sh@47 -- # : 0 00:20:24.037 02:39:57 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:20:24.037 02:39:57 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:20:24.037 02:39:57 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:20:24.037 02:39:57 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:24.037 02:39:57 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:24.037 02:39:57 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:20:24.037 02:39:57 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:20:24.037 02:39:57 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:20:24.037 02:39:57 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:20:24.037 02:39:57 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:20:24.037 02:39:57 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:20:24.037 02:39:57 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:20:24.037 02:39:57 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:24.037 02:39:57 -- host/multicontroller.sh@18 -- # '[' rdma == rdma ']' 00:20:24.037 02:39:57 -- host/multicontroller.sh@19 -- # echo 'Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target.' 00:20:24.037 Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target. 00:20:24.037 02:39:57 -- host/multicontroller.sh@20 -- # exit 0 00:20:24.037 00:20:24.037 real 0m0.122s 00:20:24.037 user 0m0.052s 00:20:24.037 sys 0m0.079s 00:20:24.037 02:39:57 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:20:24.037 02:39:57 -- common/autotest_common.sh@10 -- # set +x 00:20:24.037 ************************************ 00:20:24.037 END TEST nvmf_multicontroller 00:20:24.037 ************************************ 00:20:24.037 02:39:57 -- nvmf/nvmf.sh@90 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=rdma 00:20:24.037 02:39:57 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:24.037 02:39:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:24.037 02:39:57 -- common/autotest_common.sh@10 -- # set +x 00:20:24.296 ************************************ 00:20:24.296 START TEST nvmf_aer 00:20:24.296 ************************************ 00:20:24.296 02:39:57 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=rdma 00:20:24.296 * Looking for test storage... 00:20:24.296 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:20:24.296 02:39:57 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:20:24.296 02:39:57 -- nvmf/common.sh@7 -- # uname -s 00:20:24.296 02:39:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:24.296 02:39:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:24.296 02:39:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:24.296 02:39:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:24.296 02:39:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:24.296 02:39:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:24.296 02:39:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:24.296 02:39:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:24.296 02:39:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:24.296 02:39:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:24.296 02:39:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:20:24.296 02:39:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:20:24.296 02:39:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:24.296 02:39:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:24.296 02:39:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:24.296 02:39:57 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:20:24.296 02:39:57 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:20:24.296 02:39:57 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:24.296 02:39:57 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:24.296 02:39:57 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:24.296 02:39:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:24.296 02:39:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:24.296 02:39:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:24.296 02:39:57 -- paths/export.sh@5 -- # export PATH 00:20:24.296 02:39:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:24.296 02:39:57 -- nvmf/common.sh@47 -- # : 0 00:20:24.296 02:39:57 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:20:24.296 02:39:57 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:20:24.296 02:39:57 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:20:24.296 02:39:57 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:24.296 02:39:57 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:24.296 02:39:57 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:20:24.296 02:39:57 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:20:24.296 02:39:57 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:20:24.297 02:39:57 -- host/aer.sh@11 -- # nvmftestinit 00:20:24.297 02:39:57 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:20:24.297 02:39:57 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:24.297 02:39:57 -- nvmf/common.sh@437 -- # prepare_net_devs 00:20:24.297 02:39:57 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:20:24.297 02:39:57 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:20:24.297 02:39:57 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:24.297 02:39:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:24.297 02:39:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:24.297 02:39:57 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:20:24.297 02:39:57 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:20:24.297 02:39:57 -- nvmf/common.sh@285 -- # xtrace_disable 00:20:24.297 02:39:57 -- common/autotest_common.sh@10 -- # set +x 00:20:30.919 02:40:03 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:30.919 02:40:03 -- nvmf/common.sh@291 -- # pci_devs=() 00:20:30.919 02:40:03 -- nvmf/common.sh@291 -- # local -a pci_devs 00:20:30.919 02:40:03 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:20:30.919 02:40:03 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:20:30.919 02:40:03 -- nvmf/common.sh@293 -- # pci_drivers=() 00:20:30.919 02:40:03 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:20:30.919 02:40:03 -- nvmf/common.sh@295 -- # net_devs=() 00:20:30.919 02:40:03 -- nvmf/common.sh@295 -- # local -ga net_devs 00:20:30.919 02:40:03 -- nvmf/common.sh@296 -- # e810=() 00:20:30.919 02:40:03 -- nvmf/common.sh@296 -- # local -ga e810 00:20:30.920 02:40:03 -- nvmf/common.sh@297 -- # x722=() 00:20:30.920 02:40:03 -- nvmf/common.sh@297 -- # local -ga x722 00:20:30.920 02:40:03 -- nvmf/common.sh@298 -- # mlx=() 00:20:30.920 02:40:03 -- nvmf/common.sh@298 -- # local -ga mlx 00:20:30.920 02:40:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:30.920 02:40:03 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:30.920 02:40:03 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:30.920 02:40:03 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:30.920 02:40:03 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:30.920 02:40:03 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:30.920 02:40:03 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:30.920 02:40:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:30.920 02:40:03 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:30.920 02:40:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:30.920 02:40:03 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:30.920 02:40:03 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:20:30.920 02:40:03 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:20:30.920 02:40:03 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:20:30.920 02:40:03 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:20:30.920 02:40:03 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:20:30.920 02:40:03 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:20:30.920 02:40:03 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:20:30.920 02:40:03 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:20:30.920 02:40:03 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:20:30.920 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:20:30.920 02:40:03 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:20:30.920 02:40:03 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:20:30.920 02:40:03 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:20:30.920 02:40:03 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:20:30.920 02:40:03 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:20:30.920 02:40:03 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:20:30.920 02:40:03 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:20:30.920 02:40:03 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:20:30.920 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:20:30.920 02:40:03 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:20:30.920 02:40:03 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:20:30.920 02:40:03 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:20:30.920 02:40:03 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:20:30.920 02:40:03 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:20:30.920 02:40:03 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:20:30.920 02:40:03 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:20:30.920 02:40:03 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:20:30.920 02:40:03 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:20:30.920 02:40:03 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:30.920 02:40:03 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:20:30.920 02:40:03 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:30.920 02:40:03 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:20:30.920 Found net devices under 0000:18:00.0: mlx_0_0 00:20:30.920 02:40:03 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:20:30.920 02:40:03 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:20:30.920 02:40:03 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:30.920 02:40:03 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:20:30.920 02:40:03 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:30.920 02:40:03 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:20:30.920 Found net devices under 0000:18:00.1: mlx_0_1 00:20:30.920 02:40:03 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:20:30.920 02:40:03 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:20:30.920 02:40:03 -- nvmf/common.sh@403 -- # is_hw=yes 00:20:30.920 02:40:03 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:20:30.920 02:40:03 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:20:30.920 02:40:03 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:20:30.920 02:40:03 -- nvmf/common.sh@409 -- # rdma_device_init 00:20:30.920 02:40:03 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:20:30.920 02:40:03 -- nvmf/common.sh@58 -- # uname 00:20:30.920 02:40:03 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:20:30.920 02:40:03 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:20:30.920 02:40:03 -- nvmf/common.sh@63 -- # modprobe ib_core 00:20:30.920 02:40:03 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:20:30.920 02:40:03 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:20:30.920 02:40:03 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:20:30.920 02:40:03 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:20:30.920 02:40:03 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:20:30.920 02:40:03 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:20:30.920 02:40:03 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:20:30.920 02:40:03 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:20:30.920 02:40:03 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:20:30.920 02:40:03 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:20:30.920 02:40:03 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:20:30.920 02:40:03 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:20:30.920 02:40:03 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:20:30.920 02:40:03 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:30.920 02:40:03 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:30.920 02:40:03 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:20:30.920 02:40:03 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:20:30.920 02:40:03 -- nvmf/common.sh@105 -- # continue 2 00:20:30.920 02:40:03 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:30.920 02:40:03 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:30.920 02:40:03 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:20:30.920 02:40:03 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:30.920 02:40:03 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:20:30.920 02:40:03 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:20:30.920 02:40:03 -- nvmf/common.sh@105 -- # continue 2 00:20:30.920 02:40:03 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:20:30.920 02:40:03 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:20:30.920 02:40:03 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:20:30.920 02:40:03 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:20:30.920 02:40:03 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:30.920 02:40:03 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:30.920 02:40:03 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:20:30.920 02:40:03 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:20:30.920 02:40:03 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:20:30.920 64: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:20:30.920 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:20:30.920 altname enp24s0f0np0 00:20:30.920 altname ens785f0np0 00:20:30.920 inet 192.168.100.8/24 scope global mlx_0_0 00:20:30.920 valid_lft forever preferred_lft forever 00:20:30.920 02:40:03 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:20:30.920 02:40:03 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:20:30.920 02:40:03 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:20:30.920 02:40:03 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:20:30.920 02:40:03 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:30.920 02:40:03 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:30.920 02:40:03 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:20:30.920 02:40:03 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:20:30.920 02:40:03 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:20:30.920 65: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:20:30.920 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:20:30.920 altname enp24s0f1np1 00:20:30.920 altname ens785f1np1 00:20:30.920 inet 192.168.100.9/24 scope global mlx_0_1 00:20:30.920 valid_lft forever preferred_lft forever 00:20:30.920 02:40:03 -- nvmf/common.sh@411 -- # return 0 00:20:30.920 02:40:03 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:20:30.920 02:40:03 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:20:30.920 02:40:03 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:20:30.920 02:40:03 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:20:30.920 02:40:03 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:20:30.920 02:40:03 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:20:30.920 02:40:03 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:20:30.920 02:40:03 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:20:30.920 02:40:03 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:20:30.920 02:40:03 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:20:30.920 02:40:03 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:30.920 02:40:03 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:30.920 02:40:03 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:20:30.920 02:40:03 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:20:30.920 02:40:03 -- nvmf/common.sh@105 -- # continue 2 00:20:30.920 02:40:03 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:30.920 02:40:03 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:30.920 02:40:03 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:20:30.920 02:40:03 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:30.920 02:40:03 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:20:30.920 02:40:03 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:20:30.920 02:40:03 -- nvmf/common.sh@105 -- # continue 2 00:20:30.920 02:40:03 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:20:30.920 02:40:03 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:20:30.920 02:40:03 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:20:30.920 02:40:03 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:20:30.920 02:40:03 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:30.920 02:40:03 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:30.920 02:40:03 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:20:30.920 02:40:03 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:20:30.920 02:40:03 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:20:30.920 02:40:03 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:30.920 02:40:03 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:20:30.920 02:40:03 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:30.920 02:40:03 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:20:30.920 192.168.100.9' 00:20:30.920 02:40:03 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:20:30.920 192.168.100.9' 00:20:30.920 02:40:03 -- nvmf/common.sh@446 -- # head -n 1 00:20:30.921 02:40:03 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:20:30.921 02:40:03 -- nvmf/common.sh@447 -- # tail -n +2 00:20:30.921 02:40:03 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:20:30.921 192.168.100.9' 00:20:30.921 02:40:03 -- nvmf/common.sh@447 -- # head -n 1 00:20:30.921 02:40:03 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:20:30.921 02:40:03 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:20:30.921 02:40:03 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:20:30.921 02:40:03 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:20:30.921 02:40:03 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:20:30.921 02:40:03 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:20:30.921 02:40:03 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:20:30.921 02:40:03 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:20:30.921 02:40:03 -- common/autotest_common.sh@710 -- # xtrace_disable 00:20:30.921 02:40:03 -- common/autotest_common.sh@10 -- # set +x 00:20:30.921 02:40:03 -- nvmf/common.sh@470 -- # nvmfpid=1599216 00:20:30.921 02:40:03 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:20:30.921 02:40:03 -- nvmf/common.sh@471 -- # waitforlisten 1599216 00:20:30.921 02:40:03 -- common/autotest_common.sh@817 -- # '[' -z 1599216 ']' 00:20:30.921 02:40:03 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:30.921 02:40:03 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:30.921 02:40:03 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:30.921 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:30.921 02:40:03 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:30.921 02:40:03 -- common/autotest_common.sh@10 -- # set +x 00:20:30.921 [2024-04-27 02:40:03.777813] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:20:30.921 [2024-04-27 02:40:03.777872] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:30.921 EAL: No free 2048 kB hugepages reported on node 1 00:20:30.921 [2024-04-27 02:40:03.851204] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:20:30.921 [2024-04-27 02:40:03.938537] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:30.921 [2024-04-27 02:40:03.938574] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:30.921 [2024-04-27 02:40:03.938584] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:20:30.921 [2024-04-27 02:40:03.938593] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:20:30.921 [2024-04-27 02:40:03.938600] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:30.921 [2024-04-27 02:40:03.938653] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:30.921 [2024-04-27 02:40:03.938737] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:30.921 [2024-04-27 02:40:03.938816] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:30.921 [2024-04-27 02:40:03.938817] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:31.180 02:40:04 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:31.180 02:40:04 -- common/autotest_common.sh@850 -- # return 0 00:20:31.180 02:40:04 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:20:31.180 02:40:04 -- common/autotest_common.sh@716 -- # xtrace_disable 00:20:31.180 02:40:04 -- common/autotest_common.sh@10 -- # set +x 00:20:31.180 02:40:04 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:31.180 02:40:04 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:20:31.180 02:40:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:31.180 02:40:04 -- common/autotest_common.sh@10 -- # set +x 00:20:31.180 [2024-04-27 02:40:04.666285] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xddf4d0/0xde39c0) succeed. 00:20:31.180 [2024-04-27 02:40:04.676920] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xde0b10/0xe25050) succeed. 00:20:31.440 02:40:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:31.440 02:40:04 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:20:31.440 02:40:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:31.440 02:40:04 -- common/autotest_common.sh@10 -- # set +x 00:20:31.440 Malloc0 00:20:31.440 02:40:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:31.440 02:40:04 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:20:31.440 02:40:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:31.440 02:40:04 -- common/autotest_common.sh@10 -- # set +x 00:20:31.440 02:40:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:31.440 02:40:04 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:20:31.440 02:40:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:31.440 02:40:04 -- common/autotest_common.sh@10 -- # set +x 00:20:31.440 02:40:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:31.440 02:40:04 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:20:31.440 02:40:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:31.440 02:40:04 -- common/autotest_common.sh@10 -- # set +x 00:20:31.440 [2024-04-27 02:40:04.851381] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:20:31.440 02:40:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:31.440 02:40:04 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:20:31.440 02:40:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:31.440 02:40:04 -- common/autotest_common.sh@10 -- # set +x 00:20:31.440 [2024-04-27 02:40:04.859034] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:20:31.440 [ 00:20:31.440 { 00:20:31.440 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:20:31.440 "subtype": "Discovery", 00:20:31.440 "listen_addresses": [], 00:20:31.440 "allow_any_host": true, 00:20:31.440 "hosts": [] 00:20:31.440 }, 00:20:31.440 { 00:20:31.440 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:31.440 "subtype": "NVMe", 00:20:31.440 "listen_addresses": [ 00:20:31.440 { 00:20:31.440 "transport": "RDMA", 00:20:31.440 "trtype": "RDMA", 00:20:31.440 "adrfam": "IPv4", 00:20:31.440 "traddr": "192.168.100.8", 00:20:31.440 "trsvcid": "4420" 00:20:31.440 } 00:20:31.440 ], 00:20:31.440 "allow_any_host": true, 00:20:31.440 "hosts": [], 00:20:31.440 "serial_number": "SPDK00000000000001", 00:20:31.440 "model_number": "SPDK bdev Controller", 00:20:31.440 "max_namespaces": 2, 00:20:31.440 "min_cntlid": 1, 00:20:31.440 "max_cntlid": 65519, 00:20:31.440 "namespaces": [ 00:20:31.440 { 00:20:31.440 "nsid": 1, 00:20:31.440 "bdev_name": "Malloc0", 00:20:31.440 "name": "Malloc0", 00:20:31.440 "nguid": "255733A29EDF41BDA5EB34500BE868FF", 00:20:31.440 "uuid": "255733a2-9edf-41bd-a5eb-34500be868ff" 00:20:31.440 } 00:20:31.440 ] 00:20:31.440 } 00:20:31.440 ] 00:20:31.440 02:40:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:31.440 02:40:04 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:20:31.440 02:40:04 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:20:31.440 02:40:04 -- host/aer.sh@33 -- # aerpid=1599404 00:20:31.440 02:40:04 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:20:31.440 02:40:04 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:20:31.440 02:40:04 -- common/autotest_common.sh@1251 -- # local i=0 00:20:31.440 02:40:04 -- common/autotest_common.sh@1252 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:20:31.440 02:40:04 -- common/autotest_common.sh@1253 -- # '[' 0 -lt 200 ']' 00:20:31.440 02:40:04 -- common/autotest_common.sh@1254 -- # i=1 00:20:31.440 02:40:04 -- common/autotest_common.sh@1255 -- # sleep 0.1 00:20:31.440 EAL: No free 2048 kB hugepages reported on node 1 00:20:31.440 02:40:04 -- common/autotest_common.sh@1252 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:20:31.440 02:40:04 -- common/autotest_common.sh@1253 -- # '[' 1 -lt 200 ']' 00:20:31.440 02:40:04 -- common/autotest_common.sh@1254 -- # i=2 00:20:31.440 02:40:04 -- common/autotest_common.sh@1255 -- # sleep 0.1 00:20:31.699 02:40:05 -- common/autotest_common.sh@1252 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:20:31.699 02:40:05 -- common/autotest_common.sh@1258 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:20:31.699 02:40:05 -- common/autotest_common.sh@1262 -- # return 0 00:20:31.699 02:40:05 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:20:31.699 02:40:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:31.699 02:40:05 -- common/autotest_common.sh@10 -- # set +x 00:20:31.699 Malloc1 00:20:31.699 02:40:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:31.699 02:40:05 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:20:31.699 02:40:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:31.699 02:40:05 -- common/autotest_common.sh@10 -- # set +x 00:20:31.699 02:40:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:31.699 02:40:05 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:20:31.699 02:40:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:31.699 02:40:05 -- common/autotest_common.sh@10 -- # set +x 00:20:31.699 [ 00:20:31.699 { 00:20:31.699 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:20:31.699 "subtype": "Discovery", 00:20:31.699 "listen_addresses": [], 00:20:31.699 "allow_any_host": true, 00:20:31.699 "hosts": [] 00:20:31.699 }, 00:20:31.699 { 00:20:31.699 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:31.699 "subtype": "NVMe", 00:20:31.699 "listen_addresses": [ 00:20:31.699 { 00:20:31.699 "transport": "RDMA", 00:20:31.699 "trtype": "RDMA", 00:20:31.699 "adrfam": "IPv4", 00:20:31.699 "traddr": "192.168.100.8", 00:20:31.699 "trsvcid": "4420" 00:20:31.699 } 00:20:31.699 ], 00:20:31.699 "allow_any_host": true, 00:20:31.699 "hosts": [], 00:20:31.699 "serial_number": "SPDK00000000000001", 00:20:31.699 "model_number": "SPDK bdev Controller", 00:20:31.699 "max_namespaces": 2, 00:20:31.699 "min_cntlid": 1, 00:20:31.699 "max_cntlid": 65519, 00:20:31.699 "namespaces": [ 00:20:31.699 { 00:20:31.699 "nsid": 1, 00:20:31.699 "bdev_name": "Malloc0", 00:20:31.699 "name": "Malloc0", 00:20:31.699 "nguid": "255733A29EDF41BDA5EB34500BE868FF", 00:20:31.699 "uuid": "255733a2-9edf-41bd-a5eb-34500be868ff" 00:20:31.699 }, 00:20:31.699 { 00:20:31.699 "nsid": 2, 00:20:31.699 "bdev_name": "Malloc1", 00:20:31.700 "name": "Malloc1", 00:20:31.700 "nguid": "DEA7D8C3E5CA48D284E9F2E783CB208B", 00:20:31.700 "uuid": "dea7d8c3-e5ca-48d2-84e9-f2e783cb208b" 00:20:31.700 } 00:20:31.700 ] 00:20:31.700 } 00:20:31.700 ] 00:20:31.700 02:40:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:31.700 02:40:05 -- host/aer.sh@43 -- # wait 1599404 00:20:31.700 Asynchronous Event Request test 00:20:31.700 Attaching to 192.168.100.8 00:20:31.700 Attached to 192.168.100.8 00:20:31.700 Registering asynchronous event callbacks... 00:20:31.700 Starting namespace attribute notice tests for all controllers... 00:20:31.700 192.168.100.8: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:20:31.700 aer_cb - Changed Namespace 00:20:31.700 Cleaning up... 00:20:31.700 02:40:05 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:20:31.700 02:40:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:31.700 02:40:05 -- common/autotest_common.sh@10 -- # set +x 00:20:31.700 02:40:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:31.700 02:40:05 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:20:31.700 02:40:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:31.700 02:40:05 -- common/autotest_common.sh@10 -- # set +x 00:20:31.700 02:40:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:31.700 02:40:05 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:31.700 02:40:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:31.700 02:40:05 -- common/autotest_common.sh@10 -- # set +x 00:20:31.700 02:40:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:31.700 02:40:05 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:20:31.700 02:40:05 -- host/aer.sh@51 -- # nvmftestfini 00:20:31.700 02:40:05 -- nvmf/common.sh@477 -- # nvmfcleanup 00:20:31.700 02:40:05 -- nvmf/common.sh@117 -- # sync 00:20:31.700 02:40:05 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:20:31.700 02:40:05 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:20:31.700 02:40:05 -- nvmf/common.sh@120 -- # set +e 00:20:31.700 02:40:05 -- nvmf/common.sh@121 -- # for i in {1..20} 00:20:31.700 02:40:05 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:20:31.700 rmmod nvme_rdma 00:20:31.700 rmmod nvme_fabrics 00:20:31.700 02:40:05 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:20:31.959 02:40:05 -- nvmf/common.sh@124 -- # set -e 00:20:31.959 02:40:05 -- nvmf/common.sh@125 -- # return 0 00:20:31.959 02:40:05 -- nvmf/common.sh@478 -- # '[' -n 1599216 ']' 00:20:31.959 02:40:05 -- nvmf/common.sh@479 -- # killprocess 1599216 00:20:31.959 02:40:05 -- common/autotest_common.sh@936 -- # '[' -z 1599216 ']' 00:20:31.959 02:40:05 -- common/autotest_common.sh@940 -- # kill -0 1599216 00:20:31.959 02:40:05 -- common/autotest_common.sh@941 -- # uname 00:20:31.959 02:40:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:31.959 02:40:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1599216 00:20:31.959 02:40:05 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:20:31.959 02:40:05 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:20:31.959 02:40:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1599216' 00:20:31.959 killing process with pid 1599216 00:20:31.959 02:40:05 -- common/autotest_common.sh@955 -- # kill 1599216 00:20:31.959 [2024-04-27 02:40:05.375618] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:20:31.959 02:40:05 -- common/autotest_common.sh@960 -- # wait 1599216 00:20:31.959 [2024-04-27 02:40:05.461502] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:20:32.218 02:40:05 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:20:32.218 02:40:05 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:20:32.218 00:20:32.218 real 0m7.966s 00:20:32.218 user 0m8.465s 00:20:32.218 sys 0m5.016s 00:20:32.218 02:40:05 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:20:32.218 02:40:05 -- common/autotest_common.sh@10 -- # set +x 00:20:32.218 ************************************ 00:20:32.218 END TEST nvmf_aer 00:20:32.218 ************************************ 00:20:32.218 02:40:05 -- nvmf/nvmf.sh@91 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=rdma 00:20:32.218 02:40:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:32.218 02:40:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:32.218 02:40:05 -- common/autotest_common.sh@10 -- # set +x 00:20:32.479 ************************************ 00:20:32.479 START TEST nvmf_async_init 00:20:32.479 ************************************ 00:20:32.479 02:40:05 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=rdma 00:20:32.479 * Looking for test storage... 00:20:32.479 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:20:32.479 02:40:05 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:20:32.479 02:40:05 -- nvmf/common.sh@7 -- # uname -s 00:20:32.479 02:40:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:32.479 02:40:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:32.479 02:40:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:32.479 02:40:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:32.479 02:40:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:32.479 02:40:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:32.479 02:40:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:32.479 02:40:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:32.479 02:40:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:32.479 02:40:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:32.479 02:40:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:20:32.479 02:40:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:20:32.479 02:40:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:32.479 02:40:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:32.479 02:40:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:32.479 02:40:05 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:20:32.479 02:40:05 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:20:32.479 02:40:05 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:32.479 02:40:05 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:32.479 02:40:05 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:32.479 02:40:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:32.479 02:40:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:32.479 02:40:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:32.479 02:40:05 -- paths/export.sh@5 -- # export PATH 00:20:32.479 02:40:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:32.479 02:40:05 -- nvmf/common.sh@47 -- # : 0 00:20:32.479 02:40:05 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:20:32.479 02:40:05 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:20:32.479 02:40:05 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:20:32.479 02:40:05 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:32.479 02:40:05 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:32.479 02:40:05 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:20:32.479 02:40:05 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:20:32.479 02:40:05 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:20:32.479 02:40:05 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:20:32.479 02:40:05 -- host/async_init.sh@14 -- # null_block_size=512 00:20:32.479 02:40:05 -- host/async_init.sh@15 -- # null_bdev=null0 00:20:32.479 02:40:05 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:20:32.479 02:40:05 -- host/async_init.sh@20 -- # uuidgen 00:20:32.479 02:40:05 -- host/async_init.sh@20 -- # tr -d - 00:20:32.479 02:40:06 -- host/async_init.sh@20 -- # nguid=94a3670f9e6b4026b806f40b09b0f206 00:20:32.479 02:40:06 -- host/async_init.sh@22 -- # nvmftestinit 00:20:32.479 02:40:06 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:20:32.479 02:40:06 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:32.479 02:40:06 -- nvmf/common.sh@437 -- # prepare_net_devs 00:20:32.479 02:40:06 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:20:32.479 02:40:06 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:20:32.479 02:40:06 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:32.479 02:40:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:32.479 02:40:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:32.479 02:40:06 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:20:32.479 02:40:06 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:20:32.479 02:40:06 -- nvmf/common.sh@285 -- # xtrace_disable 00:20:32.479 02:40:06 -- common/autotest_common.sh@10 -- # set +x 00:20:39.045 02:40:11 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:39.045 02:40:11 -- nvmf/common.sh@291 -- # pci_devs=() 00:20:39.045 02:40:11 -- nvmf/common.sh@291 -- # local -a pci_devs 00:20:39.045 02:40:11 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:20:39.045 02:40:11 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:20:39.045 02:40:11 -- nvmf/common.sh@293 -- # pci_drivers=() 00:20:39.045 02:40:11 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:20:39.045 02:40:11 -- nvmf/common.sh@295 -- # net_devs=() 00:20:39.045 02:40:11 -- nvmf/common.sh@295 -- # local -ga net_devs 00:20:39.045 02:40:11 -- nvmf/common.sh@296 -- # e810=() 00:20:39.045 02:40:11 -- nvmf/common.sh@296 -- # local -ga e810 00:20:39.045 02:40:11 -- nvmf/common.sh@297 -- # x722=() 00:20:39.045 02:40:11 -- nvmf/common.sh@297 -- # local -ga x722 00:20:39.045 02:40:11 -- nvmf/common.sh@298 -- # mlx=() 00:20:39.045 02:40:11 -- nvmf/common.sh@298 -- # local -ga mlx 00:20:39.045 02:40:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:39.045 02:40:11 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:39.045 02:40:11 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:39.045 02:40:11 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:39.045 02:40:11 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:39.045 02:40:11 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:39.045 02:40:11 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:39.045 02:40:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:39.045 02:40:11 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:39.045 02:40:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:39.045 02:40:11 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:39.045 02:40:11 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:20:39.045 02:40:11 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:20:39.045 02:40:11 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:20:39.045 02:40:11 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:20:39.045 02:40:11 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:20:39.045 02:40:11 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:20:39.045 02:40:11 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:20:39.045 02:40:11 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:20:39.045 02:40:11 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:20:39.045 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:20:39.045 02:40:11 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:20:39.045 02:40:11 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:20:39.045 02:40:11 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:20:39.045 02:40:11 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:20:39.045 02:40:11 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:20:39.045 02:40:11 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:20:39.045 02:40:11 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:20:39.045 02:40:11 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:20:39.045 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:20:39.045 02:40:11 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:20:39.045 02:40:11 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:20:39.045 02:40:11 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:20:39.045 02:40:11 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:20:39.046 02:40:11 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:20:39.046 02:40:11 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:20:39.046 02:40:11 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:20:39.046 02:40:11 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:20:39.046 02:40:11 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:20:39.046 02:40:11 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:39.046 02:40:11 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:20:39.046 02:40:11 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:39.046 02:40:11 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:20:39.046 Found net devices under 0000:18:00.0: mlx_0_0 00:20:39.046 02:40:11 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:20:39.046 02:40:11 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:20:39.046 02:40:11 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:39.046 02:40:11 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:20:39.046 02:40:11 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:39.046 02:40:11 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:20:39.046 Found net devices under 0000:18:00.1: mlx_0_1 00:20:39.046 02:40:11 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:20:39.046 02:40:11 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:20:39.046 02:40:11 -- nvmf/common.sh@403 -- # is_hw=yes 00:20:39.046 02:40:11 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:20:39.046 02:40:11 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:20:39.046 02:40:11 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:20:39.046 02:40:11 -- nvmf/common.sh@409 -- # rdma_device_init 00:20:39.046 02:40:11 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:20:39.046 02:40:11 -- nvmf/common.sh@58 -- # uname 00:20:39.046 02:40:11 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:20:39.046 02:40:11 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:20:39.046 02:40:11 -- nvmf/common.sh@63 -- # modprobe ib_core 00:20:39.046 02:40:11 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:20:39.046 02:40:11 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:20:39.046 02:40:11 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:20:39.046 02:40:11 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:20:39.046 02:40:11 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:20:39.046 02:40:11 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:20:39.046 02:40:11 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:20:39.046 02:40:11 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:20:39.046 02:40:11 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:20:39.046 02:40:11 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:20:39.046 02:40:11 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:20:39.046 02:40:11 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:20:39.046 02:40:11 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:20:39.046 02:40:11 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:39.046 02:40:11 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:39.046 02:40:11 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:20:39.046 02:40:11 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:20:39.046 02:40:11 -- nvmf/common.sh@105 -- # continue 2 00:20:39.046 02:40:11 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:39.046 02:40:11 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:39.046 02:40:11 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:20:39.046 02:40:11 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:39.046 02:40:11 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:20:39.046 02:40:11 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:20:39.046 02:40:11 -- nvmf/common.sh@105 -- # continue 2 00:20:39.046 02:40:11 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:20:39.046 02:40:11 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:20:39.046 02:40:11 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:20:39.046 02:40:11 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:20:39.046 02:40:11 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:39.046 02:40:11 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:39.046 02:40:11 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:20:39.046 02:40:11 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:20:39.046 02:40:11 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:20:39.046 64: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:20:39.046 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:20:39.046 altname enp24s0f0np0 00:20:39.046 altname ens785f0np0 00:20:39.046 inet 192.168.100.8/24 scope global mlx_0_0 00:20:39.046 valid_lft forever preferred_lft forever 00:20:39.046 02:40:11 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:20:39.046 02:40:11 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:20:39.046 02:40:11 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:20:39.046 02:40:11 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:39.046 02:40:11 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:20:39.046 02:40:11 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:39.046 02:40:11 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:20:39.046 02:40:11 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:20:39.046 02:40:11 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:20:39.046 65: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:20:39.046 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:20:39.046 altname enp24s0f1np1 00:20:39.046 altname ens785f1np1 00:20:39.046 inet 192.168.100.9/24 scope global mlx_0_1 00:20:39.046 valid_lft forever preferred_lft forever 00:20:39.046 02:40:11 -- nvmf/common.sh@411 -- # return 0 00:20:39.046 02:40:11 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:20:39.046 02:40:11 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:20:39.046 02:40:11 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:20:39.046 02:40:11 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:20:39.046 02:40:11 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:20:39.046 02:40:11 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:20:39.046 02:40:11 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:20:39.046 02:40:11 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:20:39.046 02:40:11 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:20:39.046 02:40:11 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:20:39.046 02:40:11 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:39.046 02:40:11 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:39.046 02:40:11 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:20:39.046 02:40:11 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:20:39.046 02:40:11 -- nvmf/common.sh@105 -- # continue 2 00:20:39.046 02:40:11 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:39.046 02:40:11 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:39.046 02:40:11 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:20:39.046 02:40:11 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:39.046 02:40:11 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:20:39.046 02:40:11 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:20:39.046 02:40:11 -- nvmf/common.sh@105 -- # continue 2 00:20:39.046 02:40:11 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:20:39.046 02:40:11 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:20:39.046 02:40:11 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:20:39.046 02:40:11 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:39.046 02:40:11 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:20:39.046 02:40:11 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:39.046 02:40:11 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:20:39.046 02:40:11 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:20:39.046 02:40:11 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:20:39.046 02:40:11 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:20:39.046 02:40:11 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:39.046 02:40:11 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:39.046 02:40:11 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:20:39.046 192.168.100.9' 00:20:39.046 02:40:11 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:20:39.046 192.168.100.9' 00:20:39.046 02:40:11 -- nvmf/common.sh@446 -- # head -n 1 00:20:39.046 02:40:11 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:20:39.046 02:40:11 -- nvmf/common.sh@447 -- # tail -n +2 00:20:39.046 02:40:11 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:20:39.046 192.168.100.9' 00:20:39.046 02:40:11 -- nvmf/common.sh@447 -- # head -n 1 00:20:39.046 02:40:11 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:20:39.046 02:40:11 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:20:39.046 02:40:11 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:20:39.046 02:40:12 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:20:39.046 02:40:12 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:20:39.046 02:40:12 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:20:39.046 02:40:12 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:20:39.046 02:40:12 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:20:39.046 02:40:12 -- common/autotest_common.sh@710 -- # xtrace_disable 00:20:39.046 02:40:12 -- common/autotest_common.sh@10 -- # set +x 00:20:39.046 02:40:12 -- nvmf/common.sh@470 -- # nvmfpid=1602322 00:20:39.046 02:40:12 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:20:39.046 02:40:12 -- nvmf/common.sh@471 -- # waitforlisten 1602322 00:20:39.046 02:40:12 -- common/autotest_common.sh@817 -- # '[' -z 1602322 ']' 00:20:39.046 02:40:12 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:39.046 02:40:12 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:39.046 02:40:12 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:39.046 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:39.046 02:40:12 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:39.046 02:40:12 -- common/autotest_common.sh@10 -- # set +x 00:20:39.046 [2024-04-27 02:40:12.085277] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:20:39.046 [2024-04-27 02:40:12.085347] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:39.046 EAL: No free 2048 kB hugepages reported on node 1 00:20:39.046 [2024-04-27 02:40:12.161507] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:39.046 [2024-04-27 02:40:12.251786] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:39.047 [2024-04-27 02:40:12.251828] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:39.047 [2024-04-27 02:40:12.251838] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:20:39.047 [2024-04-27 02:40:12.251847] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:20:39.047 [2024-04-27 02:40:12.251855] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:39.047 [2024-04-27 02:40:12.251877] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:39.305 02:40:12 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:39.305 02:40:12 -- common/autotest_common.sh@850 -- # return 0 00:20:39.305 02:40:12 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:20:39.305 02:40:12 -- common/autotest_common.sh@716 -- # xtrace_disable 00:20:39.305 02:40:12 -- common/autotest_common.sh@10 -- # set +x 00:20:39.563 02:40:12 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:39.563 02:40:12 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:20:39.563 02:40:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:39.563 02:40:12 -- common/autotest_common.sh@10 -- # set +x 00:20:39.563 [2024-04-27 02:40:12.967080] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x11423e0/0x11468d0) succeed. 00:20:39.563 [2024-04-27 02:40:12.975921] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x11438e0/0x1187f60) succeed. 00:20:39.563 02:40:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:39.563 02:40:13 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:20:39.563 02:40:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:39.563 02:40:13 -- common/autotest_common.sh@10 -- # set +x 00:20:39.563 null0 00:20:39.563 02:40:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:39.563 02:40:13 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:20:39.563 02:40:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:39.563 02:40:13 -- common/autotest_common.sh@10 -- # set +x 00:20:39.563 02:40:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:39.563 02:40:13 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:20:39.563 02:40:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:39.563 02:40:13 -- common/autotest_common.sh@10 -- # set +x 00:20:39.563 02:40:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:39.563 02:40:13 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g 94a3670f9e6b4026b806f40b09b0f206 00:20:39.563 02:40:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:39.563 02:40:13 -- common/autotest_common.sh@10 -- # set +x 00:20:39.563 02:40:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:39.563 02:40:13 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:20:39.563 02:40:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:39.563 02:40:13 -- common/autotest_common.sh@10 -- # set +x 00:20:39.563 [2024-04-27 02:40:13.066644] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:20:39.563 02:40:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:39.563 02:40:13 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -a 192.168.100.8 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:20:39.563 02:40:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:39.563 02:40:13 -- common/autotest_common.sh@10 -- # set +x 00:20:39.563 nvme0n1 00:20:39.563 02:40:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:39.563 02:40:13 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:20:39.563 02:40:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:39.563 02:40:13 -- common/autotest_common.sh@10 -- # set +x 00:20:39.563 [ 00:20:39.563 { 00:20:39.563 "name": "nvme0n1", 00:20:39.563 "aliases": [ 00:20:39.563 "94a3670f-9e6b-4026-b806-f40b09b0f206" 00:20:39.563 ], 00:20:39.563 "product_name": "NVMe disk", 00:20:39.563 "block_size": 512, 00:20:39.563 "num_blocks": 2097152, 00:20:39.563 "uuid": "94a3670f-9e6b-4026-b806-f40b09b0f206", 00:20:39.563 "assigned_rate_limits": { 00:20:39.563 "rw_ios_per_sec": 0, 00:20:39.563 "rw_mbytes_per_sec": 0, 00:20:39.563 "r_mbytes_per_sec": 0, 00:20:39.563 "w_mbytes_per_sec": 0 00:20:39.563 }, 00:20:39.563 "claimed": false, 00:20:39.563 "zoned": false, 00:20:39.563 "supported_io_types": { 00:20:39.563 "read": true, 00:20:39.563 "write": true, 00:20:39.563 "unmap": false, 00:20:39.563 "write_zeroes": true, 00:20:39.563 "flush": true, 00:20:39.563 "reset": true, 00:20:39.563 "compare": true, 00:20:39.563 "compare_and_write": true, 00:20:39.563 "abort": true, 00:20:39.563 "nvme_admin": true, 00:20:39.563 "nvme_io": true 00:20:39.563 }, 00:20:39.563 "memory_domains": [ 00:20:39.563 { 00:20:39.563 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:20:39.563 "dma_device_type": 0 00:20:39.563 } 00:20:39.563 ], 00:20:39.563 "driver_specific": { 00:20:39.563 "nvme": [ 00:20:39.563 { 00:20:39.563 "trid": { 00:20:39.563 "trtype": "RDMA", 00:20:39.563 "adrfam": "IPv4", 00:20:39.563 "traddr": "192.168.100.8", 00:20:39.563 "trsvcid": "4420", 00:20:39.563 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:20:39.563 }, 00:20:39.563 "ctrlr_data": { 00:20:39.563 "cntlid": 1, 00:20:39.563 "vendor_id": "0x8086", 00:20:39.563 "model_number": "SPDK bdev Controller", 00:20:39.563 "serial_number": "00000000000000000000", 00:20:39.563 "firmware_revision": "24.05", 00:20:39.563 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:20:39.563 "oacs": { 00:20:39.563 "security": 0, 00:20:39.563 "format": 0, 00:20:39.563 "firmware": 0, 00:20:39.563 "ns_manage": 0 00:20:39.563 }, 00:20:39.563 "multi_ctrlr": true, 00:20:39.563 "ana_reporting": false 00:20:39.563 }, 00:20:39.563 "vs": { 00:20:39.563 "nvme_version": "1.3" 00:20:39.563 }, 00:20:39.563 "ns_data": { 00:20:39.563 "id": 1, 00:20:39.563 "can_share": true 00:20:39.563 } 00:20:39.563 } 00:20:39.563 ], 00:20:39.563 "mp_policy": "active_passive" 00:20:39.563 } 00:20:39.563 } 00:20:39.563 ] 00:20:39.563 02:40:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:39.563 02:40:13 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:20:39.563 02:40:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:39.563 02:40:13 -- common/autotest_common.sh@10 -- # set +x 00:20:39.563 [2024-04-27 02:40:13.171891] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:20:39.822 [2024-04-27 02:40:13.190359] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:20:39.822 [2024-04-27 02:40:13.211842] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:20:39.822 02:40:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:39.822 02:40:13 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:20:39.822 02:40:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:39.822 02:40:13 -- common/autotest_common.sh@10 -- # set +x 00:20:39.822 [ 00:20:39.822 { 00:20:39.822 "name": "nvme0n1", 00:20:39.822 "aliases": [ 00:20:39.822 "94a3670f-9e6b-4026-b806-f40b09b0f206" 00:20:39.822 ], 00:20:39.822 "product_name": "NVMe disk", 00:20:39.822 "block_size": 512, 00:20:39.822 "num_blocks": 2097152, 00:20:39.822 "uuid": "94a3670f-9e6b-4026-b806-f40b09b0f206", 00:20:39.822 "assigned_rate_limits": { 00:20:39.822 "rw_ios_per_sec": 0, 00:20:39.822 "rw_mbytes_per_sec": 0, 00:20:39.822 "r_mbytes_per_sec": 0, 00:20:39.822 "w_mbytes_per_sec": 0 00:20:39.822 }, 00:20:39.822 "claimed": false, 00:20:39.822 "zoned": false, 00:20:39.822 "supported_io_types": { 00:20:39.822 "read": true, 00:20:39.822 "write": true, 00:20:39.822 "unmap": false, 00:20:39.822 "write_zeroes": true, 00:20:39.822 "flush": true, 00:20:39.822 "reset": true, 00:20:39.822 "compare": true, 00:20:39.822 "compare_and_write": true, 00:20:39.822 "abort": true, 00:20:39.822 "nvme_admin": true, 00:20:39.822 "nvme_io": true 00:20:39.822 }, 00:20:39.822 "memory_domains": [ 00:20:39.822 { 00:20:39.822 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:20:39.822 "dma_device_type": 0 00:20:39.822 } 00:20:39.822 ], 00:20:39.822 "driver_specific": { 00:20:39.822 "nvme": [ 00:20:39.822 { 00:20:39.822 "trid": { 00:20:39.822 "trtype": "RDMA", 00:20:39.822 "adrfam": "IPv4", 00:20:39.822 "traddr": "192.168.100.8", 00:20:39.822 "trsvcid": "4420", 00:20:39.822 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:20:39.822 }, 00:20:39.822 "ctrlr_data": { 00:20:39.822 "cntlid": 2, 00:20:39.822 "vendor_id": "0x8086", 00:20:39.822 "model_number": "SPDK bdev Controller", 00:20:39.822 "serial_number": "00000000000000000000", 00:20:39.822 "firmware_revision": "24.05", 00:20:39.822 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:20:39.822 "oacs": { 00:20:39.822 "security": 0, 00:20:39.822 "format": 0, 00:20:39.822 "firmware": 0, 00:20:39.822 "ns_manage": 0 00:20:39.822 }, 00:20:39.822 "multi_ctrlr": true, 00:20:39.822 "ana_reporting": false 00:20:39.822 }, 00:20:39.822 "vs": { 00:20:39.822 "nvme_version": "1.3" 00:20:39.822 }, 00:20:39.822 "ns_data": { 00:20:39.822 "id": 1, 00:20:39.822 "can_share": true 00:20:39.822 } 00:20:39.822 } 00:20:39.822 ], 00:20:39.822 "mp_policy": "active_passive" 00:20:39.822 } 00:20:39.822 } 00:20:39.822 ] 00:20:39.822 02:40:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:39.822 02:40:13 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:39.822 02:40:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:39.822 02:40:13 -- common/autotest_common.sh@10 -- # set +x 00:20:39.822 02:40:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:39.822 02:40:13 -- host/async_init.sh@53 -- # mktemp 00:20:39.822 02:40:13 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.P7jh5nYsPw 00:20:39.822 02:40:13 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:20:39.822 02:40:13 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.P7jh5nYsPw 00:20:39.822 02:40:13 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:20:39.822 02:40:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:39.822 02:40:13 -- common/autotest_common.sh@10 -- # set +x 00:20:39.822 02:40:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:39.822 02:40:13 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4421 --secure-channel 00:20:39.822 02:40:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:39.822 02:40:13 -- common/autotest_common.sh@10 -- # set +x 00:20:39.822 [2024-04-27 02:40:13.294746] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4421 *** 00:20:39.822 02:40:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:39.822 02:40:13 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.P7jh5nYsPw 00:20:39.822 02:40:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:39.822 02:40:13 -- common/autotest_common.sh@10 -- # set +x 00:20:39.822 02:40:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:39.822 02:40:13 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -a 192.168.100.8 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.P7jh5nYsPw 00:20:39.822 02:40:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:39.822 02:40:13 -- common/autotest_common.sh@10 -- # set +x 00:20:39.822 [2024-04-27 02:40:13.310770] bdev_nvme_rpc.c: 515:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:39.822 nvme0n1 00:20:39.822 02:40:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:39.822 02:40:13 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:20:39.822 02:40:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:39.822 02:40:13 -- common/autotest_common.sh@10 -- # set +x 00:20:39.822 [ 00:20:39.822 { 00:20:39.822 "name": "nvme0n1", 00:20:39.822 "aliases": [ 00:20:39.822 "94a3670f-9e6b-4026-b806-f40b09b0f206" 00:20:39.822 ], 00:20:39.822 "product_name": "NVMe disk", 00:20:39.822 "block_size": 512, 00:20:39.822 "num_blocks": 2097152, 00:20:39.822 "uuid": "94a3670f-9e6b-4026-b806-f40b09b0f206", 00:20:39.822 "assigned_rate_limits": { 00:20:39.822 "rw_ios_per_sec": 0, 00:20:39.822 "rw_mbytes_per_sec": 0, 00:20:39.822 "r_mbytes_per_sec": 0, 00:20:39.822 "w_mbytes_per_sec": 0 00:20:39.822 }, 00:20:39.822 "claimed": false, 00:20:39.822 "zoned": false, 00:20:39.822 "supported_io_types": { 00:20:39.822 "read": true, 00:20:39.822 "write": true, 00:20:39.822 "unmap": false, 00:20:39.822 "write_zeroes": true, 00:20:39.822 "flush": true, 00:20:39.822 "reset": true, 00:20:39.822 "compare": true, 00:20:39.822 "compare_and_write": true, 00:20:39.822 "abort": true, 00:20:39.822 "nvme_admin": true, 00:20:39.822 "nvme_io": true 00:20:39.822 }, 00:20:39.822 "memory_domains": [ 00:20:39.822 { 00:20:39.822 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:20:39.822 "dma_device_type": 0 00:20:39.822 } 00:20:39.822 ], 00:20:39.822 "driver_specific": { 00:20:39.822 "nvme": [ 00:20:39.822 { 00:20:39.822 "trid": { 00:20:39.822 "trtype": "RDMA", 00:20:39.822 "adrfam": "IPv4", 00:20:39.822 "traddr": "192.168.100.8", 00:20:39.822 "trsvcid": "4421", 00:20:39.822 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:20:39.822 }, 00:20:39.823 "ctrlr_data": { 00:20:39.823 "cntlid": 3, 00:20:39.823 "vendor_id": "0x8086", 00:20:39.823 "model_number": "SPDK bdev Controller", 00:20:39.823 "serial_number": "00000000000000000000", 00:20:39.823 "firmware_revision": "24.05", 00:20:39.823 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:20:39.823 "oacs": { 00:20:39.823 "security": 0, 00:20:39.823 "format": 0, 00:20:39.823 "firmware": 0, 00:20:39.823 "ns_manage": 0 00:20:39.823 }, 00:20:39.823 "multi_ctrlr": true, 00:20:39.823 "ana_reporting": false 00:20:39.823 }, 00:20:39.823 "vs": { 00:20:39.823 "nvme_version": "1.3" 00:20:39.823 }, 00:20:39.823 "ns_data": { 00:20:39.823 "id": 1, 00:20:39.823 "can_share": true 00:20:39.823 } 00:20:39.823 } 00:20:39.823 ], 00:20:39.823 "mp_policy": "active_passive" 00:20:39.823 } 00:20:39.823 } 00:20:39.823 ] 00:20:39.823 02:40:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:39.823 02:40:13 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:39.823 02:40:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:39.823 02:40:13 -- common/autotest_common.sh@10 -- # set +x 00:20:39.823 02:40:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:39.823 02:40:13 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.P7jh5nYsPw 00:20:39.823 02:40:13 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:20:39.823 02:40:13 -- host/async_init.sh@78 -- # nvmftestfini 00:20:40.081 02:40:13 -- nvmf/common.sh@477 -- # nvmfcleanup 00:20:40.082 02:40:13 -- nvmf/common.sh@117 -- # sync 00:20:40.082 02:40:13 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:20:40.082 02:40:13 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:20:40.082 02:40:13 -- nvmf/common.sh@120 -- # set +e 00:20:40.082 02:40:13 -- nvmf/common.sh@121 -- # for i in {1..20} 00:20:40.082 02:40:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:20:40.082 rmmod nvme_rdma 00:20:40.082 rmmod nvme_fabrics 00:20:40.082 02:40:13 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:20:40.082 02:40:13 -- nvmf/common.sh@124 -- # set -e 00:20:40.082 02:40:13 -- nvmf/common.sh@125 -- # return 0 00:20:40.082 02:40:13 -- nvmf/common.sh@478 -- # '[' -n 1602322 ']' 00:20:40.082 02:40:13 -- nvmf/common.sh@479 -- # killprocess 1602322 00:20:40.082 02:40:13 -- common/autotest_common.sh@936 -- # '[' -z 1602322 ']' 00:20:40.082 02:40:13 -- common/autotest_common.sh@940 -- # kill -0 1602322 00:20:40.082 02:40:13 -- common/autotest_common.sh@941 -- # uname 00:20:40.082 02:40:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:40.082 02:40:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1602322 00:20:40.082 02:40:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:20:40.082 02:40:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:20:40.082 02:40:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1602322' 00:20:40.082 killing process with pid 1602322 00:20:40.082 02:40:13 -- common/autotest_common.sh@955 -- # kill 1602322 00:20:40.082 02:40:13 -- common/autotest_common.sh@960 -- # wait 1602322 00:20:40.082 [2024-04-27 02:40:13.579470] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:20:40.339 02:40:13 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:20:40.339 02:40:13 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:20:40.339 00:20:40.339 real 0m7.951s 00:20:40.339 user 0m3.678s 00:20:40.339 sys 0m5.009s 00:20:40.339 02:40:13 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:20:40.339 02:40:13 -- common/autotest_common.sh@10 -- # set +x 00:20:40.339 ************************************ 00:20:40.339 END TEST nvmf_async_init 00:20:40.339 ************************************ 00:20:40.339 02:40:13 -- nvmf/nvmf.sh@92 -- # run_test dma /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=rdma 00:20:40.339 02:40:13 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:40.339 02:40:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:40.339 02:40:13 -- common/autotest_common.sh@10 -- # set +x 00:20:40.598 ************************************ 00:20:40.598 START TEST dma 00:20:40.598 ************************************ 00:20:40.598 02:40:13 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=rdma 00:20:40.598 * Looking for test storage... 00:20:40.598 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:20:40.598 02:40:14 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:20:40.598 02:40:14 -- nvmf/common.sh@7 -- # uname -s 00:20:40.598 02:40:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:40.598 02:40:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:40.598 02:40:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:40.598 02:40:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:40.598 02:40:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:40.598 02:40:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:40.598 02:40:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:40.598 02:40:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:40.598 02:40:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:40.598 02:40:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:40.598 02:40:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:20:40.598 02:40:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:20:40.598 02:40:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:40.598 02:40:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:40.598 02:40:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:40.598 02:40:14 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:20:40.598 02:40:14 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:20:40.598 02:40:14 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:40.598 02:40:14 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:40.598 02:40:14 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:40.599 02:40:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:40.599 02:40:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:40.599 02:40:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:40.599 02:40:14 -- paths/export.sh@5 -- # export PATH 00:20:40.599 02:40:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:40.599 02:40:14 -- nvmf/common.sh@47 -- # : 0 00:20:40.599 02:40:14 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:20:40.599 02:40:14 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:20:40.599 02:40:14 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:20:40.599 02:40:14 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:40.599 02:40:14 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:40.599 02:40:14 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:20:40.599 02:40:14 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:20:40.599 02:40:14 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:20:40.599 02:40:14 -- host/dma.sh@12 -- # '[' rdma '!=' rdma ']' 00:20:40.599 02:40:14 -- host/dma.sh@16 -- # MALLOC_BDEV_SIZE=256 00:20:40.599 02:40:14 -- host/dma.sh@17 -- # MALLOC_BLOCK_SIZE=512 00:20:40.599 02:40:14 -- host/dma.sh@18 -- # subsystem=0 00:20:40.599 02:40:14 -- host/dma.sh@93 -- # nvmftestinit 00:20:40.599 02:40:14 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:20:40.599 02:40:14 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:40.599 02:40:14 -- nvmf/common.sh@437 -- # prepare_net_devs 00:20:40.599 02:40:14 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:20:40.599 02:40:14 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:20:40.599 02:40:14 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:40.599 02:40:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:40.599 02:40:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:40.599 02:40:14 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:20:40.599 02:40:14 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:20:40.599 02:40:14 -- nvmf/common.sh@285 -- # xtrace_disable 00:20:40.599 02:40:14 -- common/autotest_common.sh@10 -- # set +x 00:20:47.170 02:40:19 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:47.170 02:40:19 -- nvmf/common.sh@291 -- # pci_devs=() 00:20:47.170 02:40:19 -- nvmf/common.sh@291 -- # local -a pci_devs 00:20:47.170 02:40:19 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:20:47.170 02:40:19 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:20:47.170 02:40:19 -- nvmf/common.sh@293 -- # pci_drivers=() 00:20:47.170 02:40:19 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:20:47.170 02:40:19 -- nvmf/common.sh@295 -- # net_devs=() 00:20:47.170 02:40:19 -- nvmf/common.sh@295 -- # local -ga net_devs 00:20:47.170 02:40:19 -- nvmf/common.sh@296 -- # e810=() 00:20:47.170 02:40:19 -- nvmf/common.sh@296 -- # local -ga e810 00:20:47.170 02:40:19 -- nvmf/common.sh@297 -- # x722=() 00:20:47.170 02:40:19 -- nvmf/common.sh@297 -- # local -ga x722 00:20:47.170 02:40:19 -- nvmf/common.sh@298 -- # mlx=() 00:20:47.170 02:40:19 -- nvmf/common.sh@298 -- # local -ga mlx 00:20:47.170 02:40:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:47.170 02:40:19 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:47.170 02:40:19 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:47.170 02:40:19 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:47.170 02:40:19 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:47.170 02:40:19 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:47.170 02:40:19 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:47.170 02:40:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:47.170 02:40:19 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:47.170 02:40:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:47.170 02:40:19 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:47.170 02:40:19 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:20:47.170 02:40:19 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:20:47.170 02:40:19 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:20:47.170 02:40:19 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:20:47.170 02:40:19 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:20:47.170 02:40:19 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:20:47.170 02:40:19 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:20:47.170 02:40:19 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:20:47.170 02:40:19 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:20:47.170 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:20:47.170 02:40:19 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:20:47.170 02:40:19 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:20:47.170 02:40:19 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:20:47.170 02:40:19 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:20:47.170 02:40:19 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:20:47.170 02:40:19 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:20:47.170 02:40:19 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:20:47.170 02:40:19 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:20:47.170 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:20:47.170 02:40:19 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:20:47.170 02:40:19 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:20:47.170 02:40:19 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:20:47.170 02:40:19 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:20:47.170 02:40:19 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:20:47.170 02:40:19 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:20:47.170 02:40:19 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:20:47.170 02:40:19 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:20:47.170 02:40:19 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:20:47.170 02:40:19 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:47.170 02:40:19 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:20:47.170 02:40:19 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:47.170 02:40:19 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:20:47.170 Found net devices under 0000:18:00.0: mlx_0_0 00:20:47.170 02:40:19 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:20:47.170 02:40:19 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:20:47.170 02:40:19 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:47.170 02:40:19 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:20:47.170 02:40:19 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:47.170 02:40:19 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:20:47.170 Found net devices under 0000:18:00.1: mlx_0_1 00:20:47.170 02:40:19 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:20:47.170 02:40:19 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:20:47.170 02:40:19 -- nvmf/common.sh@403 -- # is_hw=yes 00:20:47.170 02:40:19 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:20:47.170 02:40:19 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:20:47.170 02:40:19 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:20:47.170 02:40:19 -- nvmf/common.sh@409 -- # rdma_device_init 00:20:47.170 02:40:19 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:20:47.170 02:40:19 -- nvmf/common.sh@58 -- # uname 00:20:47.170 02:40:19 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:20:47.170 02:40:19 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:20:47.170 02:40:19 -- nvmf/common.sh@63 -- # modprobe ib_core 00:20:47.170 02:40:19 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:20:47.170 02:40:19 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:20:47.170 02:40:19 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:20:47.170 02:40:19 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:20:47.170 02:40:19 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:20:47.170 02:40:19 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:20:47.170 02:40:19 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:20:47.170 02:40:19 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:20:47.170 02:40:19 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:20:47.170 02:40:19 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:20:47.170 02:40:19 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:20:47.170 02:40:19 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:20:47.170 02:40:19 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:20:47.170 02:40:19 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:47.170 02:40:19 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:47.170 02:40:19 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:20:47.170 02:40:19 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:20:47.170 02:40:19 -- nvmf/common.sh@105 -- # continue 2 00:20:47.170 02:40:19 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:47.170 02:40:19 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:47.170 02:40:19 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:20:47.170 02:40:19 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:47.170 02:40:19 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:20:47.170 02:40:19 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:20:47.170 02:40:19 -- nvmf/common.sh@105 -- # continue 2 00:20:47.170 02:40:19 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:20:47.170 02:40:19 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:20:47.170 02:40:19 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:20:47.170 02:40:19 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:20:47.170 02:40:19 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:47.170 02:40:19 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:47.170 02:40:19 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:20:47.170 02:40:19 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:20:47.170 02:40:19 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:20:47.170 64: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:20:47.170 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:20:47.170 altname enp24s0f0np0 00:20:47.170 altname ens785f0np0 00:20:47.170 inet 192.168.100.8/24 scope global mlx_0_0 00:20:47.170 valid_lft forever preferred_lft forever 00:20:47.170 02:40:19 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:20:47.170 02:40:19 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:20:47.170 02:40:19 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:20:47.170 02:40:19 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:20:47.170 02:40:19 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:47.170 02:40:19 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:47.170 02:40:19 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:20:47.170 02:40:19 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:20:47.170 02:40:19 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:20:47.170 65: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:20:47.170 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:20:47.170 altname enp24s0f1np1 00:20:47.170 altname ens785f1np1 00:20:47.170 inet 192.168.100.9/24 scope global mlx_0_1 00:20:47.170 valid_lft forever preferred_lft forever 00:20:47.170 02:40:19 -- nvmf/common.sh@411 -- # return 0 00:20:47.170 02:40:19 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:20:47.170 02:40:19 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:20:47.170 02:40:19 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:20:47.170 02:40:19 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:20:47.170 02:40:19 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:20:47.170 02:40:19 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:20:47.170 02:40:19 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:20:47.170 02:40:19 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:20:47.171 02:40:19 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:20:47.171 02:40:19 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:20:47.171 02:40:19 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:47.171 02:40:19 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:47.171 02:40:19 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:20:47.171 02:40:19 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:20:47.171 02:40:19 -- nvmf/common.sh@105 -- # continue 2 00:20:47.171 02:40:19 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:47.171 02:40:19 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:47.171 02:40:19 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:20:47.171 02:40:19 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:47.171 02:40:19 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:20:47.171 02:40:19 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:20:47.171 02:40:19 -- nvmf/common.sh@105 -- # continue 2 00:20:47.171 02:40:19 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:20:47.171 02:40:19 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:20:47.171 02:40:19 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:20:47.171 02:40:19 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:20:47.171 02:40:19 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:47.171 02:40:19 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:47.171 02:40:19 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:20:47.171 02:40:19 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:20:47.171 02:40:19 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:20:47.171 02:40:19 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:20:47.171 02:40:19 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:47.171 02:40:19 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:47.171 02:40:19 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:20:47.171 192.168.100.9' 00:20:47.171 02:40:19 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:20:47.171 192.168.100.9' 00:20:47.171 02:40:19 -- nvmf/common.sh@446 -- # head -n 1 00:20:47.171 02:40:19 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:20:47.171 02:40:19 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:20:47.171 192.168.100.9' 00:20:47.171 02:40:19 -- nvmf/common.sh@447 -- # head -n 1 00:20:47.171 02:40:19 -- nvmf/common.sh@447 -- # tail -n +2 00:20:47.171 02:40:19 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:20:47.171 02:40:19 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:20:47.171 02:40:19 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:20:47.171 02:40:19 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:20:47.171 02:40:19 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:20:47.171 02:40:19 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:20:47.171 02:40:19 -- host/dma.sh@94 -- # nvmfappstart -m 0x3 00:20:47.171 02:40:19 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:20:47.171 02:40:19 -- common/autotest_common.sh@710 -- # xtrace_disable 00:20:47.171 02:40:19 -- common/autotest_common.sh@10 -- # set +x 00:20:47.171 02:40:19 -- nvmf/common.sh@470 -- # nvmfpid=1605408 00:20:47.171 02:40:19 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:20:47.171 02:40:19 -- nvmf/common.sh@471 -- # waitforlisten 1605408 00:20:47.171 02:40:19 -- common/autotest_common.sh@817 -- # '[' -z 1605408 ']' 00:20:47.171 02:40:19 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:47.171 02:40:19 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:47.171 02:40:19 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:47.171 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:47.171 02:40:19 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:47.171 02:40:19 -- common/autotest_common.sh@10 -- # set +x 00:20:47.171 [2024-04-27 02:40:19.883719] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:20:47.171 [2024-04-27 02:40:19.883782] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:47.171 EAL: No free 2048 kB hugepages reported on node 1 00:20:47.171 [2024-04-27 02:40:19.955275] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:20:47.171 [2024-04-27 02:40:20.048150] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:47.171 [2024-04-27 02:40:20.048195] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:47.171 [2024-04-27 02:40:20.048205] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:20:47.171 [2024-04-27 02:40:20.048213] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:20:47.171 [2024-04-27 02:40:20.048221] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:47.171 [2024-04-27 02:40:20.048283] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:47.171 [2024-04-27 02:40:20.048285] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:47.171 02:40:20 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:47.171 02:40:20 -- common/autotest_common.sh@850 -- # return 0 00:20:47.171 02:40:20 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:20:47.171 02:40:20 -- common/autotest_common.sh@716 -- # xtrace_disable 00:20:47.171 02:40:20 -- common/autotest_common.sh@10 -- # set +x 00:20:47.171 02:40:20 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:47.171 02:40:20 -- host/dma.sh@96 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:20:47.171 02:40:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:47.171 02:40:20 -- common/autotest_common.sh@10 -- # set +x 00:20:47.171 [2024-04-27 02:40:20.767224] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1598f40/0x159d430) succeed. 00:20:47.171 [2024-04-27 02:40:20.776481] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x159a440/0x15deac0) succeed. 00:20:47.430 02:40:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:47.430 02:40:20 -- host/dma.sh@97 -- # rpc_cmd bdev_malloc_create 256 512 -b Malloc0 00:20:47.430 02:40:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:47.430 02:40:20 -- common/autotest_common.sh@10 -- # set +x 00:20:47.430 Malloc0 00:20:47.430 02:40:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:47.430 02:40:20 -- host/dma.sh@98 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK00000000000001 00:20:47.430 02:40:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:47.430 02:40:20 -- common/autotest_common.sh@10 -- # set +x 00:20:47.430 02:40:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:47.430 02:40:20 -- host/dma.sh@99 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Malloc0 00:20:47.430 02:40:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:47.430 02:40:20 -- common/autotest_common.sh@10 -- # set +x 00:20:47.430 02:40:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:47.430 02:40:20 -- host/dma.sh@100 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:20:47.430 02:40:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:47.430 02:40:20 -- common/autotest_common.sh@10 -- # set +x 00:20:47.430 [2024-04-27 02:40:20.951107] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:20:47.430 02:40:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:47.430 02:40:20 -- host/dma.sh@104 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dma/test_dma/test_dma -q 16 -o 4096 -w randrw -M 70 -t 5 -m 0xc --json /dev/fd/62 -b Nvme0n1 -f -x translate 00:20:47.430 02:40:20 -- host/dma.sh@104 -- # gen_nvmf_target_json 0 00:20:47.430 02:40:20 -- nvmf/common.sh@521 -- # config=() 00:20:47.430 02:40:20 -- nvmf/common.sh@521 -- # local subsystem config 00:20:47.430 02:40:20 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:20:47.430 02:40:20 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:20:47.430 { 00:20:47.430 "params": { 00:20:47.430 "name": "Nvme$subsystem", 00:20:47.430 "trtype": "$TEST_TRANSPORT", 00:20:47.430 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:47.430 "adrfam": "ipv4", 00:20:47.430 "trsvcid": "$NVMF_PORT", 00:20:47.430 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:47.430 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:47.430 "hdgst": ${hdgst:-false}, 00:20:47.430 "ddgst": ${ddgst:-false} 00:20:47.430 }, 00:20:47.430 "method": "bdev_nvme_attach_controller" 00:20:47.430 } 00:20:47.430 EOF 00:20:47.430 )") 00:20:47.430 02:40:20 -- nvmf/common.sh@543 -- # cat 00:20:47.430 02:40:20 -- nvmf/common.sh@545 -- # jq . 00:20:47.430 02:40:20 -- nvmf/common.sh@546 -- # IFS=, 00:20:47.430 02:40:20 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:20:47.430 "params": { 00:20:47.430 "name": "Nvme0", 00:20:47.430 "trtype": "rdma", 00:20:47.430 "traddr": "192.168.100.8", 00:20:47.430 "adrfam": "ipv4", 00:20:47.430 "trsvcid": "4420", 00:20:47.430 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:20:47.430 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:20:47.430 "hdgst": false, 00:20:47.430 "ddgst": false 00:20:47.430 }, 00:20:47.430 "method": "bdev_nvme_attach_controller" 00:20:47.430 }' 00:20:47.430 [2024-04-27 02:40:21.000023] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:20:47.430 [2024-04-27 02:40:21.000086] [ DPDK EAL parameters: test_dma --no-shconf -c 0xc --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1605607 ] 00:20:47.430 EAL: No free 2048 kB hugepages reported on node 1 00:20:47.689 [2024-04-27 02:40:21.070223] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:20:47.689 [2024-04-27 02:40:21.159122] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:47.689 [2024-04-27 02:40:21.159124] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:52.963 bdev Nvme0n1 reports 1 memory domains 00:20:52.963 bdev Nvme0n1 supports RDMA memory domain 00:20:52.963 Initialization complete, running randrw IO for 5 sec on 2 cores 00:20:52.963 ========================================================================== 00:20:52.963 Latency [us] 00:20:52.963 IOPS MiB/s Average min max 00:20:52.963 Core 2: 21749.36 84.96 734.74 246.41 9044.40 00:20:52.963 Core 3: 21817.33 85.22 732.47 241.96 9049.09 00:20:52.963 ========================================================================== 00:20:52.963 Total : 43566.69 170.18 733.60 241.96 9049.09 00:20:52.963 00:20:52.963 Total operations: 217912, translate 217912 pull_push 0 memzero 0 00:20:53.223 02:40:26 -- host/dma.sh@107 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dma/test_dma/test_dma -q 16 -o 4096 -w randrw -M 70 -t 5 -m 0xc --json /dev/fd/62 -b Malloc0 -x pull_push 00:20:53.223 02:40:26 -- host/dma.sh@107 -- # gen_malloc_json 00:20:53.223 02:40:26 -- host/dma.sh@21 -- # jq . 00:20:53.223 [2024-04-27 02:40:26.633239] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:20:53.223 [2024-04-27 02:40:26.633301] [ DPDK EAL parameters: test_dma --no-shconf -c 0xc --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1606337 ] 00:20:53.223 EAL: No free 2048 kB hugepages reported on node 1 00:20:53.223 [2024-04-27 02:40:26.699519] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:20:53.223 [2024-04-27 02:40:26.779265] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:53.223 [2024-04-27 02:40:26.779267] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:59.795 bdev Malloc0 reports 2 memory domains 00:20:59.796 bdev Malloc0 doesn't support RDMA memory domain 00:20:59.796 Initialization complete, running randrw IO for 5 sec on 2 cores 00:20:59.796 ========================================================================== 00:20:59.796 Latency [us] 00:20:59.796 IOPS MiB/s Average min max 00:20:59.796 Core 2: 14680.84 57.35 1089.10 474.27 1407.40 00:20:59.796 Core 3: 14671.04 57.31 1089.82 438.79 2123.75 00:20:59.796 ========================================================================== 00:20:59.796 Total : 29351.88 114.66 1089.46 438.79 2123.75 00:20:59.796 00:20:59.796 Total operations: 146817, translate 0 pull_push 587268 memzero 0 00:20:59.796 02:40:32 -- host/dma.sh@110 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dma/test_dma/test_dma -q 16 -o 4096 -w randread -M 70 -t 5 -m 0xc --json /dev/fd/62 -b lvs0/lvol0 -f -x memzero 00:20:59.796 02:40:32 -- host/dma.sh@110 -- # gen_lvol_nvme_json 0 00:20:59.796 02:40:32 -- host/dma.sh@48 -- # local subsystem=0 00:20:59.796 02:40:32 -- host/dma.sh@50 -- # jq . 00:20:59.796 Ignoring -M option 00:20:59.796 [2024-04-27 02:40:32.200892] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:20:59.796 [2024-04-27 02:40:32.200952] [ DPDK EAL parameters: test_dma --no-shconf -c 0xc --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1607059 ] 00:20:59.796 EAL: No free 2048 kB hugepages reported on node 1 00:20:59.796 [2024-04-27 02:40:32.269865] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:20:59.796 [2024-04-27 02:40:32.353075] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:59.796 [2024-04-27 02:40:32.353077] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:59.796 [2024-04-27 02:40:32.580279] vbdev_lvol_rpc.c: 347:rpc_bdev_lvol_create: *WARNING*: vbdev_lvol_rpc_req_size: deprecated feature rpc_bdev_lvol_create/resize req.size to be removed in v23.09 00:21:04.027 [2024-04-27 02:40:37.608110] app.c: 937:log_deprecation_hits: *WARNING*: vbdev_lvol_rpc_req_size: deprecation 'rpc_bdev_lvol_create/resize req.size' scheduled for removal in v23.09 hit 1 times 00:21:04.286 bdev 1fe56daa-80d8-4be1-90dc-9ecfd08d68c9 reports 1 memory domains 00:21:04.286 bdev 1fe56daa-80d8-4be1-90dc-9ecfd08d68c9 supports RDMA memory domain 00:21:04.286 Initialization complete, running randread IO for 5 sec on 2 cores 00:21:04.286 ========================================================================== 00:21:04.286 Latency [us] 00:21:04.286 IOPS MiB/s Average min max 00:21:04.286 Core 2: 82948.51 324.02 192.21 73.60 3011.89 00:21:04.287 Core 3: 85735.49 334.90 185.94 75.10 2956.28 00:21:04.287 ========================================================================== 00:21:04.287 Total : 168684.00 658.92 189.02 73.60 3011.89 00:21:04.287 00:21:04.287 Total operations: 843488, translate 0 pull_push 0 memzero 843488 00:21:04.287 02:40:37 -- host/dma.sh@113 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 16 -o 4096 -w write -t 1 -r 'trtype:rdma adrfam:IPV4 traddr:192.168.100.8 trsvcid:4420' 00:21:04.287 EAL: No free 2048 kB hugepages reported on node 1 00:21:04.545 [2024-04-27 02:40:37.959035] subsystem.c:1435:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on RDMA/192.168.100.8/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:21:07.081 Initializing NVMe Controllers 00:21:07.081 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode0 00:21:07.081 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:21:07.081 Initialization complete. Launching workers. 00:21:07.081 ======================================================== 00:21:07.081 Latency(us) 00:21:07.081 Device Information : IOPS MiB/s Average min max 00:21:07.081 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 0: 2016.00 7.88 7980.12 5984.16 9960.99 00:21:07.081 ======================================================== 00:21:07.081 Total : 2016.00 7.88 7980.12 5984.16 9960.99 00:21:07.081 00:21:07.081 02:40:40 -- host/dma.sh@116 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dma/test_dma/test_dma -q 16 -o 4096 -w randrw -M 70 -t 5 -m 0xc --json /dev/fd/62 -b lvs0/lvol0 -f -x translate 00:21:07.081 02:40:40 -- host/dma.sh@116 -- # gen_lvol_nvme_json 0 00:21:07.082 02:40:40 -- host/dma.sh@48 -- # local subsystem=0 00:21:07.082 02:40:40 -- host/dma.sh@50 -- # jq . 00:21:07.082 [2024-04-27 02:40:40.312377] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:21:07.082 [2024-04-27 02:40:40.312446] [ DPDK EAL parameters: test_dma --no-shconf -c 0xc --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1608148 ] 00:21:07.082 EAL: No free 2048 kB hugepages reported on node 1 00:21:07.082 [2024-04-27 02:40:40.381878] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:21:07.082 [2024-04-27 02:40:40.465905] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:07.082 [2024-04-27 02:40:40.465907] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:07.082 [2024-04-27 02:40:40.698690] vbdev_lvol_rpc.c: 347:rpc_bdev_lvol_create: *WARNING*: vbdev_lvol_rpc_req_size: deprecated feature rpc_bdev_lvol_create/resize req.size to be removed in v23.09 00:21:12.354 [2024-04-27 02:40:45.727662] app.c: 937:log_deprecation_hits: *WARNING*: vbdev_lvol_rpc_req_size: deprecation 'rpc_bdev_lvol_create/resize req.size' scheduled for removal in v23.09 hit 1 times 00:21:12.613 bdev cd313cbd-743a-4c88-a2c5-b9f41d8f0ba3 reports 1 memory domains 00:21:12.613 bdev cd313cbd-743a-4c88-a2c5-b9f41d8f0ba3 supports RDMA memory domain 00:21:12.613 Initialization complete, running randrw IO for 5 sec on 2 cores 00:21:12.613 ========================================================================== 00:21:12.613 Latency [us] 00:21:12.613 IOPS MiB/s Average min max 00:21:12.613 Core 2: 19122.90 74.70 835.99 19.75 11981.33 00:21:12.613 Core 3: 19425.02 75.88 822.99 11.42 11661.45 00:21:12.613 ========================================================================== 00:21:12.613 Total : 38547.92 150.58 829.44 11.42 11981.33 00:21:12.613 00:21:12.613 Total operations: 192787, translate 192681 pull_push 0 memzero 106 00:21:12.613 02:40:45 -- host/dma.sh@118 -- # trap - SIGINT SIGTERM EXIT 00:21:12.613 02:40:45 -- host/dma.sh@120 -- # nvmftestfini 00:21:12.613 02:40:45 -- nvmf/common.sh@477 -- # nvmfcleanup 00:21:12.613 02:40:45 -- nvmf/common.sh@117 -- # sync 00:21:12.613 02:40:45 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:21:12.613 02:40:45 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:21:12.613 02:40:45 -- nvmf/common.sh@120 -- # set +e 00:21:12.613 02:40:45 -- nvmf/common.sh@121 -- # for i in {1..20} 00:21:12.613 02:40:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:21:12.613 rmmod nvme_rdma 00:21:12.613 rmmod nvme_fabrics 00:21:12.613 02:40:46 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:21:12.613 02:40:46 -- nvmf/common.sh@124 -- # set -e 00:21:12.613 02:40:46 -- nvmf/common.sh@125 -- # return 0 00:21:12.613 02:40:46 -- nvmf/common.sh@478 -- # '[' -n 1605408 ']' 00:21:12.613 02:40:46 -- nvmf/common.sh@479 -- # killprocess 1605408 00:21:12.613 02:40:46 -- common/autotest_common.sh@936 -- # '[' -z 1605408 ']' 00:21:12.613 02:40:46 -- common/autotest_common.sh@940 -- # kill -0 1605408 00:21:12.613 02:40:46 -- common/autotest_common.sh@941 -- # uname 00:21:12.613 02:40:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:12.613 02:40:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1605408 00:21:12.613 02:40:46 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:12.613 02:40:46 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:12.613 02:40:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1605408' 00:21:12.613 killing process with pid 1605408 00:21:12.613 02:40:46 -- common/autotest_common.sh@955 -- # kill 1605408 00:21:12.613 02:40:46 -- common/autotest_common.sh@960 -- # wait 1605408 00:21:12.613 [2024-04-27 02:40:46.141439] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:21:12.871 02:40:46 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:21:12.871 02:40:46 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:21:12.871 00:21:12.871 real 0m32.447s 00:21:12.871 user 1m37.393s 00:21:12.871 sys 0m5.700s 00:21:12.872 02:40:46 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:21:12.872 02:40:46 -- common/autotest_common.sh@10 -- # set +x 00:21:12.872 ************************************ 00:21:12.872 END TEST dma 00:21:12.872 ************************************ 00:21:12.872 02:40:46 -- nvmf/nvmf.sh@95 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=rdma 00:21:12.872 02:40:46 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:12.872 02:40:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:12.872 02:40:46 -- common/autotest_common.sh@10 -- # set +x 00:21:13.131 ************************************ 00:21:13.131 START TEST nvmf_identify 00:21:13.131 ************************************ 00:21:13.131 02:40:46 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=rdma 00:21:13.131 * Looking for test storage... 00:21:13.131 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:21:13.131 02:40:46 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:21:13.131 02:40:46 -- nvmf/common.sh@7 -- # uname -s 00:21:13.131 02:40:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:13.131 02:40:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:13.131 02:40:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:13.131 02:40:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:13.131 02:40:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:13.131 02:40:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:13.131 02:40:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:13.131 02:40:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:13.131 02:40:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:13.131 02:40:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:13.131 02:40:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:21:13.131 02:40:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:21:13.131 02:40:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:13.131 02:40:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:13.131 02:40:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:13.131 02:40:46 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:21:13.131 02:40:46 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:21:13.131 02:40:46 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:13.131 02:40:46 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:13.131 02:40:46 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:13.131 02:40:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:13.131 02:40:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:13.131 02:40:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:13.131 02:40:46 -- paths/export.sh@5 -- # export PATH 00:21:13.131 02:40:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:13.131 02:40:46 -- nvmf/common.sh@47 -- # : 0 00:21:13.131 02:40:46 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:21:13.131 02:40:46 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:21:13.131 02:40:46 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:21:13.131 02:40:46 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:13.131 02:40:46 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:13.131 02:40:46 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:21:13.131 02:40:46 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:21:13.131 02:40:46 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:21:13.131 02:40:46 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:21:13.131 02:40:46 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:21:13.131 02:40:46 -- host/identify.sh@14 -- # nvmftestinit 00:21:13.131 02:40:46 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:21:13.131 02:40:46 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:13.131 02:40:46 -- nvmf/common.sh@437 -- # prepare_net_devs 00:21:13.131 02:40:46 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:21:13.131 02:40:46 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:21:13.131 02:40:46 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:13.131 02:40:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:13.131 02:40:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:13.131 02:40:46 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:21:13.131 02:40:46 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:21:13.131 02:40:46 -- nvmf/common.sh@285 -- # xtrace_disable 00:21:13.131 02:40:46 -- common/autotest_common.sh@10 -- # set +x 00:21:19.697 02:40:52 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:19.697 02:40:52 -- nvmf/common.sh@291 -- # pci_devs=() 00:21:19.697 02:40:52 -- nvmf/common.sh@291 -- # local -a pci_devs 00:21:19.697 02:40:52 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:21:19.697 02:40:52 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:21:19.697 02:40:52 -- nvmf/common.sh@293 -- # pci_drivers=() 00:21:19.697 02:40:52 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:21:19.697 02:40:52 -- nvmf/common.sh@295 -- # net_devs=() 00:21:19.697 02:40:52 -- nvmf/common.sh@295 -- # local -ga net_devs 00:21:19.697 02:40:52 -- nvmf/common.sh@296 -- # e810=() 00:21:19.697 02:40:52 -- nvmf/common.sh@296 -- # local -ga e810 00:21:19.697 02:40:52 -- nvmf/common.sh@297 -- # x722=() 00:21:19.697 02:40:52 -- nvmf/common.sh@297 -- # local -ga x722 00:21:19.697 02:40:52 -- nvmf/common.sh@298 -- # mlx=() 00:21:19.697 02:40:52 -- nvmf/common.sh@298 -- # local -ga mlx 00:21:19.697 02:40:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:19.697 02:40:52 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:19.697 02:40:52 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:19.697 02:40:52 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:19.697 02:40:52 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:19.697 02:40:52 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:19.697 02:40:52 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:19.697 02:40:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:19.697 02:40:52 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:19.697 02:40:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:19.697 02:40:52 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:19.697 02:40:52 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:21:19.697 02:40:52 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:21:19.697 02:40:52 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:21:19.697 02:40:52 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:21:19.697 02:40:52 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:21:19.697 02:40:52 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:21:19.697 02:40:52 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:21:19.697 02:40:52 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:21:19.697 02:40:52 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:21:19.697 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:21:19.697 02:40:52 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:21:19.697 02:40:52 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:21:19.697 02:40:52 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:21:19.697 02:40:52 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:21:19.697 02:40:52 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:21:19.697 02:40:52 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:21:19.697 02:40:52 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:21:19.697 02:40:52 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:21:19.697 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:21:19.697 02:40:52 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:21:19.697 02:40:52 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:21:19.697 02:40:52 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:21:19.697 02:40:52 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:21:19.697 02:40:52 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:21:19.697 02:40:52 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:21:19.697 02:40:52 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:21:19.697 02:40:52 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:21:19.697 02:40:52 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:21:19.697 02:40:52 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:19.697 02:40:52 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:21:19.697 02:40:52 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:19.697 02:40:52 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:21:19.697 Found net devices under 0000:18:00.0: mlx_0_0 00:21:19.697 02:40:52 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:21:19.697 02:40:52 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:21:19.697 02:40:52 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:19.697 02:40:52 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:21:19.697 02:40:52 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:19.697 02:40:52 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:21:19.697 Found net devices under 0000:18:00.1: mlx_0_1 00:21:19.697 02:40:52 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:21:19.697 02:40:52 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:21:19.697 02:40:52 -- nvmf/common.sh@403 -- # is_hw=yes 00:21:19.697 02:40:52 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:21:19.697 02:40:52 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:21:19.697 02:40:52 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:21:19.698 02:40:52 -- nvmf/common.sh@409 -- # rdma_device_init 00:21:19.698 02:40:52 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:21:19.698 02:40:52 -- nvmf/common.sh@58 -- # uname 00:21:19.698 02:40:52 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:21:19.698 02:40:52 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:21:19.698 02:40:52 -- nvmf/common.sh@63 -- # modprobe ib_core 00:21:19.698 02:40:52 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:21:19.698 02:40:52 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:21:19.698 02:40:52 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:21:19.698 02:40:52 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:21:19.698 02:40:52 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:21:19.698 02:40:52 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:21:19.698 02:40:52 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:21:19.698 02:40:52 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:21:19.698 02:40:52 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:21:19.698 02:40:52 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:21:19.698 02:40:52 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:21:19.698 02:40:52 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:21:19.698 02:40:52 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:21:19.698 02:40:52 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:19.698 02:40:52 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:19.698 02:40:52 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:21:19.698 02:40:52 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:21:19.698 02:40:52 -- nvmf/common.sh@105 -- # continue 2 00:21:19.698 02:40:52 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:19.698 02:40:52 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:19.698 02:40:52 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:21:19.698 02:40:52 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:19.698 02:40:52 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:21:19.698 02:40:52 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:21:19.698 02:40:52 -- nvmf/common.sh@105 -- # continue 2 00:21:19.698 02:40:52 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:21:19.698 02:40:52 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:21:19.698 02:40:52 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:21:19.698 02:40:52 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:21:19.698 02:40:52 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:19.698 02:40:52 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:19.698 02:40:52 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:21:19.698 02:40:52 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:21:19.698 02:40:52 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:21:19.698 64: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:21:19.698 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:21:19.698 altname enp24s0f0np0 00:21:19.698 altname ens785f0np0 00:21:19.698 inet 192.168.100.8/24 scope global mlx_0_0 00:21:19.698 valid_lft forever preferred_lft forever 00:21:19.698 02:40:52 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:21:19.698 02:40:52 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:21:19.698 02:40:52 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:21:19.698 02:40:52 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:19.698 02:40:52 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:21:19.698 02:40:52 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:19.698 02:40:52 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:21:19.698 02:40:52 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:21:19.698 02:40:52 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:21:19.698 65: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:21:19.698 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:21:19.698 altname enp24s0f1np1 00:21:19.698 altname ens785f1np1 00:21:19.698 inet 192.168.100.9/24 scope global mlx_0_1 00:21:19.698 valid_lft forever preferred_lft forever 00:21:19.698 02:40:52 -- nvmf/common.sh@411 -- # return 0 00:21:19.698 02:40:52 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:21:19.698 02:40:52 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:21:19.698 02:40:52 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:21:19.698 02:40:52 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:21:19.698 02:40:52 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:21:19.698 02:40:52 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:21:19.698 02:40:52 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:21:19.698 02:40:52 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:21:19.698 02:40:52 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:21:19.698 02:40:52 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:21:19.698 02:40:52 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:19.698 02:40:52 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:19.698 02:40:52 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:21:19.698 02:40:52 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:21:19.698 02:40:52 -- nvmf/common.sh@105 -- # continue 2 00:21:19.698 02:40:52 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:19.698 02:40:52 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:19.698 02:40:52 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:21:19.698 02:40:52 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:19.698 02:40:52 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:21:19.698 02:40:52 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:21:19.698 02:40:52 -- nvmf/common.sh@105 -- # continue 2 00:21:19.698 02:40:52 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:21:19.698 02:40:52 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:21:19.698 02:40:52 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:21:19.698 02:40:52 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:21:19.698 02:40:52 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:19.698 02:40:52 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:19.698 02:40:52 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:21:19.698 02:40:52 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:21:19.698 02:40:52 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:21:19.698 02:40:52 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:21:19.698 02:40:52 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:19.698 02:40:52 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:19.698 02:40:52 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:21:19.698 192.168.100.9' 00:21:19.698 02:40:52 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:21:19.698 192.168.100.9' 00:21:19.698 02:40:52 -- nvmf/common.sh@446 -- # head -n 1 00:21:19.698 02:40:52 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:21:19.698 02:40:52 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:21:19.698 192.168.100.9' 00:21:19.698 02:40:52 -- nvmf/common.sh@447 -- # tail -n +2 00:21:19.698 02:40:52 -- nvmf/common.sh@447 -- # head -n 1 00:21:19.698 02:40:52 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:21:19.698 02:40:52 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:21:19.698 02:40:52 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:21:19.698 02:40:52 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:21:19.698 02:40:52 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:21:19.698 02:40:52 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:21:19.698 02:40:52 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:21:19.698 02:40:52 -- common/autotest_common.sh@710 -- # xtrace_disable 00:21:19.698 02:40:52 -- common/autotest_common.sh@10 -- # set +x 00:21:19.698 02:40:52 -- host/identify.sh@19 -- # nvmfpid=1611780 00:21:19.698 02:40:52 -- host/identify.sh@18 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:21:19.698 02:40:52 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:21:19.698 02:40:52 -- host/identify.sh@23 -- # waitforlisten 1611780 00:21:19.698 02:40:52 -- common/autotest_common.sh@817 -- # '[' -z 1611780 ']' 00:21:19.698 02:40:52 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:19.698 02:40:52 -- common/autotest_common.sh@822 -- # local max_retries=100 00:21:19.698 02:40:52 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:19.698 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:19.698 02:40:52 -- common/autotest_common.sh@826 -- # xtrace_disable 00:21:19.698 02:40:52 -- common/autotest_common.sh@10 -- # set +x 00:21:19.698 [2024-04-27 02:40:52.920634] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:21:19.698 [2024-04-27 02:40:52.920696] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:19.698 EAL: No free 2048 kB hugepages reported on node 1 00:21:19.698 [2024-04-27 02:40:52.993609] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:19.698 [2024-04-27 02:40:53.086198] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:19.698 [2024-04-27 02:40:53.086240] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:19.698 [2024-04-27 02:40:53.086250] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:21:19.698 [2024-04-27 02:40:53.086258] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:21:19.698 [2024-04-27 02:40:53.086266] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:19.698 [2024-04-27 02:40:53.086313] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:19.698 [2024-04-27 02:40:53.086415] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:19.698 [2024-04-27 02:40:53.086441] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:19.698 [2024-04-27 02:40:53.086443] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:20.266 02:40:53 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:21:20.266 02:40:53 -- common/autotest_common.sh@850 -- # return 0 00:21:20.266 02:40:53 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:21:20.266 02:40:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:20.266 02:40:53 -- common/autotest_common.sh@10 -- # set +x 00:21:20.266 [2024-04-27 02:40:53.821072] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xf1e4d0/0xf229c0) succeed. 00:21:20.266 [2024-04-27 02:40:53.831598] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xf1fb10/0xf64050) succeed. 00:21:20.525 02:40:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:20.525 02:40:53 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:21:20.525 02:40:53 -- common/autotest_common.sh@716 -- # xtrace_disable 00:21:20.525 02:40:53 -- common/autotest_common.sh@10 -- # set +x 00:21:20.525 02:40:53 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:21:20.525 02:40:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:20.525 02:40:53 -- common/autotest_common.sh@10 -- # set +x 00:21:20.525 Malloc0 00:21:20.525 02:40:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:20.525 02:40:54 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:20.525 02:40:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:20.525 02:40:54 -- common/autotest_common.sh@10 -- # set +x 00:21:20.525 02:40:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:20.525 02:40:54 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:21:20.525 02:40:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:20.525 02:40:54 -- common/autotest_common.sh@10 -- # set +x 00:21:20.525 02:40:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:20.525 02:40:54 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:21:20.525 02:40:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:20.525 02:40:54 -- common/autotest_common.sh@10 -- # set +x 00:21:20.525 [2024-04-27 02:40:54.054422] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:21:20.525 02:40:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:20.525 02:40:54 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:21:20.525 02:40:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:20.525 02:40:54 -- common/autotest_common.sh@10 -- # set +x 00:21:20.525 02:40:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:20.525 02:40:54 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:21:20.525 02:40:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:20.525 02:40:54 -- common/autotest_common.sh@10 -- # set +x 00:21:20.525 [2024-04-27 02:40:54.070126] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:21:20.525 [ 00:21:20.526 { 00:21:20.526 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:21:20.526 "subtype": "Discovery", 00:21:20.526 "listen_addresses": [ 00:21:20.526 { 00:21:20.526 "transport": "RDMA", 00:21:20.526 "trtype": "RDMA", 00:21:20.526 "adrfam": "IPv4", 00:21:20.526 "traddr": "192.168.100.8", 00:21:20.526 "trsvcid": "4420" 00:21:20.526 } 00:21:20.526 ], 00:21:20.526 "allow_any_host": true, 00:21:20.526 "hosts": [] 00:21:20.526 }, 00:21:20.526 { 00:21:20.526 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:20.526 "subtype": "NVMe", 00:21:20.526 "listen_addresses": [ 00:21:20.526 { 00:21:20.526 "transport": "RDMA", 00:21:20.526 "trtype": "RDMA", 00:21:20.526 "adrfam": "IPv4", 00:21:20.526 "traddr": "192.168.100.8", 00:21:20.526 "trsvcid": "4420" 00:21:20.526 } 00:21:20.526 ], 00:21:20.526 "allow_any_host": true, 00:21:20.526 "hosts": [], 00:21:20.526 "serial_number": "SPDK00000000000001", 00:21:20.526 "model_number": "SPDK bdev Controller", 00:21:20.526 "max_namespaces": 32, 00:21:20.526 "min_cntlid": 1, 00:21:20.526 "max_cntlid": 65519, 00:21:20.526 "namespaces": [ 00:21:20.526 { 00:21:20.526 "nsid": 1, 00:21:20.526 "bdev_name": "Malloc0", 00:21:20.526 "name": "Malloc0", 00:21:20.526 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:21:20.526 "eui64": "ABCDEF0123456789", 00:21:20.526 "uuid": "4a8b470c-b90a-4cc9-97e8-58e4b7481c66" 00:21:20.526 } 00:21:20.526 ] 00:21:20.526 } 00:21:20.526 ] 00:21:20.526 02:40:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:20.526 02:40:54 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:21:20.526 [2024-04-27 02:40:54.112575] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:21:20.526 [2024-04-27 02:40:54.112619] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1611981 ] 00:21:20.526 EAL: No free 2048 kB hugepages reported on node 1 00:21:20.793 [2024-04-27 02:40:54.160443] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:21:20.793 [2024-04-27 02:40:54.160527] nvme_rdma.c:2261:nvme_rdma_ctrlr_construct: *DEBUG*: successfully initialized the nvmf ctrlr 00:21:20.793 [2024-04-27 02:40:54.160549] nvme_rdma.c:1291:nvme_rdma_ctrlr_connect_qpair: *DEBUG*: adrfam 1 ai_family 2 00:21:20.793 [2024-04-27 02:40:54.160554] nvme_rdma.c:1295:nvme_rdma_ctrlr_connect_qpair: *DEBUG*: trsvcid is 4420 00:21:20.793 [2024-04-27 02:40:54.160585] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:21:20.793 [2024-04-27 02:40:54.170856] nvme_rdma.c: 510:nvme_rdma_qpair_process_cm_event: *DEBUG*: Requested queue depth 32. Target receive queue depth 32. 00:21:20.793 [2024-04-27 02:40:54.181129] nvme_rdma.c:1180:nvme_rdma_connect_established: *DEBUG*: rc =0 00:21:20.793 [2024-04-27 02:40:54.181141] nvme_rdma.c:1185:nvme_rdma_connect_established: *DEBUG*: RDMA requests created 00:21:20.793 [2024-04-27 02:40:54.181149] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x183500 00:21:20.793 [2024-04-27 02:40:54.181157] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x183500 00:21:20.793 [2024-04-27 02:40:54.181163] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x183500 00:21:20.793 [2024-04-27 02:40:54.181170] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x183500 00:21:20.793 [2024-04-27 02:40:54.181176] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x183500 00:21:20.793 [2024-04-27 02:40:54.181183] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x183500 00:21:20.793 [2024-04-27 02:40:54.181189] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x183500 00:21:20.793 [2024-04-27 02:40:54.181196] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x183500 00:21:20.793 [2024-04-27 02:40:54.181202] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x183500 00:21:20.793 [2024-04-27 02:40:54.181208] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x183500 00:21:20.793 [2024-04-27 02:40:54.181218] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x183500 00:21:20.793 [2024-04-27 02:40:54.181224] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x183500 00:21:20.793 [2024-04-27 02:40:54.181231] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x183500 00:21:20.793 [2024-04-27 02:40:54.181237] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x183500 00:21:20.793 [2024-04-27 02:40:54.181244] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x183500 00:21:20.793 [2024-04-27 02:40:54.181250] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x183500 00:21:20.793 [2024-04-27 02:40:54.181256] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x183500 00:21:20.793 [2024-04-27 02:40:54.181263] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x183500 00:21:20.793 [2024-04-27 02:40:54.181269] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x183500 00:21:20.793 [2024-04-27 02:40:54.181276] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x183500 00:21:20.793 [2024-04-27 02:40:54.181282] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x183500 00:21:20.793 [2024-04-27 02:40:54.181288] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x183500 00:21:20.793 [2024-04-27 02:40:54.181295] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x183500 00:21:20.793 [2024-04-27 02:40:54.181301] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x183500 00:21:20.793 [2024-04-27 02:40:54.181308] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x183500 00:21:20.793 [2024-04-27 02:40:54.181314] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x183500 00:21:20.793 [2024-04-27 02:40:54.181321] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x183500 00:21:20.793 [2024-04-27 02:40:54.181327] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x183500 00:21:20.793 [2024-04-27 02:40:54.181333] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x183500 00:21:20.793 [2024-04-27 02:40:54.181347] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x183500 00:21:20.793 [2024-04-27 02:40:54.181354] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x183500 00:21:20.793 [2024-04-27 02:40:54.181360] nvme_rdma.c:1199:nvme_rdma_connect_established: *DEBUG*: RDMA responses created 00:21:20.793 [2024-04-27 02:40:54.181366] nvme_rdma.c:1202:nvme_rdma_connect_established: *DEBUG*: rc =0 00:21:20.793 [2024-04-27 02:40:54.181371] nvme_rdma.c:1207:nvme_rdma_connect_established: *DEBUG*: RDMA responses submitted 00:21:20.794 [2024-04-27 02:40:54.181391] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183500 00:21:20.794 [2024-04-27 02:40:54.181406] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf200 len:0x400 key:0x183500 00:21:20.794 [2024-04-27 02:40:54.186341] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.794 [2024-04-27 02:40:54.186350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:21:20.794 [2024-04-27 02:40:54.186359] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x183500 00:21:20.794 [2024-04-27 02:40:54.186369] nvme_fabric.c: 622:_nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:21:20.794 [2024-04-27 02:40:54.186376] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:21:20.794 [2024-04-27 02:40:54.186383] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:21:20.794 [2024-04-27 02:40:54.186403] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183500 00:21:20.794 [2024-04-27 02:40:54.186412] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.794 [2024-04-27 02:40:54.186435] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.794 [2024-04-27 02:40:54.186441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:10300 sqhd:0002 p:0 m:0 dnr:0 00:21:20.794 [2024-04-27 02:40:54.186450] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:21:20.794 [2024-04-27 02:40:54.186457] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x183500 00:21:20.794 [2024-04-27 02:40:54.186464] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:21:20.794 [2024-04-27 02:40:54.186472] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183500 00:21:20.794 [2024-04-27 02:40:54.186480] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.794 [2024-04-27 02:40:54.186497] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.794 [2024-04-27 02:40:54.186503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1e01007f sqhd:0003 p:0 m:0 dnr:0 00:21:20.794 [2024-04-27 02:40:54.186510] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:21:20.794 [2024-04-27 02:40:54.186516] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x183500 00:21:20.794 [2024-04-27 02:40:54.186523] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:21:20.794 [2024-04-27 02:40:54.186531] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183500 00:21:20.794 [2024-04-27 02:40:54.186539] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.794 [2024-04-27 02:40:54.186558] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.794 [2024-04-27 02:40:54.186564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0004 p:0 m:0 dnr:0 00:21:20.794 [2024-04-27 02:40:54.186570] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:21:20.794 [2024-04-27 02:40:54.186577] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x183500 00:21:20.794 [2024-04-27 02:40:54.186585] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183500 00:21:20.794 [2024-04-27 02:40:54.186593] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.794 [2024-04-27 02:40:54.186616] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.794 [2024-04-27 02:40:54.186622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0005 p:0 m:0 dnr:0 00:21:20.794 [2024-04-27 02:40:54.186629] nvme_ctrlr.c:3749:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:21:20.794 [2024-04-27 02:40:54.186635] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:21:20.794 [2024-04-27 02:40:54.186641] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x183500 00:21:20.794 [2024-04-27 02:40:54.186649] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:21:20.794 [2024-04-27 02:40:54.186756] nvme_ctrlr.c:3942:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:21:20.794 [2024-04-27 02:40:54.186762] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:21:20.794 [2024-04-27 02:40:54.186772] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183500 00:21:20.794 [2024-04-27 02:40:54.186780] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.794 [2024-04-27 02:40:54.186801] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.794 [2024-04-27 02:40:54.186807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0006 p:0 m:0 dnr:0 00:21:20.794 [2024-04-27 02:40:54.186813] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:21:20.794 [2024-04-27 02:40:54.186819] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x183500 00:21:20.794 [2024-04-27 02:40:54.186828] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183500 00:21:20.794 [2024-04-27 02:40:54.186836] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.794 [2024-04-27 02:40:54.186851] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.794 [2024-04-27 02:40:54.186857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:21:20.794 [2024-04-27 02:40:54.186863] nvme_ctrlr.c:3784:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:21:20.794 [2024-04-27 02:40:54.186869] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:21:20.794 [2024-04-27 02:40:54.186875] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x183500 00:21:20.794 [2024-04-27 02:40:54.186882] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:21:20.794 [2024-04-27 02:40:54.186892] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:21:20.794 [2024-04-27 02:40:54.186901] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183500 00:21:20.794 [2024-04-27 02:40:54.186909] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0x183500 00:21:20.794 [2024-04-27 02:40:54.186951] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.794 [2024-04-27 02:40:54.186957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0008 p:0 m:0 dnr:0 00:21:20.794 [2024-04-27 02:40:54.186966] nvme_ctrlr.c:1984:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:21:20.794 [2024-04-27 02:40:54.186972] nvme_ctrlr.c:1988:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:21:20.794 [2024-04-27 02:40:54.186978] nvme_ctrlr.c:1991:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:21:20.794 [2024-04-27 02:40:54.186987] nvme_ctrlr.c:2015:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:21:20.794 [2024-04-27 02:40:54.186993] nvme_ctrlr.c:2030:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:21:20.794 [2024-04-27 02:40:54.187001] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:21:20.794 [2024-04-27 02:40:54.187007] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x183500 00:21:20.794 [2024-04-27 02:40:54.187015] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:21:20.794 [2024-04-27 02:40:54.187023] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183500 00:21:20.794 [2024-04-27 02:40:54.187031] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.794 [2024-04-27 02:40:54.187050] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.794 [2024-04-27 02:40:54.187056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0009 p:0 m:0 dnr:0 00:21:20.794 [2024-04-27 02:40:54.187065] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0500 length 0x40 lkey 0x183500 00:21:20.794 [2024-04-27 02:40:54.187072] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:21:20.794 [2024-04-27 02:40:54.187079] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0640 length 0x40 lkey 0x183500 00:21:20.794 [2024-04-27 02:40:54.187087] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:21:20.794 [2024-04-27 02:40:54.187094] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.794 [2024-04-27 02:40:54.187101] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:21:20.794 [2024-04-27 02:40:54.187108] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d08c0 length 0x40 lkey 0x183500 00:21:20.794 [2024-04-27 02:40:54.187115] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:21:20.794 [2024-04-27 02:40:54.187121] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:21:20.794 [2024-04-27 02:40:54.187127] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x183500 00:21:20.794 [2024-04-27 02:40:54.187138] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:21:20.794 [2024-04-27 02:40:54.187146] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183500 00:21:20.794 [2024-04-27 02:40:54.187153] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:0 cdw10:0000000f SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.794 [2024-04-27 02:40:54.187173] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.795 [2024-04-27 02:40:54.187179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:2710 sqhd:000a p:0 m:0 dnr:0 00:21:20.795 [2024-04-27 02:40:54.187185] nvme_ctrlr.c:2902:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:21:20.795 [2024-04-27 02:40:54.187191] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:21:20.795 [2024-04-27 02:40:54.187198] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x183500 00:21:20.795 [2024-04-27 02:40:54.187207] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183500 00:21:20.795 [2024-04-27 02:40:54.187215] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0x183500 00:21:20.795 [2024-04-27 02:40:54.187235] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.795 [2024-04-27 02:40:54.187240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000b p:0 m:0 dnr:0 00:21:20.795 [2024-04-27 02:40:54.187248] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x183500 00:21:20.795 [2024-04-27 02:40:54.187258] nvme_ctrlr.c:4036:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:21:20.795 [2024-04-27 02:40:54.187279] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183500 00:21:20.795 [2024-04-27 02:40:54.187287] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:0 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf000 len:0x400 key:0x183500 00:21:20.795 [2024-04-27 02:40:54.187295] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x183500 00:21:20.795 [2024-04-27 02:40:54.187302] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:21:20.795 [2024-04-27 02:40:54.187320] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.795 [2024-04-27 02:40:54.187326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000c p:0 m:0 dnr:0 00:21:20.795 [2024-04-27 02:40:54.187341] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0b40 length 0x40 lkey 0x183500 00:21:20.795 [2024-04-27 02:40:54.187349] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0xc00 key:0x183500 00:21:20.795 [2024-04-27 02:40:54.187355] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x183500 00:21:20.795 [2024-04-27 02:40:54.187362] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.795 [2024-04-27 02:40:54.187367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:000d p:0 m:0 dnr:0 00:21:20.795 [2024-04-27 02:40:54.187373] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x183500 00:21:20.795 [2024-04-27 02:40:54.187380] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.795 [2024-04-27 02:40:54.187386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:6 cdw0:0 sqhd:000e p:0 m:0 dnr:0 00:21:20.795 [2024-04-27 02:40:54.187395] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x183500 00:21:20.795 [2024-04-27 02:40:54.187403] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:0 cdw10:00010070 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf000 len:0x8 key:0x183500 00:21:20.795 [2024-04-27 02:40:54.187409] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x183500 00:21:20.795 [2024-04-27 02:40:54.187425] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.795 [2024-04-27 02:40:54.187431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:000f p:0 m:0 dnr:0 00:21:20.795 [2024-04-27 02:40:54.187442] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x183500 00:21:20.795 ===================================================== 00:21:20.795 NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2014-08.org.nvmexpress.discovery 00:21:20.795 ===================================================== 00:21:20.795 Controller Capabilities/Features 00:21:20.795 ================================ 00:21:20.795 Vendor ID: 0000 00:21:20.795 Subsystem Vendor ID: 0000 00:21:20.795 Serial Number: .................... 00:21:20.795 Model Number: ........................................ 00:21:20.795 Firmware Version: 24.05 00:21:20.795 Recommended Arb Burst: 0 00:21:20.795 IEEE OUI Identifier: 00 00 00 00:21:20.795 Multi-path I/O 00:21:20.795 May have multiple subsystem ports: No 00:21:20.795 May have multiple controllers: No 00:21:20.795 Associated with SR-IOV VF: No 00:21:20.795 Max Data Transfer Size: 131072 00:21:20.795 Max Number of Namespaces: 0 00:21:20.795 Max Number of I/O Queues: 1024 00:21:20.795 NVMe Specification Version (VS): 1.3 00:21:20.795 NVMe Specification Version (Identify): 1.3 00:21:20.795 Maximum Queue Entries: 128 00:21:20.795 Contiguous Queues Required: Yes 00:21:20.795 Arbitration Mechanisms Supported 00:21:20.795 Weighted Round Robin: Not Supported 00:21:20.795 Vendor Specific: Not Supported 00:21:20.795 Reset Timeout: 15000 ms 00:21:20.795 Doorbell Stride: 4 bytes 00:21:20.795 NVM Subsystem Reset: Not Supported 00:21:20.795 Command Sets Supported 00:21:20.795 NVM Command Set: Supported 00:21:20.795 Boot Partition: Not Supported 00:21:20.795 Memory Page Size Minimum: 4096 bytes 00:21:20.795 Memory Page Size Maximum: 4096 bytes 00:21:20.795 Persistent Memory Region: Not Supported 00:21:20.795 Optional Asynchronous Events Supported 00:21:20.795 Namespace Attribute Notices: Not Supported 00:21:20.795 Firmware Activation Notices: Not Supported 00:21:20.795 ANA Change Notices: Not Supported 00:21:20.795 PLE Aggregate Log Change Notices: Not Supported 00:21:20.795 LBA Status Info Alert Notices: Not Supported 00:21:20.795 EGE Aggregate Log Change Notices: Not Supported 00:21:20.795 Normal NVM Subsystem Shutdown event: Not Supported 00:21:20.795 Zone Descriptor Change Notices: Not Supported 00:21:20.795 Discovery Log Change Notices: Supported 00:21:20.795 Controller Attributes 00:21:20.795 128-bit Host Identifier: Not Supported 00:21:20.795 Non-Operational Permissive Mode: Not Supported 00:21:20.795 NVM Sets: Not Supported 00:21:20.795 Read Recovery Levels: Not Supported 00:21:20.795 Endurance Groups: Not Supported 00:21:20.795 Predictable Latency Mode: Not Supported 00:21:20.795 Traffic Based Keep ALive: Not Supported 00:21:20.795 Namespace Granularity: Not Supported 00:21:20.795 SQ Associations: Not Supported 00:21:20.795 UUID List: Not Supported 00:21:20.795 Multi-Domain Subsystem: Not Supported 00:21:20.795 Fixed Capacity Management: Not Supported 00:21:20.795 Variable Capacity Management: Not Supported 00:21:20.795 Delete Endurance Group: Not Supported 00:21:20.795 Delete NVM Set: Not Supported 00:21:20.795 Extended LBA Formats Supported: Not Supported 00:21:20.795 Flexible Data Placement Supported: Not Supported 00:21:20.795 00:21:20.795 Controller Memory Buffer Support 00:21:20.795 ================================ 00:21:20.795 Supported: No 00:21:20.795 00:21:20.795 Persistent Memory Region Support 00:21:20.795 ================================ 00:21:20.795 Supported: No 00:21:20.795 00:21:20.795 Admin Command Set Attributes 00:21:20.795 ============================ 00:21:20.795 Security Send/Receive: Not Supported 00:21:20.795 Format NVM: Not Supported 00:21:20.795 Firmware Activate/Download: Not Supported 00:21:20.795 Namespace Management: Not Supported 00:21:20.795 Device Self-Test: Not Supported 00:21:20.795 Directives: Not Supported 00:21:20.795 NVMe-MI: Not Supported 00:21:20.795 Virtualization Management: Not Supported 00:21:20.795 Doorbell Buffer Config: Not Supported 00:21:20.795 Get LBA Status Capability: Not Supported 00:21:20.795 Command & Feature Lockdown Capability: Not Supported 00:21:20.795 Abort Command Limit: 1 00:21:20.795 Async Event Request Limit: 4 00:21:20.795 Number of Firmware Slots: N/A 00:21:20.795 Firmware Slot 1 Read-Only: N/A 00:21:20.795 Firmware Activation Without Reset: N/A 00:21:20.795 Multiple Update Detection Support: N/A 00:21:20.795 Firmware Update Granularity: No Information Provided 00:21:20.795 Per-Namespace SMART Log: No 00:21:20.795 Asymmetric Namespace Access Log Page: Not Supported 00:21:20.795 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:21:20.795 Command Effects Log Page: Not Supported 00:21:20.795 Get Log Page Extended Data: Supported 00:21:20.795 Telemetry Log Pages: Not Supported 00:21:20.795 Persistent Event Log Pages: Not Supported 00:21:20.795 Supported Log Pages Log Page: May Support 00:21:20.795 Commands Supported & Effects Log Page: Not Supported 00:21:20.795 Feature Identifiers & Effects Log Page:May Support 00:21:20.795 NVMe-MI Commands & Effects Log Page: May Support 00:21:20.795 Data Area 4 for Telemetry Log: Not Supported 00:21:20.795 Error Log Page Entries Supported: 128 00:21:20.795 Keep Alive: Not Supported 00:21:20.795 00:21:20.795 NVM Command Set Attributes 00:21:20.795 ========================== 00:21:20.795 Submission Queue Entry Size 00:21:20.795 Max: 1 00:21:20.795 Min: 1 00:21:20.795 Completion Queue Entry Size 00:21:20.795 Max: 1 00:21:20.795 Min: 1 00:21:20.795 Number of Namespaces: 0 00:21:20.795 Compare Command: Not Supported 00:21:20.795 Write Uncorrectable Command: Not Supported 00:21:20.795 Dataset Management Command: Not Supported 00:21:20.795 Write Zeroes Command: Not Supported 00:21:20.795 Set Features Save Field: Not Supported 00:21:20.795 Reservations: Not Supported 00:21:20.795 Timestamp: Not Supported 00:21:20.795 Copy: Not Supported 00:21:20.795 Volatile Write Cache: Not Present 00:21:20.795 Atomic Write Unit (Normal): 1 00:21:20.795 Atomic Write Unit (PFail): 1 00:21:20.796 Atomic Compare & Write Unit: 1 00:21:20.796 Fused Compare & Write: Supported 00:21:20.796 Scatter-Gather List 00:21:20.796 SGL Command Set: Supported 00:21:20.796 SGL Keyed: Supported 00:21:20.796 SGL Bit Bucket Descriptor: Not Supported 00:21:20.796 SGL Metadata Pointer: Not Supported 00:21:20.796 Oversized SGL: Not Supported 00:21:20.796 SGL Metadata Address: Not Supported 00:21:20.796 SGL Offset: Supported 00:21:20.796 Transport SGL Data Block: Not Supported 00:21:20.796 Replay Protected Memory Block: Not Supported 00:21:20.796 00:21:20.796 Firmware Slot Information 00:21:20.796 ========================= 00:21:20.796 Active slot: 0 00:21:20.796 00:21:20.796 00:21:20.796 Error Log 00:21:20.796 ========= 00:21:20.796 00:21:20.796 Active Namespaces 00:21:20.796 ================= 00:21:20.796 Discovery Log Page 00:21:20.796 ================== 00:21:20.796 Generation Counter: 2 00:21:20.796 Number of Records: 2 00:21:20.796 Record Format: 0 00:21:20.796 00:21:20.796 Discovery Log Entry 0 00:21:20.796 ---------------------- 00:21:20.796 Transport Type: 1 (RDMA) 00:21:20.796 Address Family: 1 (IPv4) 00:21:20.796 Subsystem Type: 3 (Current Discovery Subsystem) 00:21:20.796 Entry Flags: 00:21:20.796 Duplicate Returned Information: 1 00:21:20.796 Explicit Persistent Connection Support for Discovery: 1 00:21:20.796 Transport Requirements: 00:21:20.796 Secure Channel: Not Required 00:21:20.796 Port ID: 0 (0x0000) 00:21:20.796 Controller ID: 65535 (0xffff) 00:21:20.796 Admin Max SQ Size: 128 00:21:20.796 Transport Service Identifier: 4420 00:21:20.796 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:21:20.796 Transport Address: 192.168.100.8 00:21:20.796 Transport Specific Address Subtype - RDMA 00:21:20.796 RDMA QP Service Type: 1 (Reliable Connected) 00:21:20.796 RDMA Provider Type: 1 (No provider specified) 00:21:20.796 RDMA CM Service: 1 (RDMA_CM) 00:21:20.796 Discovery Log Entry 1 00:21:20.796 ---------------------- 00:21:20.796 Transport Type: 1 (RDMA) 00:21:20.796 Address Family: 1 (IPv4) 00:21:20.796 Subsystem Type: 2 (NVM Subsystem) 00:21:20.796 Entry Flags: 00:21:20.796 Duplicate Returned Information: 0 00:21:20.796 Explicit Persistent Connection Support for Discovery: 0 00:21:20.796 Transport Requirements: 00:21:20.796 Secure Channel: Not Required 00:21:20.796 Port ID: 0 (0x0000) 00:21:20.796 Controller ID: 65535 (0xffff) 00:21:20.796 Admin Max SQ Size: [2024-04-27 02:40:54.187516] nvme_ctrlr.c:4221:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:21:20.796 [2024-04-27 02:40:54.187526] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 64699 doesn't match qid 00:21:20.796 [2024-04-27 02:40:54.187541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32614 cdw0:5 sqhd:3790 p:0 m:0 dnr:0 00:21:20.796 [2024-04-27 02:40:54.187548] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 64699 doesn't match qid 00:21:20.796 [2024-04-27 02:40:54.187558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32614 cdw0:5 sqhd:3790 p:0 m:0 dnr:0 00:21:20.796 [2024-04-27 02:40:54.187565] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 64699 doesn't match qid 00:21:20.796 [2024-04-27 02:40:54.187573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32614 cdw0:5 sqhd:3790 p:0 m:0 dnr:0 00:21:20.796 [2024-04-27 02:40:54.187579] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 64699 doesn't match qid 00:21:20.796 [2024-04-27 02:40:54.187587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32614 cdw0:5 sqhd:3790 p:0 m:0 dnr:0 00:21:20.796 [2024-04-27 02:40:54.187597] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d08c0 length 0x40 lkey 0x183500 00:21:20.796 [2024-04-27 02:40:54.187605] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:4 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.796 [2024-04-27 02:40:54.187629] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.796 [2024-04-27 02:40:54.187635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:4 cdw0:460001 sqhd:0010 p:0 m:0 dnr:0 00:21:20.796 [2024-04-27 02:40:54.187647] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.796 [2024-04-27 02:40:54.187655] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.796 [2024-04-27 02:40:54.187662] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x183500 00:21:20.796 [2024-04-27 02:40:54.187676] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.796 [2024-04-27 02:40:54.187682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:0 sqhd:0011 p:0 m:0 dnr:0 00:21:20.796 [2024-04-27 02:40:54.187688] nvme_ctrlr.c:1082:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:21:20.796 [2024-04-27 02:40:54.187694] nvme_ctrlr.c:1085:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:21:20.796 [2024-04-27 02:40:54.187701] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x183500 00:21:20.796 [2024-04-27 02:40:54.187709] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.796 [2024-04-27 02:40:54.187717] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.796 [2024-04-27 02:40:54.187735] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.796 [2024-04-27 02:40:54.187742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0012 p:0 m:0 dnr:0 00:21:20.796 [2024-04-27 02:40:54.187749] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x183500 00:21:20.796 [2024-04-27 02:40:54.187759] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.796 [2024-04-27 02:40:54.187767] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.796 [2024-04-27 02:40:54.187787] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.796 [2024-04-27 02:40:54.187793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0013 p:0 m:0 dnr:0 00:21:20.796 [2024-04-27 02:40:54.187801] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x183500 00:21:20.796 [2024-04-27 02:40:54.187812] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.796 [2024-04-27 02:40:54.187820] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.796 [2024-04-27 02:40:54.187836] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.796 [2024-04-27 02:40:54.187842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0014 p:0 m:0 dnr:0 00:21:20.796 [2024-04-27 02:40:54.187849] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x183500 00:21:20.796 [2024-04-27 02:40:54.187858] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.796 [2024-04-27 02:40:54.187866] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.796 [2024-04-27 02:40:54.187884] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.796 [2024-04-27 02:40:54.187891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0015 p:0 m:0 dnr:0 00:21:20.796 [2024-04-27 02:40:54.187898] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x183500 00:21:20.796 [2024-04-27 02:40:54.187908] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.796 [2024-04-27 02:40:54.187916] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.796 [2024-04-27 02:40:54.187938] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.796 [2024-04-27 02:40:54.187944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0016 p:0 m:0 dnr:0 00:21:20.796 [2024-04-27 02:40:54.187950] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x183500 00:21:20.796 [2024-04-27 02:40:54.187961] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.796 [2024-04-27 02:40:54.187970] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.796 [2024-04-27 02:40:54.187985] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.796 [2024-04-27 02:40:54.187992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0017 p:0 m:0 dnr:0 00:21:20.796 [2024-04-27 02:40:54.187999] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x183500 00:21:20.796 [2024-04-27 02:40:54.188008] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.796 [2024-04-27 02:40:54.188016] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.796 [2024-04-27 02:40:54.188039] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.796 [2024-04-27 02:40:54.188045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0018 p:0 m:0 dnr:0 00:21:20.796 [2024-04-27 02:40:54.188054] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x183500 00:21:20.796 [2024-04-27 02:40:54.188063] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.796 [2024-04-27 02:40:54.188071] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.796 [2024-04-27 02:40:54.188085] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.796 [2024-04-27 02:40:54.188091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0019 p:0 m:0 dnr:0 00:21:20.796 [2024-04-27 02:40:54.188097] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x183500 00:21:20.796 [2024-04-27 02:40:54.188107] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.797 [2024-04-27 02:40:54.188115] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.797 [2024-04-27 02:40:54.188134] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.797 [2024-04-27 02:40:54.188141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001a p:0 m:0 dnr:0 00:21:20.797 [2024-04-27 02:40:54.188147] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x183500 00:21:20.797 [2024-04-27 02:40:54.188156] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.797 [2024-04-27 02:40:54.188165] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.797 [2024-04-27 02:40:54.188181] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.797 [2024-04-27 02:40:54.188187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001b p:0 m:0 dnr:0 00:21:20.797 [2024-04-27 02:40:54.188194] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x183500 00:21:20.797 [2024-04-27 02:40:54.188203] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.797 [2024-04-27 02:40:54.188211] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.797 [2024-04-27 02:40:54.188226] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.797 [2024-04-27 02:40:54.188232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001c p:0 m:0 dnr:0 00:21:20.797 [2024-04-27 02:40:54.188239] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x183500 00:21:20.797 [2024-04-27 02:40:54.188248] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.797 [2024-04-27 02:40:54.188255] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.797 [2024-04-27 02:40:54.188275] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.797 [2024-04-27 02:40:54.188281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001d p:0 m:0 dnr:0 00:21:20.797 [2024-04-27 02:40:54.188287] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x183500 00:21:20.797 [2024-04-27 02:40:54.188296] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.797 [2024-04-27 02:40:54.188304] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.797 [2024-04-27 02:40:54.188324] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.797 [2024-04-27 02:40:54.188329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001e p:0 m:0 dnr:0 00:21:20.797 [2024-04-27 02:40:54.188341] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x183500 00:21:20.797 [2024-04-27 02:40:54.188351] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.797 [2024-04-27 02:40:54.188359] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.797 [2024-04-27 02:40:54.188379] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.797 [2024-04-27 02:40:54.188385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001f p:0 m:0 dnr:0 00:21:20.797 [2024-04-27 02:40:54.188391] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x183500 00:21:20.797 [2024-04-27 02:40:54.188400] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.797 [2024-04-27 02:40:54.188409] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.797 [2024-04-27 02:40:54.188425] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.797 [2024-04-27 02:40:54.188431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0000 p:0 m:0 dnr:0 00:21:20.797 [2024-04-27 02:40:54.188438] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x183500 00:21:20.797 [2024-04-27 02:40:54.188447] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.797 [2024-04-27 02:40:54.188455] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.797 [2024-04-27 02:40:54.188477] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.797 [2024-04-27 02:40:54.188482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:21:20.797 [2024-04-27 02:40:54.188489] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x183500 00:21:20.797 [2024-04-27 02:40:54.188498] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.797 [2024-04-27 02:40:54.188506] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.797 [2024-04-27 02:40:54.188522] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.797 [2024-04-27 02:40:54.188528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0002 p:0 m:0 dnr:0 00:21:20.797 [2024-04-27 02:40:54.188534] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x183500 00:21:20.797 [2024-04-27 02:40:54.188543] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.797 [2024-04-27 02:40:54.188551] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.797 [2024-04-27 02:40:54.188569] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.797 [2024-04-27 02:40:54.188575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0003 p:0 m:0 dnr:0 00:21:20.797 [2024-04-27 02:40:54.188581] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x183500 00:21:20.797 [2024-04-27 02:40:54.188590] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.797 [2024-04-27 02:40:54.188598] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.797 [2024-04-27 02:40:54.188620] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.797 [2024-04-27 02:40:54.188626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0004 p:0 m:0 dnr:0 00:21:20.797 [2024-04-27 02:40:54.188632] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x183500 00:21:20.797 [2024-04-27 02:40:54.188641] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.797 [2024-04-27 02:40:54.188649] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.797 [2024-04-27 02:40:54.188671] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.797 [2024-04-27 02:40:54.188676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0005 p:0 m:0 dnr:0 00:21:20.797 [2024-04-27 02:40:54.188683] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x183500 00:21:20.797 [2024-04-27 02:40:54.188692] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.797 [2024-04-27 02:40:54.188701] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.797 [2024-04-27 02:40:54.188715] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.797 [2024-04-27 02:40:54.188721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0006 p:0 m:0 dnr:0 00:21:20.797 [2024-04-27 02:40:54.188727] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x183500 00:21:20.797 [2024-04-27 02:40:54.188736] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.797 [2024-04-27 02:40:54.188744] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.797 [2024-04-27 02:40:54.188760] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.797 [2024-04-27 02:40:54.188766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:21:20.797 [2024-04-27 02:40:54.188772] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x183500 00:21:20.797 [2024-04-27 02:40:54.188781] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.797 [2024-04-27 02:40:54.188789] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.797 [2024-04-27 02:40:54.188805] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.797 [2024-04-27 02:40:54.188811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0008 p:0 m:0 dnr:0 00:21:20.797 [2024-04-27 02:40:54.188818] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x183500 00:21:20.797 [2024-04-27 02:40:54.188827] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.797 [2024-04-27 02:40:54.188835] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.797 [2024-04-27 02:40:54.188856] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.797 [2024-04-27 02:40:54.188862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0009 p:0 m:0 dnr:0 00:21:20.797 [2024-04-27 02:40:54.188868] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x183500 00:21:20.797 [2024-04-27 02:40:54.188877] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.797 [2024-04-27 02:40:54.188885] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.797 [2024-04-27 02:40:54.188905] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.797 [2024-04-27 02:40:54.188911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000a p:0 m:0 dnr:0 00:21:20.797 [2024-04-27 02:40:54.188917] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x183500 00:21:20.797 [2024-04-27 02:40:54.188926] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.797 [2024-04-27 02:40:54.188934] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.797 [2024-04-27 02:40:54.188950] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.797 [2024-04-27 02:40:54.188956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000b p:0 m:0 dnr:0 00:21:20.797 [2024-04-27 02:40:54.188962] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x183500 00:21:20.797 [2024-04-27 02:40:54.188973] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.797 [2024-04-27 02:40:54.188981] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.798 [2024-04-27 02:40:54.188999] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.798 [2024-04-27 02:40:54.189004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000c p:0 m:0 dnr:0 00:21:20.798 [2024-04-27 02:40:54.189011] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x183500 00:21:20.798 [2024-04-27 02:40:54.189020] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.798 [2024-04-27 02:40:54.189028] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.798 [2024-04-27 02:40:54.189044] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.798 [2024-04-27 02:40:54.189049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000d p:0 m:0 dnr:0 00:21:20.798 [2024-04-27 02:40:54.189056] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x183500 00:21:20.798 [2024-04-27 02:40:54.189065] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.798 [2024-04-27 02:40:54.189073] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.798 [2024-04-27 02:40:54.189089] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.798 [2024-04-27 02:40:54.189094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000e p:0 m:0 dnr:0 00:21:20.798 [2024-04-27 02:40:54.189101] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x183500 00:21:20.798 [2024-04-27 02:40:54.189110] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.798 [2024-04-27 02:40:54.189118] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.798 [2024-04-27 02:40:54.189136] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.798 [2024-04-27 02:40:54.189141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000f p:0 m:0 dnr:0 00:21:20.798 [2024-04-27 02:40:54.189148] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x183500 00:21:20.798 [2024-04-27 02:40:54.189157] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.798 [2024-04-27 02:40:54.189165] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.798 [2024-04-27 02:40:54.189188] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.798 [2024-04-27 02:40:54.189194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0010 p:0 m:0 dnr:0 00:21:20.798 [2024-04-27 02:40:54.189201] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x183500 00:21:20.798 [2024-04-27 02:40:54.189210] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.798 [2024-04-27 02:40:54.189218] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.798 [2024-04-27 02:40:54.189234] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.798 [2024-04-27 02:40:54.189239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0011 p:0 m:0 dnr:0 00:21:20.798 [2024-04-27 02:40:54.189246] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x183500 00:21:20.798 [2024-04-27 02:40:54.189256] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.798 [2024-04-27 02:40:54.189264] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.798 [2024-04-27 02:40:54.189286] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.798 [2024-04-27 02:40:54.189292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0012 p:0 m:0 dnr:0 00:21:20.798 [2024-04-27 02:40:54.189298] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x183500 00:21:20.798 [2024-04-27 02:40:54.189307] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.798 [2024-04-27 02:40:54.189315] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.798 [2024-04-27 02:40:54.189342] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.798 [2024-04-27 02:40:54.189348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0013 p:0 m:0 dnr:0 00:21:20.798 [2024-04-27 02:40:54.189355] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x183500 00:21:20.798 [2024-04-27 02:40:54.189364] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.798 [2024-04-27 02:40:54.189371] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.798 [2024-04-27 02:40:54.189389] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.798 [2024-04-27 02:40:54.189395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0014 p:0 m:0 dnr:0 00:21:20.798 [2024-04-27 02:40:54.189402] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x183500 00:21:20.798 [2024-04-27 02:40:54.189411] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.798 [2024-04-27 02:40:54.189419] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.798 [2024-04-27 02:40:54.189442] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.798 [2024-04-27 02:40:54.189448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0015 p:0 m:0 dnr:0 00:21:20.798 [2024-04-27 02:40:54.189454] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x183500 00:21:20.798 [2024-04-27 02:40:54.189463] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.798 [2024-04-27 02:40:54.189471] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.798 [2024-04-27 02:40:54.189487] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.798 [2024-04-27 02:40:54.189493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0016 p:0 m:0 dnr:0 00:21:20.798 [2024-04-27 02:40:54.189499] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x183500 00:21:20.798 [2024-04-27 02:40:54.189508] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.798 [2024-04-27 02:40:54.189516] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.798 [2024-04-27 02:40:54.189532] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.798 [2024-04-27 02:40:54.189538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0017 p:0 m:0 dnr:0 00:21:20.798 [2024-04-27 02:40:54.189546] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x183500 00:21:20.798 [2024-04-27 02:40:54.189555] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.798 [2024-04-27 02:40:54.189562] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.798 [2024-04-27 02:40:54.189584] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.798 [2024-04-27 02:40:54.189590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0018 p:0 m:0 dnr:0 00:21:20.798 [2024-04-27 02:40:54.189596] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x183500 00:21:20.798 [2024-04-27 02:40:54.189605] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.798 [2024-04-27 02:40:54.189613] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.798 [2024-04-27 02:40:54.189629] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.798 [2024-04-27 02:40:54.189635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0019 p:0 m:0 dnr:0 00:21:20.798 [2024-04-27 02:40:54.189641] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x183500 00:21:20.798 [2024-04-27 02:40:54.189650] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.798 [2024-04-27 02:40:54.189658] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.798 [2024-04-27 02:40:54.189680] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.798 [2024-04-27 02:40:54.189685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001a p:0 m:0 dnr:0 00:21:20.799 [2024-04-27 02:40:54.189692] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x183500 00:21:20.799 [2024-04-27 02:40:54.189701] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.799 [2024-04-27 02:40:54.189709] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.799 [2024-04-27 02:40:54.189725] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.799 [2024-04-27 02:40:54.189730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001b p:0 m:0 dnr:0 00:21:20.799 [2024-04-27 02:40:54.189737] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x183500 00:21:20.799 [2024-04-27 02:40:54.189746] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.799 [2024-04-27 02:40:54.189754] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.799 [2024-04-27 02:40:54.189770] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.799 [2024-04-27 02:40:54.189775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001c p:0 m:0 dnr:0 00:21:20.799 [2024-04-27 02:40:54.189782] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x183500 00:21:20.799 [2024-04-27 02:40:54.189791] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.799 [2024-04-27 02:40:54.189799] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.799 [2024-04-27 02:40:54.189815] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.799 [2024-04-27 02:40:54.189821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001d p:0 m:0 dnr:0 00:21:20.799 [2024-04-27 02:40:54.189829] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x183500 00:21:20.799 [2024-04-27 02:40:54.189838] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.799 [2024-04-27 02:40:54.189846] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.799 [2024-04-27 02:40:54.189860] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.799 [2024-04-27 02:40:54.189865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001e p:0 m:0 dnr:0 00:21:20.799 [2024-04-27 02:40:54.189872] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x183500 00:21:20.799 [2024-04-27 02:40:54.189881] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.799 [2024-04-27 02:40:54.189889] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.799 [2024-04-27 02:40:54.189903] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.799 [2024-04-27 02:40:54.189908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001f p:0 m:0 dnr:0 00:21:20.799 [2024-04-27 02:40:54.189915] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x183500 00:21:20.799 [2024-04-27 02:40:54.189924] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.799 [2024-04-27 02:40:54.189932] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.799 [2024-04-27 02:40:54.189948] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.799 [2024-04-27 02:40:54.189954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0000 p:0 m:0 dnr:0 00:21:20.799 [2024-04-27 02:40:54.189960] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x183500 00:21:20.799 [2024-04-27 02:40:54.189969] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.799 [2024-04-27 02:40:54.189977] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.799 [2024-04-27 02:40:54.190001] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.799 [2024-04-27 02:40:54.190006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:21:20.799 [2024-04-27 02:40:54.190013] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x183500 00:21:20.799 [2024-04-27 02:40:54.190022] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.799 [2024-04-27 02:40:54.190030] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.799 [2024-04-27 02:40:54.190053] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.799 [2024-04-27 02:40:54.190059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0002 p:0 m:0 dnr:0 00:21:20.799 [2024-04-27 02:40:54.190065] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x183500 00:21:20.799 [2024-04-27 02:40:54.190074] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.799 [2024-04-27 02:40:54.190082] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.799 [2024-04-27 02:40:54.190098] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.799 [2024-04-27 02:40:54.190106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0003 p:0 m:0 dnr:0 00:21:20.799 [2024-04-27 02:40:54.190112] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x183500 00:21:20.799 [2024-04-27 02:40:54.190121] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.799 [2024-04-27 02:40:54.190129] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.799 [2024-04-27 02:40:54.190143] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.799 [2024-04-27 02:40:54.190149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0004 p:0 m:0 dnr:0 00:21:20.799 [2024-04-27 02:40:54.190155] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x183500 00:21:20.799 [2024-04-27 02:40:54.190164] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.799 [2024-04-27 02:40:54.190172] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.799 [2024-04-27 02:40:54.190186] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.799 [2024-04-27 02:40:54.190192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0005 p:0 m:0 dnr:0 00:21:20.799 [2024-04-27 02:40:54.190198] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x183500 00:21:20.799 [2024-04-27 02:40:54.190207] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.799 [2024-04-27 02:40:54.190215] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.799 [2024-04-27 02:40:54.190237] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.799 [2024-04-27 02:40:54.190243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0006 p:0 m:0 dnr:0 00:21:20.799 [2024-04-27 02:40:54.190249] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x183500 00:21:20.799 [2024-04-27 02:40:54.190258] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.799 [2024-04-27 02:40:54.190266] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.799 [2024-04-27 02:40:54.190288] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.799 [2024-04-27 02:40:54.190294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:21:20.799 [2024-04-27 02:40:54.190300] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x183500 00:21:20.799 [2024-04-27 02:40:54.190309] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.799 [2024-04-27 02:40:54.190317] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.799 [2024-04-27 02:40:54.194344] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.799 [2024-04-27 02:40:54.194351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0008 p:0 m:0 dnr:0 00:21:20.799 [2024-04-27 02:40:54.194358] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x183500 00:21:20.799 [2024-04-27 02:40:54.194367] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.799 [2024-04-27 02:40:54.194375] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.799 [2024-04-27 02:40:54.194393] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.799 [2024-04-27 02:40:54.194400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:9 sqhd:0009 p:0 m:0 dnr:0 00:21:20.799 [2024-04-27 02:40:54.194407] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x183500 00:21:20.799 [2024-04-27 02:40:54.194414] nvme_ctrlr.c:1204:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 6 milliseconds 00:21:20.799 128 00:21:20.799 Transport Service Identifier: 4420 00:21:20.799 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:21:20.799 Transport Address: 192.168.100.8 00:21:20.799 Transport Specific Address Subtype - RDMA 00:21:20.799 RDMA QP Service Type: 1 (Reliable Connected) 00:21:20.799 RDMA Provider Type: 1 (No provider specified) 00:21:20.799 RDMA CM Service: 1 (RDMA_CM) 00:21:20.799 02:40:54 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:21:20.799 [2024-04-27 02:40:54.271818] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:21:20.799 [2024-04-27 02:40:54.271861] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1611983 ] 00:21:20.799 EAL: No free 2048 kB hugepages reported on node 1 00:21:20.799 [2024-04-27 02:40:54.321606] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:21:20.799 [2024-04-27 02:40:54.321681] nvme_rdma.c:2261:nvme_rdma_ctrlr_construct: *DEBUG*: successfully initialized the nvmf ctrlr 00:21:20.799 [2024-04-27 02:40:54.321696] nvme_rdma.c:1291:nvme_rdma_ctrlr_connect_qpair: *DEBUG*: adrfam 1 ai_family 2 00:21:20.800 [2024-04-27 02:40:54.321701] nvme_rdma.c:1295:nvme_rdma_ctrlr_connect_qpair: *DEBUG*: trsvcid is 4420 00:21:20.800 [2024-04-27 02:40:54.321727] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:21:20.800 [2024-04-27 02:40:54.332888] nvme_rdma.c: 510:nvme_rdma_qpair_process_cm_event: *DEBUG*: Requested queue depth 32. Target receive queue depth 32. 00:21:20.800 [2024-04-27 02:40:54.343154] nvme_rdma.c:1180:nvme_rdma_connect_established: *DEBUG*: rc =0 00:21:20.800 [2024-04-27 02:40:54.343164] nvme_rdma.c:1185:nvme_rdma_connect_established: *DEBUG*: RDMA requests created 00:21:20.800 [2024-04-27 02:40:54.343171] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.343179] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.343186] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.343192] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.343199] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.343205] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.343212] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.343218] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.343224] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.343231] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.343240] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.343246] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.343253] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.343259] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.343266] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.343272] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.343279] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.343285] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.343292] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.343298] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.343304] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.343311] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.343317] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.343324] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.343330] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.343339] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.343346] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.343352] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.343359] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.343365] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.343372] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.343378] nvme_rdma.c:1199:nvme_rdma_connect_established: *DEBUG*: RDMA responses created 00:21:20.800 [2024-04-27 02:40:54.343387] nvme_rdma.c:1202:nvme_rdma_connect_established: *DEBUG*: rc =0 00:21:20.800 [2024-04-27 02:40:54.343392] nvme_rdma.c:1207:nvme_rdma_connect_established: *DEBUG*: RDMA responses submitted 00:21:20.800 [2024-04-27 02:40:54.343407] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.343419] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf200 len:0x400 key:0x183500 00:21:20.800 [2024-04-27 02:40:54.348345] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.800 [2024-04-27 02:40:54.348354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:21:20.800 [2024-04-27 02:40:54.348362] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.348369] nvme_fabric.c: 622:_nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:21:20.800 [2024-04-27 02:40:54.348376] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:21:20.800 [2024-04-27 02:40:54.348383] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:21:20.800 [2024-04-27 02:40:54.348400] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.348409] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.800 [2024-04-27 02:40:54.348430] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.800 [2024-04-27 02:40:54.348436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:10300 sqhd:0002 p:0 m:0 dnr:0 00:21:20.800 [2024-04-27 02:40:54.348445] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:21:20.800 [2024-04-27 02:40:54.348451] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.348458] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:21:20.800 [2024-04-27 02:40:54.348466] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.348474] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.800 [2024-04-27 02:40:54.348494] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.800 [2024-04-27 02:40:54.348500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1e01007f sqhd:0003 p:0 m:0 dnr:0 00:21:20.800 [2024-04-27 02:40:54.348507] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:21:20.800 [2024-04-27 02:40:54.348513] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.348520] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:21:20.800 [2024-04-27 02:40:54.348528] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.348536] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.800 [2024-04-27 02:40:54.348552] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.800 [2024-04-27 02:40:54.348558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0004 p:0 m:0 dnr:0 00:21:20.800 [2024-04-27 02:40:54.348565] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:21:20.800 [2024-04-27 02:40:54.348571] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.348580] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.348588] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.800 [2024-04-27 02:40:54.348608] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.800 [2024-04-27 02:40:54.348614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0005 p:0 m:0 dnr:0 00:21:20.800 [2024-04-27 02:40:54.348620] nvme_ctrlr.c:3749:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:21:20.800 [2024-04-27 02:40:54.348626] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:21:20.800 [2024-04-27 02:40:54.348633] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.348640] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:21:20.800 [2024-04-27 02:40:54.348749] nvme_ctrlr.c:3942:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:21:20.800 [2024-04-27 02:40:54.348754] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:21:20.800 [2024-04-27 02:40:54.348763] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.348771] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.800 [2024-04-27 02:40:54.348789] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.800 [2024-04-27 02:40:54.348795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0006 p:0 m:0 dnr:0 00:21:20.800 [2024-04-27 02:40:54.348801] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:21:20.800 [2024-04-27 02:40:54.348808] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.348816] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183500 00:21:20.800 [2024-04-27 02:40:54.348824] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.800 [2024-04-27 02:40:54.348846] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.800 [2024-04-27 02:40:54.348852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:21:20.800 [2024-04-27 02:40:54.348858] nvme_ctrlr.c:3784:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:21:20.801 [2024-04-27 02:40:54.348864] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:21:20.801 [2024-04-27 02:40:54.348870] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x183500 00:21:20.801 [2024-04-27 02:40:54.348877] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:21:20.801 [2024-04-27 02:40:54.348886] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:21:20.801 [2024-04-27 02:40:54.348895] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183500 00:21:20.801 [2024-04-27 02:40:54.348903] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0x183500 00:21:20.801 [2024-04-27 02:40:54.348938] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.801 [2024-04-27 02:40:54.348944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0008 p:0 m:0 dnr:0 00:21:20.801 [2024-04-27 02:40:54.348953] nvme_ctrlr.c:1984:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:21:20.801 [2024-04-27 02:40:54.348959] nvme_ctrlr.c:1988:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:21:20.801 [2024-04-27 02:40:54.348965] nvme_ctrlr.c:1991:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:21:20.801 [2024-04-27 02:40:54.348973] nvme_ctrlr.c:2015:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:21:20.801 [2024-04-27 02:40:54.348979] nvme_ctrlr.c:2030:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:21:20.801 [2024-04-27 02:40:54.348985] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:21:20.801 [2024-04-27 02:40:54.348992] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x183500 00:21:20.801 [2024-04-27 02:40:54.349000] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:21:20.801 [2024-04-27 02:40:54.349008] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183500 00:21:20.801 [2024-04-27 02:40:54.349016] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.801 [2024-04-27 02:40:54.349040] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.801 [2024-04-27 02:40:54.349046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0009 p:0 m:0 dnr:0 00:21:20.801 [2024-04-27 02:40:54.349054] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0500 length 0x40 lkey 0x183500 00:21:20.801 [2024-04-27 02:40:54.349062] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:21:20.801 [2024-04-27 02:40:54.349069] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0640 length 0x40 lkey 0x183500 00:21:20.801 [2024-04-27 02:40:54.349076] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:21:20.801 [2024-04-27 02:40:54.349083] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.801 [2024-04-27 02:40:54.349090] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:21:20.801 [2024-04-27 02:40:54.349098] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d08c0 length 0x40 lkey 0x183500 00:21:20.801 [2024-04-27 02:40:54.349105] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:21:20.801 [2024-04-27 02:40:54.349111] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:21:20.801 [2024-04-27 02:40:54.349117] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x183500 00:21:20.801 [2024-04-27 02:40:54.349127] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:21:20.801 [2024-04-27 02:40:54.349135] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183500 00:21:20.801 [2024-04-27 02:40:54.349143] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:0 cdw10:0000000f SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.801 [2024-04-27 02:40:54.349163] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.801 [2024-04-27 02:40:54.349169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:2710 sqhd:000a p:0 m:0 dnr:0 00:21:20.801 [2024-04-27 02:40:54.349175] nvme_ctrlr.c:2902:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:21:20.801 [2024-04-27 02:40:54.349182] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:21:20.801 [2024-04-27 02:40:54.349188] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x183500 00:21:20.801 [2024-04-27 02:40:54.349195] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:21:20.801 [2024-04-27 02:40:54.349202] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:21:20.801 [2024-04-27 02:40:54.349210] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183500 00:21:20.801 [2024-04-27 02:40:54.349219] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:0 cdw10:00000007 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.801 [2024-04-27 02:40:54.349241] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.801 [2024-04-27 02:40:54.349247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:7e007e sqhd:000b p:0 m:0 dnr:0 00:21:20.801 [2024-04-27 02:40:54.349288] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:21:20.801 [2024-04-27 02:40:54.349295] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x183500 00:21:20.801 [2024-04-27 02:40:54.349303] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:21:20.801 [2024-04-27 02:40:54.349312] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183500 00:21:20.801 [2024-04-27 02:40:54.349319] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000002 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003cc000 len:0x1000 key:0x183500 00:21:20.801 [2024-04-27 02:40:54.349347] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.801 [2024-04-27 02:40:54.349353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000c p:0 m:0 dnr:0 00:21:20.801 [2024-04-27 02:40:54.349363] nvme_ctrlr.c:4557:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:21:20.801 [2024-04-27 02:40:54.349376] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:21:20.801 [2024-04-27 02:40:54.349383] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x183500 00:21:20.801 [2024-04-27 02:40:54.349391] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:21:20.801 [2024-04-27 02:40:54.349400] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183500 00:21:20.801 [2024-04-27 02:40:54.349408] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:1 cdw10:00000000 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0x183500 00:21:20.801 [2024-04-27 02:40:54.349439] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.801 [2024-04-27 02:40:54.349445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000d p:0 m:0 dnr:0 00:21:20.801 [2024-04-27 02:40:54.349457] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:21:20.801 [2024-04-27 02:40:54.349464] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x183500 00:21:20.801 [2024-04-27 02:40:54.349472] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:21:20.801 [2024-04-27 02:40:54.349480] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183500 00:21:20.801 [2024-04-27 02:40:54.349488] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:1 cdw10:00000003 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0x183500 00:21:20.801 [2024-04-27 02:40:54.349512] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.801 [2024-04-27 02:40:54.349517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000e p:0 m:0 dnr:0 00:21:20.801 [2024-04-27 02:40:54.349526] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:21:20.801 [2024-04-27 02:40:54.349533] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x183500 00:21:20.801 [2024-04-27 02:40:54.349542] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:21:20.801 [2024-04-27 02:40:54.349551] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:21:20.801 [2024-04-27 02:40:54.349558] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:21:20.801 [2024-04-27 02:40:54.349565] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:21:20.801 [2024-04-27 02:40:54.349572] nvme_ctrlr.c:2990:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:21:20.801 [2024-04-27 02:40:54.349578] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:21:20.801 [2024-04-27 02:40:54.349585] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:21:20.801 [2024-04-27 02:40:54.349599] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183500 00:21:20.801 [2024-04-27 02:40:54.349607] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:0 cdw10:00000001 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.801 [2024-04-27 02:40:54.349615] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x183500 00:21:20.801 [2024-04-27 02:40:54.349622] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:21:20.801 [2024-04-27 02:40:54.349633] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.801 [2024-04-27 02:40:54.349639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000f p:0 m:0 dnr:0 00:21:20.801 [2024-04-27 02:40:54.349646] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x183500 00:21:20.801 [2024-04-27 02:40:54.349652] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.801 [2024-04-27 02:40:54.349658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:0010 p:0 m:0 dnr:0 00:21:20.802 [2024-04-27 02:40:54.349664] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x183500 00:21:20.802 [2024-04-27 02:40:54.349674] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x183500 00:21:20.802 [2024-04-27 02:40:54.349681] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.802 [2024-04-27 02:40:54.349704] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.802 [2024-04-27 02:40:54.349710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:0011 p:0 m:0 dnr:0 00:21:20.802 [2024-04-27 02:40:54.349716] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x183500 00:21:20.802 [2024-04-27 02:40:54.349725] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x183500 00:21:20.802 [2024-04-27 02:40:54.349733] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.802 [2024-04-27 02:40:54.349756] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.802 [2024-04-27 02:40:54.349762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:0012 p:0 m:0 dnr:0 00:21:20.802 [2024-04-27 02:40:54.349768] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x183500 00:21:20.802 [2024-04-27 02:40:54.349777] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x183500 00:21:20.802 [2024-04-27 02:40:54.349787] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.802 [2024-04-27 02:40:54.349807] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.802 [2024-04-27 02:40:54.349813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:7e007e sqhd:0013 p:0 m:0 dnr:0 00:21:20.802 [2024-04-27 02:40:54.349819] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x183500 00:21:20.802 [2024-04-27 02:40:54.349831] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x183500 00:21:20.802 [2024-04-27 02:40:54.349838] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003c9000 len:0x2000 key:0x183500 00:21:20.802 [2024-04-27 02:40:54.349847] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183500 00:21:20.802 [2024-04-27 02:40:54.349855] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:0 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf000 len:0x200 key:0x183500 00:21:20.802 [2024-04-27 02:40:54.349864] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0b40 length 0x40 lkey 0x183500 00:21:20.802 [2024-04-27 02:40:54.349871] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x200 key:0x183500 00:21:20.802 [2024-04-27 02:40:54.349880] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0c80 length 0x40 lkey 0x183500 00:21:20.802 [2024-04-27 02:40:54.349888] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003c7000 len:0x1000 key:0x183500 00:21:20.802 [2024-04-27 02:40:54.349896] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.802 [2024-04-27 02:40:54.349902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:0014 p:0 m:0 dnr:0 00:21:20.802 [2024-04-27 02:40:54.349916] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x183500 00:21:20.802 [2024-04-27 02:40:54.349923] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.802 [2024-04-27 02:40:54.349929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0015 p:0 m:0 dnr:0 00:21:20.802 [2024-04-27 02:40:54.349938] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x183500 00:21:20.802 [2024-04-27 02:40:54.349945] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.802 [2024-04-27 02:40:54.349951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:6 cdw0:0 sqhd:0016 p:0 m:0 dnr:0 00:21:20.802 [2024-04-27 02:40:54.349959] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x183500 00:21:20.802 [2024-04-27 02:40:54.349965] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.802 [2024-04-27 02:40:54.349970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:7 cdw0:0 sqhd:0017 p:0 m:0 dnr:0 00:21:20.802 [2024-04-27 02:40:54.349981] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x183500 00:21:20.802 ===================================================== 00:21:20.802 NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:21:20.802 ===================================================== 00:21:20.802 Controller Capabilities/Features 00:21:20.802 ================================ 00:21:20.802 Vendor ID: 8086 00:21:20.802 Subsystem Vendor ID: 8086 00:21:20.802 Serial Number: SPDK00000000000001 00:21:20.802 Model Number: SPDK bdev Controller 00:21:20.802 Firmware Version: 24.05 00:21:20.802 Recommended Arb Burst: 6 00:21:20.802 IEEE OUI Identifier: e4 d2 5c 00:21:20.802 Multi-path I/O 00:21:20.802 May have multiple subsystem ports: Yes 00:21:20.802 May have multiple controllers: Yes 00:21:20.802 Associated with SR-IOV VF: No 00:21:20.802 Max Data Transfer Size: 131072 00:21:20.802 Max Number of Namespaces: 32 00:21:20.802 Max Number of I/O Queues: 127 00:21:20.802 NVMe Specification Version (VS): 1.3 00:21:20.802 NVMe Specification Version (Identify): 1.3 00:21:20.802 Maximum Queue Entries: 128 00:21:20.802 Contiguous Queues Required: Yes 00:21:20.802 Arbitration Mechanisms Supported 00:21:20.802 Weighted Round Robin: Not Supported 00:21:20.802 Vendor Specific: Not Supported 00:21:20.802 Reset Timeout: 15000 ms 00:21:20.802 Doorbell Stride: 4 bytes 00:21:20.802 NVM Subsystem Reset: Not Supported 00:21:20.802 Command Sets Supported 00:21:20.802 NVM Command Set: Supported 00:21:20.802 Boot Partition: Not Supported 00:21:20.802 Memory Page Size Minimum: 4096 bytes 00:21:20.802 Memory Page Size Maximum: 4096 bytes 00:21:20.802 Persistent Memory Region: Not Supported 00:21:20.802 Optional Asynchronous Events Supported 00:21:20.802 Namespace Attribute Notices: Supported 00:21:20.802 Firmware Activation Notices: Not Supported 00:21:20.802 ANA Change Notices: Not Supported 00:21:20.802 PLE Aggregate Log Change Notices: Not Supported 00:21:20.802 LBA Status Info Alert Notices: Not Supported 00:21:20.802 EGE Aggregate Log Change Notices: Not Supported 00:21:20.802 Normal NVM Subsystem Shutdown event: Not Supported 00:21:20.802 Zone Descriptor Change Notices: Not Supported 00:21:20.802 Discovery Log Change Notices: Not Supported 00:21:20.802 Controller Attributes 00:21:20.802 128-bit Host Identifier: Supported 00:21:20.802 Non-Operational Permissive Mode: Not Supported 00:21:20.802 NVM Sets: Not Supported 00:21:20.802 Read Recovery Levels: Not Supported 00:21:20.802 Endurance Groups: Not Supported 00:21:20.802 Predictable Latency Mode: Not Supported 00:21:20.802 Traffic Based Keep ALive: Not Supported 00:21:20.802 Namespace Granularity: Not Supported 00:21:20.802 SQ Associations: Not Supported 00:21:20.802 UUID List: Not Supported 00:21:20.802 Multi-Domain Subsystem: Not Supported 00:21:20.802 Fixed Capacity Management: Not Supported 00:21:20.802 Variable Capacity Management: Not Supported 00:21:20.802 Delete Endurance Group: Not Supported 00:21:20.802 Delete NVM Set: Not Supported 00:21:20.802 Extended LBA Formats Supported: Not Supported 00:21:20.802 Flexible Data Placement Supported: Not Supported 00:21:20.802 00:21:20.802 Controller Memory Buffer Support 00:21:20.802 ================================ 00:21:20.802 Supported: No 00:21:20.802 00:21:20.802 Persistent Memory Region Support 00:21:20.802 ================================ 00:21:20.802 Supported: No 00:21:20.802 00:21:20.802 Admin Command Set Attributes 00:21:20.802 ============================ 00:21:20.802 Security Send/Receive: Not Supported 00:21:20.802 Format NVM: Not Supported 00:21:20.802 Firmware Activate/Download: Not Supported 00:21:20.802 Namespace Management: Not Supported 00:21:20.802 Device Self-Test: Not Supported 00:21:20.802 Directives: Not Supported 00:21:20.802 NVMe-MI: Not Supported 00:21:20.802 Virtualization Management: Not Supported 00:21:20.802 Doorbell Buffer Config: Not Supported 00:21:20.803 Get LBA Status Capability: Not Supported 00:21:20.803 Command & Feature Lockdown Capability: Not Supported 00:21:20.803 Abort Command Limit: 4 00:21:20.803 Async Event Request Limit: 4 00:21:20.803 Number of Firmware Slots: N/A 00:21:20.803 Firmware Slot 1 Read-Only: N/A 00:21:20.803 Firmware Activation Without Reset: N/A 00:21:20.803 Multiple Update Detection Support: N/A 00:21:20.803 Firmware Update Granularity: No Information Provided 00:21:20.803 Per-Namespace SMART Log: No 00:21:20.803 Asymmetric Namespace Access Log Page: Not Supported 00:21:20.803 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:21:20.803 Command Effects Log Page: Supported 00:21:20.803 Get Log Page Extended Data: Supported 00:21:20.803 Telemetry Log Pages: Not Supported 00:21:20.803 Persistent Event Log Pages: Not Supported 00:21:20.803 Supported Log Pages Log Page: May Support 00:21:20.803 Commands Supported & Effects Log Page: Not Supported 00:21:20.803 Feature Identifiers & Effects Log Page:May Support 00:21:20.803 NVMe-MI Commands & Effects Log Page: May Support 00:21:20.803 Data Area 4 for Telemetry Log: Not Supported 00:21:20.803 Error Log Page Entries Supported: 128 00:21:20.803 Keep Alive: Supported 00:21:20.803 Keep Alive Granularity: 10000 ms 00:21:20.803 00:21:20.803 NVM Command Set Attributes 00:21:20.803 ========================== 00:21:20.803 Submission Queue Entry Size 00:21:20.803 Max: 64 00:21:20.803 Min: 64 00:21:20.803 Completion Queue Entry Size 00:21:20.803 Max: 16 00:21:20.803 Min: 16 00:21:20.803 Number of Namespaces: 32 00:21:20.803 Compare Command: Supported 00:21:20.803 Write Uncorrectable Command: Not Supported 00:21:20.803 Dataset Management Command: Supported 00:21:20.803 Write Zeroes Command: Supported 00:21:20.803 Set Features Save Field: Not Supported 00:21:20.803 Reservations: Supported 00:21:20.803 Timestamp: Not Supported 00:21:20.803 Copy: Supported 00:21:20.803 Volatile Write Cache: Present 00:21:20.803 Atomic Write Unit (Normal): 1 00:21:20.803 Atomic Write Unit (PFail): 1 00:21:20.803 Atomic Compare & Write Unit: 1 00:21:20.803 Fused Compare & Write: Supported 00:21:20.803 Scatter-Gather List 00:21:20.803 SGL Command Set: Supported 00:21:20.803 SGL Keyed: Supported 00:21:20.803 SGL Bit Bucket Descriptor: Not Supported 00:21:20.803 SGL Metadata Pointer: Not Supported 00:21:20.803 Oversized SGL: Not Supported 00:21:20.803 SGL Metadata Address: Not Supported 00:21:20.803 SGL Offset: Supported 00:21:20.803 Transport SGL Data Block: Not Supported 00:21:20.803 Replay Protected Memory Block: Not Supported 00:21:20.803 00:21:20.803 Firmware Slot Information 00:21:20.803 ========================= 00:21:20.803 Active slot: 1 00:21:20.803 Slot 1 Firmware Revision: 24.05 00:21:20.803 00:21:20.803 00:21:20.803 Commands Supported and Effects 00:21:20.803 ============================== 00:21:20.803 Admin Commands 00:21:20.803 -------------- 00:21:20.803 Get Log Page (02h): Supported 00:21:20.803 Identify (06h): Supported 00:21:20.803 Abort (08h): Supported 00:21:20.803 Set Features (09h): Supported 00:21:20.803 Get Features (0Ah): Supported 00:21:20.803 Asynchronous Event Request (0Ch): Supported 00:21:20.803 Keep Alive (18h): Supported 00:21:20.803 I/O Commands 00:21:20.803 ------------ 00:21:20.803 Flush (00h): Supported LBA-Change 00:21:20.803 Write (01h): Supported LBA-Change 00:21:20.803 Read (02h): Supported 00:21:20.803 Compare (05h): Supported 00:21:20.803 Write Zeroes (08h): Supported LBA-Change 00:21:20.803 Dataset Management (09h): Supported LBA-Change 00:21:20.803 Copy (19h): Supported LBA-Change 00:21:20.803 Unknown (79h): Supported LBA-Change 00:21:20.803 Unknown (7Ah): Supported 00:21:20.803 00:21:20.803 Error Log 00:21:20.803 ========= 00:21:20.803 00:21:20.803 Arbitration 00:21:20.803 =========== 00:21:20.803 Arbitration Burst: 1 00:21:20.803 00:21:20.803 Power Management 00:21:20.803 ================ 00:21:20.803 Number of Power States: 1 00:21:20.803 Current Power State: Power State #0 00:21:20.803 Power State #0: 00:21:20.803 Max Power: 0.00 W 00:21:20.803 Non-Operational State: Operational 00:21:20.803 Entry Latency: Not Reported 00:21:20.803 Exit Latency: Not Reported 00:21:20.803 Relative Read Throughput: 0 00:21:20.803 Relative Read Latency: 0 00:21:20.803 Relative Write Throughput: 0 00:21:20.803 Relative Write Latency: 0 00:21:20.803 Idle Power: Not Reported 00:21:20.803 Active Power: Not Reported 00:21:20.803 Non-Operational Permissive Mode: Not Supported 00:21:20.803 00:21:20.803 Health Information 00:21:20.803 ================== 00:21:20.803 Critical Warnings: 00:21:20.803 Available Spare Space: OK 00:21:20.803 Temperature: OK 00:21:20.803 Device Reliability: OK 00:21:20.803 Read Only: No 00:21:20.803 Volatile Memory Backup: OK 00:21:20.803 Current Temperature: 0 Kelvin (-273 Celsius) 00:21:20.803 Temperature Threshold: [2024-04-27 02:40:54.350064] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0c80 length 0x40 lkey 0x183500 00:21:20.803 [2024-04-27 02:40:54.350073] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.803 [2024-04-27 02:40:54.350097] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.803 [2024-04-27 02:40:54.350104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:7 cdw0:0 sqhd:0018 p:0 m:0 dnr:0 00:21:20.803 [2024-04-27 02:40:54.350110] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x183500 00:21:20.803 [2024-04-27 02:40:54.350135] nvme_ctrlr.c:4221:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:21:20.803 [2024-04-27 02:40:54.350144] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 27252 doesn't match qid 00:21:20.803 [2024-04-27 02:40:54.350160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32674 cdw0:5 sqhd:8790 p:0 m:0 dnr:0 00:21:20.803 [2024-04-27 02:40:54.350167] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 27252 doesn't match qid 00:21:20.803 [2024-04-27 02:40:54.350176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32674 cdw0:5 sqhd:8790 p:0 m:0 dnr:0 00:21:20.803 [2024-04-27 02:40:54.350182] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 27252 doesn't match qid 00:21:20.803 [2024-04-27 02:40:54.350191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32674 cdw0:5 sqhd:8790 p:0 m:0 dnr:0 00:21:20.803 [2024-04-27 02:40:54.350197] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 27252 doesn't match qid 00:21:20.803 [2024-04-27 02:40:54.350206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32674 cdw0:5 sqhd:8790 p:0 m:0 dnr:0 00:21:20.803 [2024-04-27 02:40:54.350215] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d08c0 length 0x40 lkey 0x183500 00:21:20.803 [2024-04-27 02:40:54.350223] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:4 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.803 [2024-04-27 02:40:54.350244] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.803 [2024-04-27 02:40:54.350250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:4 cdw0:460001 sqhd:0019 p:0 m:0 dnr:0 00:21:20.803 [2024-04-27 02:40:54.350258] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.803 [2024-04-27 02:40:54.350266] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.803 [2024-04-27 02:40:54.350273] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x183500 00:21:20.803 [2024-04-27 02:40:54.350291] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.803 [2024-04-27 02:40:54.350297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:0 sqhd:001a p:0 m:0 dnr:0 00:21:20.803 [2024-04-27 02:40:54.350304] nvme_ctrlr.c:1082:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:21:20.803 [2024-04-27 02:40:54.350310] nvme_ctrlr.c:1085:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:21:20.803 [2024-04-27 02:40:54.350317] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x183500 00:21:20.803 [2024-04-27 02:40:54.350327] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.803 [2024-04-27 02:40:54.350341] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.803 [2024-04-27 02:40:54.350359] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.803 [2024-04-27 02:40:54.350365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001b p:0 m:0 dnr:0 00:21:20.803 [2024-04-27 02:40:54.350371] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x183500 00:21:20.803 [2024-04-27 02:40:54.350381] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.803 [2024-04-27 02:40:54.350389] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.803 [2024-04-27 02:40:54.350405] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.803 [2024-04-27 02:40:54.350413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001c p:0 m:0 dnr:0 00:21:20.803 [2024-04-27 02:40:54.350420] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x183500 00:21:20.803 [2024-04-27 02:40:54.350429] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.803 [2024-04-27 02:40:54.350438] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.803 [2024-04-27 02:40:54.350453] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.803 [2024-04-27 02:40:54.350459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001d p:0 m:0 dnr:0 00:21:20.804 [2024-04-27 02:40:54.350465] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x183500 00:21:20.804 [2024-04-27 02:40:54.350474] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.804 [2024-04-27 02:40:54.350482] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.804 [2024-04-27 02:40:54.350506] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.804 [2024-04-27 02:40:54.350513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001e p:0 m:0 dnr:0 00:21:20.804 [2024-04-27 02:40:54.350520] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x183500 00:21:20.804 [2024-04-27 02:40:54.350529] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.804 [2024-04-27 02:40:54.350537] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.804 [2024-04-27 02:40:54.350556] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.804 [2024-04-27 02:40:54.350563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001f p:0 m:0 dnr:0 00:21:20.804 [2024-04-27 02:40:54.350571] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x183500 00:21:20.804 [2024-04-27 02:40:54.350580] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.804 [2024-04-27 02:40:54.350590] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.804 [2024-04-27 02:40:54.350606] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.804 [2024-04-27 02:40:54.350612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0000 p:0 m:0 dnr:0 00:21:20.804 [2024-04-27 02:40:54.350621] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x183500 00:21:20.804 [2024-04-27 02:40:54.350630] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.804 [2024-04-27 02:40:54.350639] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.804 [2024-04-27 02:40:54.350656] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.804 [2024-04-27 02:40:54.350662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:21:20.804 [2024-04-27 02:40:54.350669] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x183500 00:21:20.804 [2024-04-27 02:40:54.350678] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.804 [2024-04-27 02:40:54.350686] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.804 [2024-04-27 02:40:54.350702] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.804 [2024-04-27 02:40:54.350708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0002 p:0 m:0 dnr:0 00:21:20.804 [2024-04-27 02:40:54.350715] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x183500 00:21:20.804 [2024-04-27 02:40:54.350724] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.804 [2024-04-27 02:40:54.350732] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.804 [2024-04-27 02:40:54.350753] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.804 [2024-04-27 02:40:54.350760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0003 p:0 m:0 dnr:0 00:21:20.804 [2024-04-27 02:40:54.350767] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x183500 00:21:20.804 [2024-04-27 02:40:54.350776] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.804 [2024-04-27 02:40:54.350784] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.804 [2024-04-27 02:40:54.350804] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.804 [2024-04-27 02:40:54.350810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0004 p:0 m:0 dnr:0 00:21:20.804 [2024-04-27 02:40:54.350816] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x183500 00:21:20.804 [2024-04-27 02:40:54.350825] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.804 [2024-04-27 02:40:54.350833] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.804 [2024-04-27 02:40:54.350849] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.804 [2024-04-27 02:40:54.350855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0005 p:0 m:0 dnr:0 00:21:20.804 [2024-04-27 02:40:54.350861] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x183500 00:21:20.804 [2024-04-27 02:40:54.350870] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.804 [2024-04-27 02:40:54.350878] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.804 [2024-04-27 02:40:54.350897] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.804 [2024-04-27 02:40:54.350903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0006 p:0 m:0 dnr:0 00:21:20.804 [2024-04-27 02:40:54.350910] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x183500 00:21:20.804 [2024-04-27 02:40:54.350919] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.804 [2024-04-27 02:40:54.350927] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.804 [2024-04-27 02:40:54.350950] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.804 [2024-04-27 02:40:54.350956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:21:20.804 [2024-04-27 02:40:54.350963] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x183500 00:21:20.804 [2024-04-27 02:40:54.350971] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.804 [2024-04-27 02:40:54.350983] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.804 [2024-04-27 02:40:54.350999] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.804 [2024-04-27 02:40:54.351005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0008 p:0 m:0 dnr:0 00:21:20.804 [2024-04-27 02:40:54.351011] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x183500 00:21:20.804 [2024-04-27 02:40:54.351020] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.804 [2024-04-27 02:40:54.351028] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.804 [2024-04-27 02:40:54.351046] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.804 [2024-04-27 02:40:54.351051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0009 p:0 m:0 dnr:0 00:21:20.804 [2024-04-27 02:40:54.351058] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x183500 00:21:20.804 [2024-04-27 02:40:54.351067] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.804 [2024-04-27 02:40:54.351075] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.804 [2024-04-27 02:40:54.351090] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.804 [2024-04-27 02:40:54.351096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000a p:0 m:0 dnr:0 00:21:20.804 [2024-04-27 02:40:54.351103] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x183500 00:21:20.804 [2024-04-27 02:40:54.351112] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.804 [2024-04-27 02:40:54.351120] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.804 [2024-04-27 02:40:54.351137] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.804 [2024-04-27 02:40:54.351143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000b p:0 m:0 dnr:0 00:21:20.804 [2024-04-27 02:40:54.351149] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x183500 00:21:20.804 [2024-04-27 02:40:54.351158] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.804 [2024-04-27 02:40:54.351166] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.804 [2024-04-27 02:40:54.351182] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.804 [2024-04-27 02:40:54.351188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000c p:0 m:0 dnr:0 00:21:20.804 [2024-04-27 02:40:54.351194] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x183500 00:21:20.804 [2024-04-27 02:40:54.351203] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.804 [2024-04-27 02:40:54.351211] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.804 [2024-04-27 02:40:54.351225] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.804 [2024-04-27 02:40:54.351231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000d p:0 m:0 dnr:0 00:21:20.804 [2024-04-27 02:40:54.351237] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x183500 00:21:20.804 [2024-04-27 02:40:54.351246] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.804 [2024-04-27 02:40:54.351255] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.804 [2024-04-27 02:40:54.351273] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.804 [2024-04-27 02:40:54.351279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000e p:0 m:0 dnr:0 00:21:20.804 [2024-04-27 02:40:54.351285] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x183500 00:21:20.804 [2024-04-27 02:40:54.351294] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.804 [2024-04-27 02:40:54.351302] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.804 [2024-04-27 02:40:54.351321] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.804 [2024-04-27 02:40:54.351327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000f p:0 m:0 dnr:0 00:21:20.805 [2024-04-27 02:40:54.351334] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x183500 00:21:20.805 [2024-04-27 02:40:54.351347] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.805 [2024-04-27 02:40:54.351355] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.805 [2024-04-27 02:40:54.351371] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.805 [2024-04-27 02:40:54.351377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0010 p:0 m:0 dnr:0 00:21:20.805 [2024-04-27 02:40:54.351383] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x183500 00:21:20.805 [2024-04-27 02:40:54.351392] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.805 [2024-04-27 02:40:54.351400] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.805 [2024-04-27 02:40:54.351423] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.805 [2024-04-27 02:40:54.351429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0011 p:0 m:0 dnr:0 00:21:20.805 [2024-04-27 02:40:54.351436] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x183500 00:21:20.805 [2024-04-27 02:40:54.351445] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.805 [2024-04-27 02:40:54.351453] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.805 [2024-04-27 02:40:54.351474] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.805 [2024-04-27 02:40:54.351480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0012 p:0 m:0 dnr:0 00:21:20.805 [2024-04-27 02:40:54.351486] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x183500 00:21:20.805 [2024-04-27 02:40:54.351495] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.805 [2024-04-27 02:40:54.351503] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.805 [2024-04-27 02:40:54.351524] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.805 [2024-04-27 02:40:54.351530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0013 p:0 m:0 dnr:0 00:21:20.805 [2024-04-27 02:40:54.351537] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x183500 00:21:20.805 [2024-04-27 02:40:54.351547] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.805 [2024-04-27 02:40:54.351556] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.805 [2024-04-27 02:40:54.351581] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.805 [2024-04-27 02:40:54.351587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0014 p:0 m:0 dnr:0 00:21:20.805 [2024-04-27 02:40:54.351593] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x183500 00:21:20.805 [2024-04-27 02:40:54.351602] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.805 [2024-04-27 02:40:54.351610] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.805 [2024-04-27 02:40:54.351628] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.805 [2024-04-27 02:40:54.351633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0015 p:0 m:0 dnr:0 00:21:20.805 [2024-04-27 02:40:54.351640] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x183500 00:21:20.805 [2024-04-27 02:40:54.351649] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.805 [2024-04-27 02:40:54.351657] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.805 [2024-04-27 02:40:54.351673] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.805 [2024-04-27 02:40:54.351678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0016 p:0 m:0 dnr:0 00:21:20.805 [2024-04-27 02:40:54.351685] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x183500 00:21:20.805 [2024-04-27 02:40:54.351694] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.805 [2024-04-27 02:40:54.351702] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.805 [2024-04-27 02:40:54.351719] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.805 [2024-04-27 02:40:54.351725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0017 p:0 m:0 dnr:0 00:21:20.805 [2024-04-27 02:40:54.351732] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x183500 00:21:20.805 [2024-04-27 02:40:54.351741] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.805 [2024-04-27 02:40:54.351749] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.805 [2024-04-27 02:40:54.351766] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.805 [2024-04-27 02:40:54.351772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0018 p:0 m:0 dnr:0 00:21:20.805 [2024-04-27 02:40:54.351779] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x183500 00:21:20.805 [2024-04-27 02:40:54.351787] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.805 [2024-04-27 02:40:54.351795] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.805 [2024-04-27 02:40:54.351817] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.805 [2024-04-27 02:40:54.351822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0019 p:0 m:0 dnr:0 00:21:20.805 [2024-04-27 02:40:54.351829] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x183500 00:21:20.805 [2024-04-27 02:40:54.351839] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.805 [2024-04-27 02:40:54.351847] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.805 [2024-04-27 02:40:54.351867] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.805 [2024-04-27 02:40:54.351873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001a p:0 m:0 dnr:0 00:21:20.805 [2024-04-27 02:40:54.351879] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x183500 00:21:20.805 [2024-04-27 02:40:54.351888] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.805 [2024-04-27 02:40:54.351896] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.805 [2024-04-27 02:40:54.351916] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.805 [2024-04-27 02:40:54.351921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001b p:0 m:0 dnr:0 00:21:20.805 [2024-04-27 02:40:54.351928] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x183500 00:21:20.805 [2024-04-27 02:40:54.351937] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.805 [2024-04-27 02:40:54.351945] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.805 [2024-04-27 02:40:54.351964] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.805 [2024-04-27 02:40:54.351970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001c p:0 m:0 dnr:0 00:21:20.805 [2024-04-27 02:40:54.351977] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x183500 00:21:20.805 [2024-04-27 02:40:54.351986] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.805 [2024-04-27 02:40:54.351994] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.805 [2024-04-27 02:40:54.352009] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.805 [2024-04-27 02:40:54.352015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001d p:0 m:0 dnr:0 00:21:20.805 [2024-04-27 02:40:54.352022] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x183500 00:21:20.805 [2024-04-27 02:40:54.352031] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.805 [2024-04-27 02:40:54.352038] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.805 [2024-04-27 02:40:54.352056] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.805 [2024-04-27 02:40:54.352062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001e p:0 m:0 dnr:0 00:21:20.805 [2024-04-27 02:40:54.352068] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x183500 00:21:20.805 [2024-04-27 02:40:54.352077] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.805 [2024-04-27 02:40:54.352085] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.805 [2024-04-27 02:40:54.352101] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.805 [2024-04-27 02:40:54.352107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001f p:0 m:0 dnr:0 00:21:20.805 [2024-04-27 02:40:54.352115] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x183500 00:21:20.805 [2024-04-27 02:40:54.352124] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.805 [2024-04-27 02:40:54.352132] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.805 [2024-04-27 02:40:54.352146] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.805 [2024-04-27 02:40:54.352151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0000 p:0 m:0 dnr:0 00:21:20.805 [2024-04-27 02:40:54.352158] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x183500 00:21:20.805 [2024-04-27 02:40:54.352167] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.805 [2024-04-27 02:40:54.352175] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.805 [2024-04-27 02:40:54.352194] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.805 [2024-04-27 02:40:54.352200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:21:20.806 [2024-04-27 02:40:54.352207] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x183500 00:21:20.806 [2024-04-27 02:40:54.352215] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.806 [2024-04-27 02:40:54.352223] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.806 [2024-04-27 02:40:54.352237] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.806 [2024-04-27 02:40:54.352243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0002 p:0 m:0 dnr:0 00:21:20.806 [2024-04-27 02:40:54.352250] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x183500 00:21:20.806 [2024-04-27 02:40:54.352259] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.806 [2024-04-27 02:40:54.352266] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.806 [2024-04-27 02:40:54.352290] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.806 [2024-04-27 02:40:54.352295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0003 p:0 m:0 dnr:0 00:21:20.806 [2024-04-27 02:40:54.352302] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x183500 00:21:20.806 [2024-04-27 02:40:54.352311] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.806 [2024-04-27 02:40:54.352319] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.806 [2024-04-27 02:40:54.352335] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.806 [2024-04-27 02:40:54.356347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0004 p:0 m:0 dnr:0 00:21:20.806 [2024-04-27 02:40:54.356353] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x183500 00:21:20.806 [2024-04-27 02:40:54.356363] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183500 00:21:20.806 [2024-04-27 02:40:54.356371] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:21:20.806 [2024-04-27 02:40:54.356395] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:21:20.806 [2024-04-27 02:40:54.356401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:9 sqhd:0005 p:0 m:0 dnr:0 00:21:20.806 [2024-04-27 02:40:54.356409] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x183500 00:21:20.806 [2024-04-27 02:40:54.356416] nvme_ctrlr.c:1204:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 6 milliseconds 00:21:20.806 0 Kelvin (-273 Celsius) 00:21:20.806 Available Spare: 0% 00:21:20.806 Available Spare Threshold: 0% 00:21:20.806 Life Percentage Used: 0% 00:21:20.806 Data Units Read: 0 00:21:20.806 Data Units Written: 0 00:21:20.806 Host Read Commands: 0 00:21:20.806 Host Write Commands: 0 00:21:20.806 Controller Busy Time: 0 minutes 00:21:20.806 Power Cycles: 0 00:21:20.806 Power On Hours: 0 hours 00:21:20.806 Unsafe Shutdowns: 0 00:21:20.806 Unrecoverable Media Errors: 0 00:21:20.806 Lifetime Error Log Entries: 0 00:21:20.806 Warning Temperature Time: 0 minutes 00:21:20.806 Critical Temperature Time: 0 minutes 00:21:20.806 00:21:20.806 Number of Queues 00:21:20.806 ================ 00:21:20.806 Number of I/O Submission Queues: 127 00:21:20.806 Number of I/O Completion Queues: 127 00:21:20.806 00:21:20.806 Active Namespaces 00:21:20.806 ================= 00:21:20.806 Namespace ID:1 00:21:20.806 Error Recovery Timeout: Unlimited 00:21:20.806 Command Set Identifier: NVM (00h) 00:21:20.806 Deallocate: Supported 00:21:20.806 Deallocated/Unwritten Error: Not Supported 00:21:20.806 Deallocated Read Value: Unknown 00:21:20.806 Deallocate in Write Zeroes: Not Supported 00:21:20.806 Deallocated Guard Field: 0xFFFF 00:21:20.806 Flush: Supported 00:21:20.806 Reservation: Supported 00:21:20.806 Namespace Sharing Capabilities: Multiple Controllers 00:21:20.806 Size (in LBAs): 131072 (0GiB) 00:21:20.806 Capacity (in LBAs): 131072 (0GiB) 00:21:20.806 Utilization (in LBAs): 131072 (0GiB) 00:21:20.806 NGUID: ABCDEF0123456789ABCDEF0123456789 00:21:20.806 EUI64: ABCDEF0123456789 00:21:20.806 UUID: 4a8b470c-b90a-4cc9-97e8-58e4b7481c66 00:21:20.806 Thin Provisioning: Not Supported 00:21:20.806 Per-NS Atomic Units: Yes 00:21:20.806 Atomic Boundary Size (Normal): 0 00:21:20.806 Atomic Boundary Size (PFail): 0 00:21:20.806 Atomic Boundary Offset: 0 00:21:20.806 Maximum Single Source Range Length: 65535 00:21:20.806 Maximum Copy Length: 65535 00:21:20.806 Maximum Source Range Count: 1 00:21:20.806 NGUID/EUI64 Never Reused: No 00:21:20.806 Namespace Write Protected: No 00:21:20.806 Number of LBA Formats: 1 00:21:20.806 Current LBA Format: LBA Format #00 00:21:20.806 LBA Format #00: Data Size: 512 Metadata Size: 0 00:21:20.806 00:21:20.806 02:40:54 -- host/identify.sh@51 -- # sync 00:21:21.067 02:40:54 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:21.067 02:40:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:21.067 02:40:54 -- common/autotest_common.sh@10 -- # set +x 00:21:21.067 02:40:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:21.067 02:40:54 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:21:21.067 02:40:54 -- host/identify.sh@56 -- # nvmftestfini 00:21:21.067 02:40:54 -- nvmf/common.sh@477 -- # nvmfcleanup 00:21:21.067 02:40:54 -- nvmf/common.sh@117 -- # sync 00:21:21.067 02:40:54 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:21:21.067 02:40:54 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:21:21.067 02:40:54 -- nvmf/common.sh@120 -- # set +e 00:21:21.067 02:40:54 -- nvmf/common.sh@121 -- # for i in {1..20} 00:21:21.067 02:40:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:21:21.067 rmmod nvme_rdma 00:21:21.067 rmmod nvme_fabrics 00:21:21.067 02:40:54 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:21:21.067 02:40:54 -- nvmf/common.sh@124 -- # set -e 00:21:21.067 02:40:54 -- nvmf/common.sh@125 -- # return 0 00:21:21.067 02:40:54 -- nvmf/common.sh@478 -- # '[' -n 1611780 ']' 00:21:21.067 02:40:54 -- nvmf/common.sh@479 -- # killprocess 1611780 00:21:21.067 02:40:54 -- common/autotest_common.sh@936 -- # '[' -z 1611780 ']' 00:21:21.067 02:40:54 -- common/autotest_common.sh@940 -- # kill -0 1611780 00:21:21.067 02:40:54 -- common/autotest_common.sh@941 -- # uname 00:21:21.067 02:40:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:21.067 02:40:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1611780 00:21:21.067 02:40:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:21.067 02:40:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:21.067 02:40:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1611780' 00:21:21.067 killing process with pid 1611780 00:21:21.067 02:40:54 -- common/autotest_common.sh@955 -- # kill 1611780 00:21:21.068 [2024-04-27 02:40:54.536807] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:21:21.068 02:40:54 -- common/autotest_common.sh@960 -- # wait 1611780 00:21:21.068 [2024-04-27 02:40:54.625682] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:21:21.326 02:40:54 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:21:21.326 02:40:54 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:21:21.326 00:21:21.326 real 0m8.252s 00:21:21.326 user 0m8.794s 00:21:21.326 sys 0m5.175s 00:21:21.326 02:40:54 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:21:21.326 02:40:54 -- common/autotest_common.sh@10 -- # set +x 00:21:21.326 ************************************ 00:21:21.326 END TEST nvmf_identify 00:21:21.326 ************************************ 00:21:21.326 02:40:54 -- nvmf/nvmf.sh@96 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=rdma 00:21:21.326 02:40:54 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:21.326 02:40:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:21.326 02:40:54 -- common/autotest_common.sh@10 -- # set +x 00:21:21.584 ************************************ 00:21:21.584 START TEST nvmf_perf 00:21:21.584 ************************************ 00:21:21.584 02:40:55 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=rdma 00:21:21.584 * Looking for test storage... 00:21:21.584 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:21:21.584 02:40:55 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:21:21.584 02:40:55 -- nvmf/common.sh@7 -- # uname -s 00:21:21.584 02:40:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:21.584 02:40:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:21.584 02:40:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:21.584 02:40:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:21.584 02:40:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:21.584 02:40:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:21.584 02:40:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:21.584 02:40:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:21.584 02:40:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:21.584 02:40:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:21.584 02:40:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:21:21.584 02:40:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:21:21.584 02:40:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:21.584 02:40:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:21.584 02:40:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:21.584 02:40:55 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:21:21.584 02:40:55 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:21:21.584 02:40:55 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:21.584 02:40:55 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:21.584 02:40:55 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:21.584 02:40:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:21.584 02:40:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:21.584 02:40:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:21.584 02:40:55 -- paths/export.sh@5 -- # export PATH 00:21:21.584 02:40:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:21.584 02:40:55 -- nvmf/common.sh@47 -- # : 0 00:21:21.584 02:40:55 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:21:21.584 02:40:55 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:21:21.584 02:40:55 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:21:21.584 02:40:55 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:21.584 02:40:55 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:21.584 02:40:55 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:21:21.584 02:40:55 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:21:21.584 02:40:55 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:21:21.584 02:40:55 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:21:21.584 02:40:55 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:21:21.584 02:40:55 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:21:21.584 02:40:55 -- host/perf.sh@17 -- # nvmftestinit 00:21:21.584 02:40:55 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:21:21.584 02:40:55 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:21.584 02:40:55 -- nvmf/common.sh@437 -- # prepare_net_devs 00:21:21.584 02:40:55 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:21:21.584 02:40:55 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:21:21.584 02:40:55 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:21.584 02:40:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:21.584 02:40:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:21.584 02:40:55 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:21:21.584 02:40:55 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:21:21.584 02:40:55 -- nvmf/common.sh@285 -- # xtrace_disable 00:21:21.584 02:40:55 -- common/autotest_common.sh@10 -- # set +x 00:21:28.148 02:41:00 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:28.148 02:41:00 -- nvmf/common.sh@291 -- # pci_devs=() 00:21:28.148 02:41:00 -- nvmf/common.sh@291 -- # local -a pci_devs 00:21:28.148 02:41:00 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:21:28.148 02:41:00 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:21:28.148 02:41:00 -- nvmf/common.sh@293 -- # pci_drivers=() 00:21:28.148 02:41:00 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:21:28.148 02:41:00 -- nvmf/common.sh@295 -- # net_devs=() 00:21:28.148 02:41:00 -- nvmf/common.sh@295 -- # local -ga net_devs 00:21:28.148 02:41:00 -- nvmf/common.sh@296 -- # e810=() 00:21:28.148 02:41:00 -- nvmf/common.sh@296 -- # local -ga e810 00:21:28.148 02:41:00 -- nvmf/common.sh@297 -- # x722=() 00:21:28.148 02:41:00 -- nvmf/common.sh@297 -- # local -ga x722 00:21:28.148 02:41:00 -- nvmf/common.sh@298 -- # mlx=() 00:21:28.148 02:41:00 -- nvmf/common.sh@298 -- # local -ga mlx 00:21:28.148 02:41:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:28.148 02:41:00 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:28.148 02:41:00 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:28.148 02:41:00 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:28.148 02:41:00 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:28.148 02:41:00 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:28.148 02:41:00 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:28.148 02:41:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:28.148 02:41:00 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:28.148 02:41:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:28.148 02:41:00 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:28.148 02:41:00 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:21:28.148 02:41:00 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:21:28.148 02:41:00 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:21:28.148 02:41:00 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:21:28.148 02:41:00 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:21:28.148 02:41:00 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:21:28.148 02:41:00 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:21:28.148 02:41:00 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:21:28.148 02:41:00 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:21:28.148 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:21:28.148 02:41:00 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:21:28.148 02:41:00 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:21:28.148 02:41:00 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:21:28.148 02:41:00 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:21:28.148 02:41:00 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:21:28.148 02:41:00 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:21:28.148 02:41:00 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:21:28.148 02:41:00 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:21:28.148 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:21:28.148 02:41:00 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:21:28.148 02:41:00 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:21:28.148 02:41:00 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:21:28.148 02:41:00 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:21:28.148 02:41:00 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:21:28.148 02:41:00 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:21:28.148 02:41:00 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:21:28.148 02:41:00 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:21:28.148 02:41:00 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:21:28.148 02:41:00 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:28.148 02:41:00 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:21:28.148 02:41:00 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:28.148 02:41:00 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:21:28.148 Found net devices under 0000:18:00.0: mlx_0_0 00:21:28.148 02:41:00 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:21:28.148 02:41:00 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:21:28.148 02:41:00 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:28.148 02:41:00 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:21:28.148 02:41:00 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:28.148 02:41:00 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:21:28.148 Found net devices under 0000:18:00.1: mlx_0_1 00:21:28.148 02:41:00 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:21:28.148 02:41:00 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:21:28.148 02:41:00 -- nvmf/common.sh@403 -- # is_hw=yes 00:21:28.148 02:41:00 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:21:28.148 02:41:00 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:21:28.148 02:41:00 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:21:28.148 02:41:00 -- nvmf/common.sh@409 -- # rdma_device_init 00:21:28.148 02:41:00 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:21:28.148 02:41:00 -- nvmf/common.sh@58 -- # uname 00:21:28.148 02:41:00 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:21:28.148 02:41:00 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:21:28.148 02:41:00 -- nvmf/common.sh@63 -- # modprobe ib_core 00:21:28.148 02:41:00 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:21:28.148 02:41:00 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:21:28.148 02:41:00 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:21:28.148 02:41:00 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:21:28.148 02:41:00 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:21:28.148 02:41:00 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:21:28.148 02:41:00 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:21:28.148 02:41:00 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:21:28.148 02:41:00 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:21:28.148 02:41:00 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:21:28.148 02:41:00 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:21:28.148 02:41:00 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:21:28.148 02:41:00 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:21:28.148 02:41:00 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:28.148 02:41:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:28.148 02:41:00 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:21:28.148 02:41:00 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:21:28.148 02:41:00 -- nvmf/common.sh@105 -- # continue 2 00:21:28.148 02:41:00 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:28.148 02:41:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:28.148 02:41:00 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:21:28.148 02:41:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:28.149 02:41:00 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:21:28.149 02:41:00 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:21:28.149 02:41:00 -- nvmf/common.sh@105 -- # continue 2 00:21:28.149 02:41:00 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:21:28.149 02:41:00 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:21:28.149 02:41:00 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:21:28.149 02:41:00 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:21:28.149 02:41:00 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:28.149 02:41:00 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:28.149 02:41:00 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:21:28.149 02:41:00 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:21:28.149 02:41:00 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:21:28.149 64: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:21:28.149 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:21:28.149 altname enp24s0f0np0 00:21:28.149 altname ens785f0np0 00:21:28.149 inet 192.168.100.8/24 scope global mlx_0_0 00:21:28.149 valid_lft forever preferred_lft forever 00:21:28.149 02:41:00 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:21:28.149 02:41:00 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:21:28.149 02:41:00 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:21:28.149 02:41:00 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:21:28.149 02:41:00 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:28.149 02:41:00 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:28.149 02:41:00 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:21:28.149 02:41:00 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:21:28.149 02:41:00 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:21:28.149 65: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:21:28.149 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:21:28.149 altname enp24s0f1np1 00:21:28.149 altname ens785f1np1 00:21:28.149 inet 192.168.100.9/24 scope global mlx_0_1 00:21:28.149 valid_lft forever preferred_lft forever 00:21:28.149 02:41:00 -- nvmf/common.sh@411 -- # return 0 00:21:28.149 02:41:00 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:21:28.149 02:41:00 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:21:28.149 02:41:00 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:21:28.149 02:41:00 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:21:28.149 02:41:00 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:21:28.149 02:41:00 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:21:28.149 02:41:00 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:21:28.149 02:41:00 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:21:28.149 02:41:00 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:21:28.149 02:41:01 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:21:28.149 02:41:01 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:28.149 02:41:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:28.149 02:41:01 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:21:28.149 02:41:01 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:21:28.149 02:41:01 -- nvmf/common.sh@105 -- # continue 2 00:21:28.149 02:41:01 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:28.149 02:41:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:28.149 02:41:01 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:21:28.149 02:41:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:28.149 02:41:01 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:21:28.149 02:41:01 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:21:28.149 02:41:01 -- nvmf/common.sh@105 -- # continue 2 00:21:28.149 02:41:01 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:21:28.149 02:41:01 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:21:28.149 02:41:01 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:21:28.149 02:41:01 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:21:28.149 02:41:01 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:28.149 02:41:01 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:28.149 02:41:01 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:21:28.149 02:41:01 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:21:28.149 02:41:01 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:21:28.149 02:41:01 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:21:28.149 02:41:01 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:28.149 02:41:01 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:28.149 02:41:01 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:21:28.149 192.168.100.9' 00:21:28.149 02:41:01 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:21:28.149 192.168.100.9' 00:21:28.149 02:41:01 -- nvmf/common.sh@446 -- # head -n 1 00:21:28.149 02:41:01 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:21:28.149 02:41:01 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:21:28.149 192.168.100.9' 00:21:28.149 02:41:01 -- nvmf/common.sh@447 -- # tail -n +2 00:21:28.149 02:41:01 -- nvmf/common.sh@447 -- # head -n 1 00:21:28.149 02:41:01 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:21:28.149 02:41:01 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:21:28.149 02:41:01 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:21:28.149 02:41:01 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:21:28.149 02:41:01 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:21:28.149 02:41:01 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:21:28.149 02:41:01 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:21:28.149 02:41:01 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:21:28.149 02:41:01 -- common/autotest_common.sh@710 -- # xtrace_disable 00:21:28.149 02:41:01 -- common/autotest_common.sh@10 -- # set +x 00:21:28.149 02:41:01 -- nvmf/common.sh@470 -- # nvmfpid=1614883 00:21:28.149 02:41:01 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:21:28.149 02:41:01 -- nvmf/common.sh@471 -- # waitforlisten 1614883 00:21:28.149 02:41:01 -- common/autotest_common.sh@817 -- # '[' -z 1614883 ']' 00:21:28.149 02:41:01 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:28.149 02:41:01 -- common/autotest_common.sh@822 -- # local max_retries=100 00:21:28.149 02:41:01 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:28.149 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:28.149 02:41:01 -- common/autotest_common.sh@826 -- # xtrace_disable 00:21:28.149 02:41:01 -- common/autotest_common.sh@10 -- # set +x 00:21:28.149 [2024-04-27 02:41:01.142286] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:21:28.149 [2024-04-27 02:41:01.142353] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:28.149 EAL: No free 2048 kB hugepages reported on node 1 00:21:28.149 [2024-04-27 02:41:01.214997] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:28.149 [2024-04-27 02:41:01.303325] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:28.149 [2024-04-27 02:41:01.303372] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:28.149 [2024-04-27 02:41:01.303382] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:21:28.149 [2024-04-27 02:41:01.303392] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:21:28.149 [2024-04-27 02:41:01.303399] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:28.149 [2024-04-27 02:41:01.303456] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:28.149 [2024-04-27 02:41:01.303521] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:28.149 [2024-04-27 02:41:01.303541] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:28.149 [2024-04-27 02:41:01.303542] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:28.409 02:41:01 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:21:28.409 02:41:01 -- common/autotest_common.sh@850 -- # return 0 00:21:28.409 02:41:01 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:21:28.409 02:41:01 -- common/autotest_common.sh@716 -- # xtrace_disable 00:21:28.409 02:41:01 -- common/autotest_common.sh@10 -- # set +x 00:21:28.409 02:41:02 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:28.409 02:41:02 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/gen_nvme.sh 00:21:28.409 02:41:02 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:21:31.703 02:41:05 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:21:31.703 02:41:05 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:21:31.703 02:41:05 -- host/perf.sh@30 -- # local_nvme_trid=0000:5f:00.0 00:21:31.703 02:41:05 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:21:31.962 02:41:05 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:21:31.962 02:41:05 -- host/perf.sh@33 -- # '[' -n 0000:5f:00.0 ']' 00:21:31.962 02:41:05 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:21:31.962 02:41:05 -- host/perf.sh@37 -- # '[' rdma == rdma ']' 00:21:31.962 02:41:05 -- host/perf.sh@40 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -c 0 00:21:32.221 [2024-04-27 02:41:05.590867] rdma.c:2712:nvmf_rdma_create: *WARNING*: In capsule data size is set to 256, this is minimum size required to support msdbd=16 00:21:32.221 [2024-04-27 02:41:05.612266] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1922770/0x1950580) succeed. 00:21:32.222 [2024-04-27 02:41:05.623039] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1923db0/0x19b0540) succeed. 00:21:32.222 02:41:05 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:32.480 02:41:05 -- host/perf.sh@45 -- # for bdev in $bdevs 00:21:32.480 02:41:05 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:21:32.772 02:41:06 -- host/perf.sh@45 -- # for bdev in $bdevs 00:21:32.772 02:41:06 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:21:32.772 02:41:06 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:21:33.032 [2024-04-27 02:41:06.488377] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:21:33.032 02:41:06 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:21:33.291 02:41:06 -- host/perf.sh@52 -- # '[' -n 0000:5f:00.0 ']' 00:21:33.291 02:41:06 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:5f:00.0' 00:21:33.291 02:41:06 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:21:33.291 02:41:06 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:5f:00.0' 00:21:34.670 Initializing NVMe Controllers 00:21:34.670 Attached to NVMe Controller at 0000:5f:00.0 [8086:0a54] 00:21:34.670 Associating PCIE (0000:5f:00.0) NSID 1 with lcore 0 00:21:34.670 Initialization complete. Launching workers. 00:21:34.670 ======================================================== 00:21:34.670 Latency(us) 00:21:34.670 Device Information : IOPS MiB/s Average min max 00:21:34.670 PCIE (0000:5f:00.0) NSID 1 from core 0: 99563.87 388.92 321.09 34.38 4310.82 00:21:34.670 ======================================================== 00:21:34.670 Total : 99563.87 388.92 321.09 34.38 4310.82 00:21:34.670 00:21:34.670 02:41:07 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:21:34.670 EAL: No free 2048 kB hugepages reported on node 1 00:21:37.960 Initializing NVMe Controllers 00:21:37.960 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:21:37.960 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:21:37.960 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:21:37.960 Initialization complete. Launching workers. 00:21:37.960 ======================================================== 00:21:37.960 Latency(us) 00:21:37.960 Device Information : IOPS MiB/s Average min max 00:21:37.960 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 6797.62 26.55 146.89 51.00 6006.08 00:21:37.960 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 5261.55 20.55 189.85 63.86 6087.03 00:21:37.960 ======================================================== 00:21:37.960 Total : 12059.16 47.11 165.63 51.00 6087.03 00:21:37.960 00:21:37.960 02:41:11 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:21:37.960 EAL: No free 2048 kB hugepages reported on node 1 00:21:41.252 Initializing NVMe Controllers 00:21:41.252 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:21:41.252 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:21:41.252 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:21:41.252 Initialization complete. Launching workers. 00:21:41.252 ======================================================== 00:21:41.252 Latency(us) 00:21:41.252 Device Information : IOPS MiB/s Average min max 00:21:41.252 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 18333.98 71.62 1745.29 496.30 5521.49 00:21:41.252 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 4032.00 15.75 7971.15 4931.40 10197.11 00:21:41.252 ======================================================== 00:21:41.252 Total : 22365.98 87.37 2867.64 496.30 10197.11 00:21:41.252 00:21:41.252 02:41:14 -- host/perf.sh@59 -- # [[ mlx5 == \e\8\1\0 ]] 00:21:41.252 02:41:14 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:21:41.252 EAL: No free 2048 kB hugepages reported on node 1 00:21:46.525 Initializing NVMe Controllers 00:21:46.525 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:21:46.525 Controller IO queue size 128, less than required. 00:21:46.525 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:21:46.525 Controller IO queue size 128, less than required. 00:21:46.525 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:21:46.525 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:21:46.525 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:21:46.525 Initialization complete. Launching workers. 00:21:46.525 ======================================================== 00:21:46.525 Latency(us) 00:21:46.525 Device Information : IOPS MiB/s Average min max 00:21:46.525 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 3389.26 847.32 38024.50 15447.76 91612.93 00:21:46.525 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3597.13 899.28 35203.24 15350.04 58846.35 00:21:46.525 ======================================================== 00:21:46.525 Total : 6986.39 1746.60 36571.90 15350.04 91612.93 00:21:46.525 00:21:46.525 02:41:19 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -c 0xf -P 4 00:21:46.526 EAL: No free 2048 kB hugepages reported on node 1 00:21:46.526 No valid NVMe controllers or AIO or URING devices found 00:21:46.526 Initializing NVMe Controllers 00:21:46.526 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:21:46.526 Controller IO queue size 128, less than required. 00:21:46.526 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:21:46.526 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:21:46.526 Controller IO queue size 128, less than required. 00:21:46.526 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:21:46.526 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:21:46.526 WARNING: Some requested NVMe devices were skipped 00:21:46.526 02:41:19 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' --transport-stat 00:21:46.526 EAL: No free 2048 kB hugepages reported on node 1 00:21:50.720 Initializing NVMe Controllers 00:21:50.720 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:21:50.720 Controller IO queue size 128, less than required. 00:21:50.720 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:21:50.720 Controller IO queue size 128, less than required. 00:21:50.720 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:21:50.720 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:21:50.720 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:21:50.720 Initialization complete. Launching workers. 00:21:50.720 00:21:50.720 ==================== 00:21:50.720 lcore 0, ns RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:21:50.720 RDMA transport: 00:21:50.720 dev name: mlx5_0 00:21:50.720 polls: 393866 00:21:50.720 idle_polls: 390521 00:21:50.720 completions: 42458 00:21:50.720 queued_requests: 1 00:21:50.720 total_send_wrs: 21229 00:21:50.720 send_doorbell_updates: 3029 00:21:50.720 total_recv_wrs: 21356 00:21:50.720 recv_doorbell_updates: 3051 00:21:50.720 --------------------------------- 00:21:50.720 00:21:50.720 ==================== 00:21:50.720 lcore 0, ns RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:21:50.720 RDMA transport: 00:21:50.720 dev name: mlx5_0 00:21:50.720 polls: 396146 00:21:50.720 idle_polls: 395861 00:21:50.720 completions: 19758 00:21:50.720 queued_requests: 1 00:21:50.720 total_send_wrs: 9879 00:21:50.720 send_doorbell_updates: 263 00:21:50.720 total_recv_wrs: 10006 00:21:50.720 recv_doorbell_updates: 264 00:21:50.720 --------------------------------- 00:21:50.720 ======================================================== 00:21:50.720 Latency(us) 00:21:50.720 Device Information : IOPS MiB/s Average min max 00:21:50.720 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 5307.00 1326.75 24166.01 13042.74 59460.70 00:21:50.720 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 2469.50 617.38 51781.98 31152.00 79099.51 00:21:50.720 ======================================================== 00:21:50.720 Total : 7776.50 1944.12 32935.72 13042.74 79099.51 00:21:50.720 00:21:50.720 02:41:23 -- host/perf.sh@66 -- # sync 00:21:50.720 02:41:23 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:50.720 02:41:24 -- host/perf.sh@69 -- # '[' 0 -eq 1 ']' 00:21:50.720 02:41:24 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:21:50.720 02:41:24 -- host/perf.sh@114 -- # nvmftestfini 00:21:50.720 02:41:24 -- nvmf/common.sh@477 -- # nvmfcleanup 00:21:50.720 02:41:24 -- nvmf/common.sh@117 -- # sync 00:21:50.720 02:41:24 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:21:50.720 02:41:24 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:21:50.720 02:41:24 -- nvmf/common.sh@120 -- # set +e 00:21:50.720 02:41:24 -- nvmf/common.sh@121 -- # for i in {1..20} 00:21:50.720 02:41:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:21:50.720 rmmod nvme_rdma 00:21:50.720 rmmod nvme_fabrics 00:21:50.720 02:41:24 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:21:50.720 02:41:24 -- nvmf/common.sh@124 -- # set -e 00:21:50.720 02:41:24 -- nvmf/common.sh@125 -- # return 0 00:21:50.720 02:41:24 -- nvmf/common.sh@478 -- # '[' -n 1614883 ']' 00:21:50.720 02:41:24 -- nvmf/common.sh@479 -- # killprocess 1614883 00:21:50.720 02:41:24 -- common/autotest_common.sh@936 -- # '[' -z 1614883 ']' 00:21:50.720 02:41:24 -- common/autotest_common.sh@940 -- # kill -0 1614883 00:21:50.720 02:41:24 -- common/autotest_common.sh@941 -- # uname 00:21:50.720 02:41:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:50.720 02:41:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1614883 00:21:50.720 02:41:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:50.720 02:41:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:50.720 02:41:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1614883' 00:21:50.720 killing process with pid 1614883 00:21:50.720 02:41:24 -- common/autotest_common.sh@955 -- # kill 1614883 00:21:50.720 02:41:24 -- common/autotest_common.sh@960 -- # wait 1614883 00:21:50.720 [2024-04-27 02:41:24.149295] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:21:54.903 02:41:28 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:21:54.903 02:41:28 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:21:54.903 00:21:54.903 real 0m32.964s 00:21:54.903 user 1m48.780s 00:21:54.903 sys 0m5.855s 00:21:54.903 02:41:28 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:21:54.903 02:41:28 -- common/autotest_common.sh@10 -- # set +x 00:21:54.903 ************************************ 00:21:54.903 END TEST nvmf_perf 00:21:54.903 ************************************ 00:21:54.903 02:41:28 -- nvmf/nvmf.sh@97 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=rdma 00:21:54.903 02:41:28 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:54.903 02:41:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:54.903 02:41:28 -- common/autotest_common.sh@10 -- # set +x 00:21:54.903 ************************************ 00:21:54.903 START TEST nvmf_fio_host 00:21:54.903 ************************************ 00:21:54.903 02:41:28 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=rdma 00:21:54.903 * Looking for test storage... 00:21:54.903 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:21:54.903 02:41:28 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:21:54.903 02:41:28 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:54.903 02:41:28 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:54.903 02:41:28 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:54.903 02:41:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:54.904 02:41:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:54.904 02:41:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:54.904 02:41:28 -- paths/export.sh@5 -- # export PATH 00:21:54.904 02:41:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:54.904 02:41:28 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:21:54.904 02:41:28 -- nvmf/common.sh@7 -- # uname -s 00:21:54.904 02:41:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:54.904 02:41:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:54.904 02:41:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:54.904 02:41:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:54.904 02:41:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:54.904 02:41:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:54.904 02:41:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:54.904 02:41:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:54.904 02:41:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:54.904 02:41:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:54.904 02:41:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:21:54.904 02:41:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:21:54.904 02:41:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:54.904 02:41:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:54.904 02:41:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:54.904 02:41:28 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:21:54.904 02:41:28 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:21:54.904 02:41:28 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:54.904 02:41:28 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:54.904 02:41:28 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:54.904 02:41:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:54.904 02:41:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:54.904 02:41:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:54.904 02:41:28 -- paths/export.sh@5 -- # export PATH 00:21:54.904 02:41:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:54.904 02:41:28 -- nvmf/common.sh@47 -- # : 0 00:21:54.904 02:41:28 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:21:54.904 02:41:28 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:21:54.904 02:41:28 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:21:54.904 02:41:28 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:54.904 02:41:28 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:54.904 02:41:28 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:21:54.904 02:41:28 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:21:54.904 02:41:28 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:21:54.904 02:41:28 -- host/fio.sh@12 -- # nvmftestinit 00:21:54.904 02:41:28 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:21:54.904 02:41:28 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:54.904 02:41:28 -- nvmf/common.sh@437 -- # prepare_net_devs 00:21:54.904 02:41:28 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:21:54.904 02:41:28 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:21:54.904 02:41:28 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:54.904 02:41:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:54.904 02:41:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:54.904 02:41:28 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:21:54.904 02:41:28 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:21:54.904 02:41:28 -- nvmf/common.sh@285 -- # xtrace_disable 00:21:54.904 02:41:28 -- common/autotest_common.sh@10 -- # set +x 00:22:00.167 02:41:33 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:00.167 02:41:33 -- nvmf/common.sh@291 -- # pci_devs=() 00:22:00.167 02:41:33 -- nvmf/common.sh@291 -- # local -a pci_devs 00:22:00.167 02:41:33 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:22:00.167 02:41:33 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:22:00.167 02:41:33 -- nvmf/common.sh@293 -- # pci_drivers=() 00:22:00.167 02:41:33 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:22:00.167 02:41:33 -- nvmf/common.sh@295 -- # net_devs=() 00:22:00.167 02:41:33 -- nvmf/common.sh@295 -- # local -ga net_devs 00:22:00.167 02:41:33 -- nvmf/common.sh@296 -- # e810=() 00:22:00.167 02:41:33 -- nvmf/common.sh@296 -- # local -ga e810 00:22:00.167 02:41:33 -- nvmf/common.sh@297 -- # x722=() 00:22:00.167 02:41:33 -- nvmf/common.sh@297 -- # local -ga x722 00:22:00.167 02:41:33 -- nvmf/common.sh@298 -- # mlx=() 00:22:00.167 02:41:33 -- nvmf/common.sh@298 -- # local -ga mlx 00:22:00.167 02:41:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:00.167 02:41:33 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:00.167 02:41:33 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:00.167 02:41:33 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:00.167 02:41:33 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:00.167 02:41:33 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:00.167 02:41:33 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:00.167 02:41:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:00.167 02:41:33 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:00.167 02:41:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:00.167 02:41:33 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:00.167 02:41:33 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:22:00.167 02:41:33 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:22:00.167 02:41:33 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:22:00.167 02:41:33 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:22:00.167 02:41:33 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:22:00.167 02:41:33 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:22:00.167 02:41:33 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:22:00.167 02:41:33 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:22:00.167 02:41:33 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:22:00.167 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:22:00.167 02:41:33 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:22:00.167 02:41:33 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:22:00.167 02:41:33 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:22:00.167 02:41:33 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:22:00.167 02:41:33 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:22:00.167 02:41:33 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:22:00.167 02:41:33 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:22:00.167 02:41:33 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:22:00.167 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:22:00.167 02:41:33 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:22:00.167 02:41:33 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:22:00.167 02:41:33 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:22:00.167 02:41:33 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:22:00.167 02:41:33 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:22:00.167 02:41:33 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:22:00.167 02:41:33 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:22:00.167 02:41:33 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:22:00.167 02:41:33 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:22:00.167 02:41:33 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:00.168 02:41:33 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:22:00.168 02:41:33 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:00.168 02:41:33 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:22:00.168 Found net devices under 0000:18:00.0: mlx_0_0 00:22:00.168 02:41:33 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:22:00.168 02:41:33 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:22:00.168 02:41:33 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:00.168 02:41:33 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:22:00.168 02:41:33 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:00.168 02:41:33 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:22:00.168 Found net devices under 0000:18:00.1: mlx_0_1 00:22:00.168 02:41:33 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:22:00.168 02:41:33 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:22:00.168 02:41:33 -- nvmf/common.sh@403 -- # is_hw=yes 00:22:00.168 02:41:33 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:22:00.168 02:41:33 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:22:00.168 02:41:33 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:22:00.168 02:41:33 -- nvmf/common.sh@409 -- # rdma_device_init 00:22:00.168 02:41:33 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:22:00.168 02:41:33 -- nvmf/common.sh@58 -- # uname 00:22:00.168 02:41:33 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:22:00.168 02:41:33 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:22:00.168 02:41:33 -- nvmf/common.sh@63 -- # modprobe ib_core 00:22:00.168 02:41:33 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:22:00.168 02:41:33 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:22:00.168 02:41:33 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:22:00.168 02:41:33 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:22:00.168 02:41:33 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:22:00.168 02:41:33 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:22:00.168 02:41:33 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:22:00.168 02:41:33 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:22:00.168 02:41:33 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:22:00.168 02:41:33 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:22:00.168 02:41:33 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:22:00.168 02:41:33 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:22:00.168 02:41:33 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:22:00.168 02:41:33 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:00.168 02:41:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:00.168 02:41:33 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:22:00.168 02:41:33 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:22:00.168 02:41:33 -- nvmf/common.sh@105 -- # continue 2 00:22:00.168 02:41:33 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:00.168 02:41:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:00.168 02:41:33 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:22:00.168 02:41:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:00.168 02:41:33 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:22:00.168 02:41:33 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:22:00.168 02:41:33 -- nvmf/common.sh@105 -- # continue 2 00:22:00.168 02:41:33 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:22:00.168 02:41:33 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:22:00.168 02:41:33 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:22:00.168 02:41:33 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:22:00.168 02:41:33 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:00.168 02:41:33 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:00.168 02:41:33 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:22:00.168 02:41:33 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:22:00.168 02:41:33 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:22:00.168 64: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:22:00.168 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:22:00.168 altname enp24s0f0np0 00:22:00.168 altname ens785f0np0 00:22:00.168 inet 192.168.100.8/24 scope global mlx_0_0 00:22:00.168 valid_lft forever preferred_lft forever 00:22:00.168 02:41:33 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:22:00.168 02:41:33 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:22:00.168 02:41:33 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:22:00.425 02:41:33 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:22:00.425 02:41:33 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:00.425 02:41:33 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:00.425 02:41:33 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:22:00.425 02:41:33 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:22:00.425 02:41:33 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:22:00.425 65: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:22:00.425 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:22:00.425 altname enp24s0f1np1 00:22:00.425 altname ens785f1np1 00:22:00.425 inet 192.168.100.9/24 scope global mlx_0_1 00:22:00.425 valid_lft forever preferred_lft forever 00:22:00.425 02:41:33 -- nvmf/common.sh@411 -- # return 0 00:22:00.425 02:41:33 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:22:00.425 02:41:33 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:22:00.425 02:41:33 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:22:00.425 02:41:33 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:22:00.425 02:41:33 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:22:00.425 02:41:33 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:22:00.425 02:41:33 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:22:00.426 02:41:33 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:22:00.426 02:41:33 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:22:00.426 02:41:33 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:22:00.426 02:41:33 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:00.426 02:41:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:00.426 02:41:33 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:22:00.426 02:41:33 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:22:00.426 02:41:33 -- nvmf/common.sh@105 -- # continue 2 00:22:00.426 02:41:33 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:00.426 02:41:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:00.426 02:41:33 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:22:00.426 02:41:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:00.426 02:41:33 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:22:00.426 02:41:33 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:22:00.426 02:41:33 -- nvmf/common.sh@105 -- # continue 2 00:22:00.426 02:41:33 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:22:00.426 02:41:33 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:22:00.426 02:41:33 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:22:00.426 02:41:33 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:00.426 02:41:33 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:22:00.426 02:41:33 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:00.426 02:41:33 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:22:00.426 02:41:33 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:22:00.426 02:41:33 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:22:00.426 02:41:33 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:22:00.426 02:41:33 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:00.426 02:41:33 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:00.426 02:41:33 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:22:00.426 192.168.100.9' 00:22:00.426 02:41:33 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:22:00.426 192.168.100.9' 00:22:00.426 02:41:33 -- nvmf/common.sh@446 -- # head -n 1 00:22:00.426 02:41:33 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:22:00.426 02:41:33 -- nvmf/common.sh@447 -- # tail -n +2 00:22:00.426 02:41:33 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:22:00.426 192.168.100.9' 00:22:00.426 02:41:33 -- nvmf/common.sh@447 -- # head -n 1 00:22:00.426 02:41:33 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:22:00.426 02:41:33 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:22:00.426 02:41:33 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:22:00.426 02:41:33 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:22:00.426 02:41:33 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:22:00.426 02:41:33 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:22:00.426 02:41:33 -- host/fio.sh@14 -- # [[ y != y ]] 00:22:00.426 02:41:33 -- host/fio.sh@19 -- # timing_enter start_nvmf_tgt 00:22:00.426 02:41:33 -- common/autotest_common.sh@710 -- # xtrace_disable 00:22:00.426 02:41:33 -- common/autotest_common.sh@10 -- # set +x 00:22:00.426 02:41:33 -- host/fio.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:00.426 02:41:33 -- host/fio.sh@22 -- # nvmfpid=1621206 00:22:00.426 02:41:33 -- host/fio.sh@24 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:00.426 02:41:33 -- host/fio.sh@26 -- # waitforlisten 1621206 00:22:00.426 02:41:33 -- common/autotest_common.sh@817 -- # '[' -z 1621206 ']' 00:22:00.426 02:41:33 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:00.426 02:41:33 -- common/autotest_common.sh@822 -- # local max_retries=100 00:22:00.426 02:41:33 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:00.426 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:00.426 02:41:33 -- common/autotest_common.sh@826 -- # xtrace_disable 00:22:00.426 02:41:33 -- common/autotest_common.sh@10 -- # set +x 00:22:00.426 [2024-04-27 02:41:33.943073] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:22:00.426 [2024-04-27 02:41:33.943127] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:00.426 EAL: No free 2048 kB hugepages reported on node 1 00:22:00.426 [2024-04-27 02:41:34.015402] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:00.683 [2024-04-27 02:41:34.108016] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:00.683 [2024-04-27 02:41:34.108059] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:00.683 [2024-04-27 02:41:34.108070] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:22:00.683 [2024-04-27 02:41:34.108079] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:22:00.683 [2024-04-27 02:41:34.108086] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:00.683 [2024-04-27 02:41:34.108150] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:00.683 [2024-04-27 02:41:34.108169] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:00.683 [2024-04-27 02:41:34.108233] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:00.683 [2024-04-27 02:41:34.108235] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:01.246 02:41:34 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:22:01.246 02:41:34 -- common/autotest_common.sh@850 -- # return 0 00:22:01.246 02:41:34 -- host/fio.sh@27 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:22:01.246 02:41:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:01.246 02:41:34 -- common/autotest_common.sh@10 -- # set +x 00:22:01.246 [2024-04-27 02:41:34.807023] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1b6f4d0/0x1b739c0) succeed. 00:22:01.246 [2024-04-27 02:41:34.817535] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1b70b10/0x1bb5050) succeed. 00:22:01.504 02:41:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:01.504 02:41:34 -- host/fio.sh@28 -- # timing_exit start_nvmf_tgt 00:22:01.504 02:41:34 -- common/autotest_common.sh@716 -- # xtrace_disable 00:22:01.504 02:41:34 -- common/autotest_common.sh@10 -- # set +x 00:22:01.504 02:41:34 -- host/fio.sh@30 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:01.504 02:41:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:01.504 02:41:34 -- common/autotest_common.sh@10 -- # set +x 00:22:01.504 Malloc1 00:22:01.504 02:41:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:01.504 02:41:35 -- host/fio.sh@31 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:01.504 02:41:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:01.504 02:41:35 -- common/autotest_common.sh@10 -- # set +x 00:22:01.504 02:41:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:01.504 02:41:35 -- host/fio.sh@32 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:22:01.504 02:41:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:01.504 02:41:35 -- common/autotest_common.sh@10 -- # set +x 00:22:01.504 02:41:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:01.504 02:41:35 -- host/fio.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:22:01.504 02:41:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:01.504 02:41:35 -- common/autotest_common.sh@10 -- # set +x 00:22:01.504 [2024-04-27 02:41:35.040580] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:22:01.504 02:41:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:01.504 02:41:35 -- host/fio.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:22:01.505 02:41:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:01.505 02:41:35 -- common/autotest_common.sh@10 -- # set +x 00:22:01.505 02:41:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:01.505 02:41:35 -- host/fio.sh@36 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme 00:22:01.505 02:41:35 -- host/fio.sh@39 -- # fio_nvme /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:22:01.505 02:41:35 -- common/autotest_common.sh@1346 -- # fio_plugin /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:22:01.505 02:41:35 -- common/autotest_common.sh@1323 -- # local fio_dir=/usr/src/fio 00:22:01.505 02:41:35 -- common/autotest_common.sh@1325 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:22:01.505 02:41:35 -- common/autotest_common.sh@1325 -- # local sanitizers 00:22:01.505 02:41:35 -- common/autotest_common.sh@1326 -- # local plugin=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:22:01.505 02:41:35 -- common/autotest_common.sh@1327 -- # shift 00:22:01.505 02:41:35 -- common/autotest_common.sh@1329 -- # local asan_lib= 00:22:01.505 02:41:35 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:22:01.505 02:41:35 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:22:01.505 02:41:35 -- common/autotest_common.sh@1331 -- # grep libasan 00:22:01.505 02:41:35 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:22:01.505 02:41:35 -- common/autotest_common.sh@1331 -- # asan_lib= 00:22:01.505 02:41:35 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:22:01.505 02:41:35 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:22:01.505 02:41:35 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:22:01.505 02:41:35 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:22:01.505 02:41:35 -- common/autotest_common.sh@1331 -- # grep libclang_rt.asan 00:22:01.505 02:41:35 -- common/autotest_common.sh@1331 -- # asan_lib= 00:22:01.505 02:41:35 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:22:01.505 02:41:35 -- common/autotest_common.sh@1338 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme' 00:22:01.505 02:41:35 -- common/autotest_common.sh@1338 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:22:01.762 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:22:01.762 fio-3.35 00:22:01.762 Starting 1 thread 00:22:02.018 EAL: No free 2048 kB hugepages reported on node 1 00:22:04.573 00:22:04.573 test: (groupid=0, jobs=1): err= 0: pid=1621581: Sat Apr 27 02:41:37 2024 00:22:04.573 read: IOPS=17.8k, BW=69.5MiB/s (72.9MB/s)(139MiB/2004msec) 00:22:04.573 slat (nsec): min=1393, max=35759, avg=1514.45, stdev=476.51 00:22:04.573 clat (usec): min=1997, max=6528, avg=3570.60, stdev=80.58 00:22:04.573 lat (usec): min=2020, max=6529, avg=3572.12, stdev=80.52 00:22:04.573 clat percentiles (usec): 00:22:04.573 | 1.00th=[ 3523], 5.00th=[ 3556], 10.00th=[ 3556], 20.00th=[ 3556], 00:22:04.573 | 30.00th=[ 3556], 40.00th=[ 3556], 50.00th=[ 3556], 60.00th=[ 3589], 00:22:04.573 | 70.00th=[ 3589], 80.00th=[ 3589], 90.00th=[ 3589], 95.00th=[ 3589], 00:22:04.573 | 99.00th=[ 3621], 99.50th=[ 3752], 99.90th=[ 4293], 99.95th=[ 5604], 00:22:04.573 | 99.99th=[ 6456] 00:22:04.573 bw ( KiB/s): min=69808, max=72032, per=100.00%, avg=71198.00, stdev=965.95, samples=4 00:22:04.573 iops : min=17452, max=18008, avg=17799.50, stdev=241.49, samples=4 00:22:04.573 write: IOPS=17.8k, BW=69.5MiB/s (72.9MB/s)(139MiB/2004msec); 0 zone resets 00:22:04.573 slat (nsec): min=1441, max=18535, avg=1844.59, stdev=538.22 00:22:04.573 clat (usec): min=2723, max=6521, avg=3569.37, stdev=85.89 00:22:04.573 lat (usec): min=2729, max=6523, avg=3571.22, stdev=85.84 00:22:04.573 clat percentiles (usec): 00:22:04.573 | 1.00th=[ 3523], 5.00th=[ 3556], 10.00th=[ 3556], 20.00th=[ 3556], 00:22:04.573 | 30.00th=[ 3556], 40.00th=[ 3556], 50.00th=[ 3556], 60.00th=[ 3556], 00:22:04.573 | 70.00th=[ 3589], 80.00th=[ 3589], 90.00th=[ 3589], 95.00th=[ 3589], 00:22:04.573 | 99.00th=[ 3621], 99.50th=[ 3752], 99.90th=[ 4752], 99.95th=[ 5997], 00:22:04.573 | 99.99th=[ 6521] 00:22:04.573 bw ( KiB/s): min=69776, max=71792, per=100.00%, avg=71194.00, stdev=949.62, samples=4 00:22:04.573 iops : min=17444, max=17948, avg=17798.50, stdev=237.40, samples=4 00:22:04.573 lat (msec) : 2=0.01%, 4=99.81%, 10=0.19% 00:22:04.573 cpu : usr=99.45%, sys=0.15%, ctx=15, majf=0, minf=3 00:22:04.573 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.9% 00:22:04.573 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:04.573 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:22:04.573 issued rwts: total=35664,35659,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:04.573 latency : target=0, window=0, percentile=100.00%, depth=128 00:22:04.573 00:22:04.573 Run status group 0 (all jobs): 00:22:04.573 READ: bw=69.5MiB/s (72.9MB/s), 69.5MiB/s-69.5MiB/s (72.9MB/s-72.9MB/s), io=139MiB (146MB), run=2004-2004msec 00:22:04.573 WRITE: bw=69.5MiB/s (72.9MB/s), 69.5MiB/s-69.5MiB/s (72.9MB/s-72.9MB/s), io=139MiB (146MB), run=2004-2004msec 00:22:04.573 02:41:37 -- host/fio.sh@43 -- # fio_nvme /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' 00:22:04.573 02:41:37 -- common/autotest_common.sh@1346 -- # fio_plugin /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' 00:22:04.573 02:41:37 -- common/autotest_common.sh@1323 -- # local fio_dir=/usr/src/fio 00:22:04.573 02:41:37 -- common/autotest_common.sh@1325 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:22:04.573 02:41:37 -- common/autotest_common.sh@1325 -- # local sanitizers 00:22:04.573 02:41:37 -- common/autotest_common.sh@1326 -- # local plugin=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:22:04.573 02:41:37 -- common/autotest_common.sh@1327 -- # shift 00:22:04.573 02:41:37 -- common/autotest_common.sh@1329 -- # local asan_lib= 00:22:04.573 02:41:37 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:22:04.573 02:41:37 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:22:04.574 02:41:37 -- common/autotest_common.sh@1331 -- # grep libasan 00:22:04.574 02:41:37 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:22:04.574 02:41:37 -- common/autotest_common.sh@1331 -- # asan_lib= 00:22:04.574 02:41:37 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:22:04.574 02:41:37 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:22:04.574 02:41:37 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:22:04.574 02:41:37 -- common/autotest_common.sh@1331 -- # grep libclang_rt.asan 00:22:04.574 02:41:37 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:22:04.574 02:41:37 -- common/autotest_common.sh@1331 -- # asan_lib= 00:22:04.574 02:41:37 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:22:04.574 02:41:37 -- common/autotest_common.sh@1338 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme' 00:22:04.574 02:41:37 -- common/autotest_common.sh@1338 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' 00:22:04.574 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:22:04.574 fio-3.35 00:22:04.574 Starting 1 thread 00:22:04.574 EAL: No free 2048 kB hugepages reported on node 1 00:22:07.097 00:22:07.097 test: (groupid=0, jobs=1): err= 0: pid=1622034: Sat Apr 27 02:41:40 2024 00:22:07.097 read: IOPS=13.1k, BW=205MiB/s (215MB/s)(404MiB/1971msec) 00:22:07.097 slat (nsec): min=2305, max=42798, avg=2694.07, stdev=1249.64 00:22:07.097 clat (usec): min=281, max=9525, avg=1717.09, stdev=1071.86 00:22:07.097 lat (usec): min=283, max=9530, avg=1719.78, stdev=1072.52 00:22:07.097 clat percentiles (usec): 00:22:07.097 | 1.00th=[ 586], 5.00th=[ 848], 10.00th=[ 979], 20.00th=[ 1139], 00:22:07.097 | 30.00th=[ 1254], 40.00th=[ 1352], 50.00th=[ 1450], 60.00th=[ 1565], 00:22:07.097 | 70.00th=[ 1729], 80.00th=[ 1942], 90.00th=[ 2376], 95.00th=[ 3818], 00:22:07.097 | 99.00th=[ 6783], 99.50th=[ 7308], 99.90th=[ 8717], 99.95th=[ 9110], 00:22:07.097 | 99.99th=[ 9503] 00:22:07.097 bw ( KiB/s): min=100224, max=104736, per=49.05%, avg=102856.00, stdev=1927.52, samples=4 00:22:07.098 iops : min= 6264, max= 6546, avg=6428.50, stdev=120.47, samples=4 00:22:07.098 write: IOPS=7182, BW=112MiB/s (118MB/s)(209MiB/1865msec); 0 zone resets 00:22:07.098 slat (nsec): min=27092, max=95788, avg=30450.71, stdev=6818.76 00:22:07.098 clat (usec): min=4219, max=21845, avg=14024.59, stdev=1779.98 00:22:07.098 lat (usec): min=4247, max=21873, avg=14055.04, stdev=1779.76 00:22:07.098 clat percentiles (usec): 00:22:07.098 | 1.00th=[ 7898], 5.00th=[11469], 10.00th=[11994], 20.00th=[12780], 00:22:07.098 | 30.00th=[13304], 40.00th=[13698], 50.00th=[14091], 60.00th=[14353], 00:22:07.098 | 70.00th=[14877], 80.00th=[15401], 90.00th=[16057], 95.00th=[16712], 00:22:07.098 | 99.00th=[18220], 99.50th=[19268], 99.90th=[21365], 99.95th=[21627], 00:22:07.098 | 99.99th=[21890] 00:22:07.098 bw ( KiB/s): min=101536, max=110112, per=92.51%, avg=106312.00, stdev=3582.61, samples=4 00:22:07.098 iops : min= 6346, max= 6882, avg=6644.50, stdev=223.91, samples=4 00:22:07.098 lat (usec) : 500=0.30%, 750=1.72%, 1000=5.26% 00:22:07.098 lat (msec) : 2=46.57%, 4=8.98%, 10=3.60%, 20=33.44%, 50=0.12% 00:22:07.098 cpu : usr=96.86%, sys=1.50%, ctx=182, majf=0, minf=2 00:22:07.098 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:22:07.098 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:07.098 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:22:07.098 issued rwts: total=25834,13395,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:07.098 latency : target=0, window=0, percentile=100.00%, depth=128 00:22:07.098 00:22:07.098 Run status group 0 (all jobs): 00:22:07.098 READ: bw=205MiB/s (215MB/s), 205MiB/s-205MiB/s (215MB/s-215MB/s), io=404MiB (423MB), run=1971-1971msec 00:22:07.098 WRITE: bw=112MiB/s (118MB/s), 112MiB/s-112MiB/s (118MB/s-118MB/s), io=209MiB (219MB), run=1865-1865msec 00:22:07.098 02:41:40 -- host/fio.sh@45 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:07.098 02:41:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:07.098 02:41:40 -- common/autotest_common.sh@10 -- # set +x 00:22:07.098 02:41:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:07.098 02:41:40 -- host/fio.sh@47 -- # '[' 0 -eq 1 ']' 00:22:07.098 02:41:40 -- host/fio.sh@81 -- # trap - SIGINT SIGTERM EXIT 00:22:07.098 02:41:40 -- host/fio.sh@83 -- # rm -f ./local-test-0-verify.state 00:22:07.098 02:41:40 -- host/fio.sh@84 -- # nvmftestfini 00:22:07.098 02:41:40 -- nvmf/common.sh@477 -- # nvmfcleanup 00:22:07.098 02:41:40 -- nvmf/common.sh@117 -- # sync 00:22:07.098 02:41:40 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:22:07.098 02:41:40 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:22:07.098 02:41:40 -- nvmf/common.sh@120 -- # set +e 00:22:07.098 02:41:40 -- nvmf/common.sh@121 -- # for i in {1..20} 00:22:07.098 02:41:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:22:07.098 rmmod nvme_rdma 00:22:07.098 rmmod nvme_fabrics 00:22:07.098 02:41:40 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:22:07.098 02:41:40 -- nvmf/common.sh@124 -- # set -e 00:22:07.098 02:41:40 -- nvmf/common.sh@125 -- # return 0 00:22:07.098 02:41:40 -- nvmf/common.sh@478 -- # '[' -n 1621206 ']' 00:22:07.098 02:41:40 -- nvmf/common.sh@479 -- # killprocess 1621206 00:22:07.098 02:41:40 -- common/autotest_common.sh@936 -- # '[' -z 1621206 ']' 00:22:07.098 02:41:40 -- common/autotest_common.sh@940 -- # kill -0 1621206 00:22:07.098 02:41:40 -- common/autotest_common.sh@941 -- # uname 00:22:07.098 02:41:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:07.098 02:41:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1621206 00:22:07.098 02:41:40 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:07.098 02:41:40 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:07.098 02:41:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1621206' 00:22:07.098 killing process with pid 1621206 00:22:07.098 02:41:40 -- common/autotest_common.sh@955 -- # kill 1621206 00:22:07.098 02:41:40 -- common/autotest_common.sh@960 -- # wait 1621206 00:22:07.098 [2024-04-27 02:41:40.602751] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:22:07.356 02:41:40 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:22:07.356 02:41:40 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:22:07.356 00:22:07.356 real 0m12.612s 00:22:07.356 user 0m37.574s 00:22:07.356 sys 0m5.081s 00:22:07.356 02:41:40 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:22:07.356 02:41:40 -- common/autotest_common.sh@10 -- # set +x 00:22:07.356 ************************************ 00:22:07.356 END TEST nvmf_fio_host 00:22:07.356 ************************************ 00:22:07.356 02:41:40 -- nvmf/nvmf.sh@98 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=rdma 00:22:07.356 02:41:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:07.357 02:41:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:07.357 02:41:40 -- common/autotest_common.sh@10 -- # set +x 00:22:07.615 ************************************ 00:22:07.615 START TEST nvmf_failover 00:22:07.615 ************************************ 00:22:07.615 02:41:41 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=rdma 00:22:07.615 * Looking for test storage... 00:22:07.615 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:22:07.615 02:41:41 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:22:07.615 02:41:41 -- nvmf/common.sh@7 -- # uname -s 00:22:07.615 02:41:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:07.615 02:41:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:07.615 02:41:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:07.615 02:41:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:07.615 02:41:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:07.615 02:41:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:07.615 02:41:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:07.615 02:41:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:07.615 02:41:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:07.615 02:41:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:07.615 02:41:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:22:07.615 02:41:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:22:07.615 02:41:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:07.615 02:41:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:07.615 02:41:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:07.615 02:41:41 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:22:07.615 02:41:41 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:22:07.615 02:41:41 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:07.615 02:41:41 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:07.615 02:41:41 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:07.615 02:41:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:07.615 02:41:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:07.615 02:41:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:07.615 02:41:41 -- paths/export.sh@5 -- # export PATH 00:22:07.615 02:41:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:07.615 02:41:41 -- nvmf/common.sh@47 -- # : 0 00:22:07.615 02:41:41 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:22:07.615 02:41:41 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:22:07.615 02:41:41 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:22:07.615 02:41:41 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:07.615 02:41:41 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:07.615 02:41:41 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:22:07.615 02:41:41 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:22:07.615 02:41:41 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:22:07.615 02:41:41 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:07.615 02:41:41 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:07.615 02:41:41 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:22:07.615 02:41:41 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:22:07.615 02:41:41 -- host/failover.sh@18 -- # nvmftestinit 00:22:07.616 02:41:41 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:22:07.616 02:41:41 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:07.616 02:41:41 -- nvmf/common.sh@437 -- # prepare_net_devs 00:22:07.616 02:41:41 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:22:07.616 02:41:41 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:22:07.616 02:41:41 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:07.616 02:41:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:07.616 02:41:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:07.616 02:41:41 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:22:07.616 02:41:41 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:22:07.616 02:41:41 -- nvmf/common.sh@285 -- # xtrace_disable 00:22:07.616 02:41:41 -- common/autotest_common.sh@10 -- # set +x 00:22:14.169 02:41:47 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:14.169 02:41:47 -- nvmf/common.sh@291 -- # pci_devs=() 00:22:14.169 02:41:47 -- nvmf/common.sh@291 -- # local -a pci_devs 00:22:14.169 02:41:47 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:22:14.169 02:41:47 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:22:14.169 02:41:47 -- nvmf/common.sh@293 -- # pci_drivers=() 00:22:14.169 02:41:47 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:22:14.169 02:41:47 -- nvmf/common.sh@295 -- # net_devs=() 00:22:14.169 02:41:47 -- nvmf/common.sh@295 -- # local -ga net_devs 00:22:14.169 02:41:47 -- nvmf/common.sh@296 -- # e810=() 00:22:14.169 02:41:47 -- nvmf/common.sh@296 -- # local -ga e810 00:22:14.169 02:41:47 -- nvmf/common.sh@297 -- # x722=() 00:22:14.169 02:41:47 -- nvmf/common.sh@297 -- # local -ga x722 00:22:14.169 02:41:47 -- nvmf/common.sh@298 -- # mlx=() 00:22:14.169 02:41:47 -- nvmf/common.sh@298 -- # local -ga mlx 00:22:14.169 02:41:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:14.169 02:41:47 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:14.169 02:41:47 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:14.169 02:41:47 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:14.169 02:41:47 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:14.169 02:41:47 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:14.169 02:41:47 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:14.169 02:41:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:14.169 02:41:47 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:14.169 02:41:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:14.169 02:41:47 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:14.169 02:41:47 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:22:14.169 02:41:47 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:22:14.169 02:41:47 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:22:14.169 02:41:47 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:22:14.169 02:41:47 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:22:14.169 02:41:47 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:22:14.169 02:41:47 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:22:14.169 02:41:47 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:22:14.169 02:41:47 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:22:14.169 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:22:14.169 02:41:47 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:22:14.169 02:41:47 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:22:14.169 02:41:47 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:22:14.169 02:41:47 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:22:14.169 02:41:47 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:22:14.169 02:41:47 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:22:14.169 02:41:47 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:22:14.169 02:41:47 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:22:14.169 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:22:14.169 02:41:47 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:22:14.169 02:41:47 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:22:14.169 02:41:47 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:22:14.169 02:41:47 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:22:14.169 02:41:47 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:22:14.169 02:41:47 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:22:14.169 02:41:47 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:22:14.169 02:41:47 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:22:14.169 02:41:47 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:22:14.169 02:41:47 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:14.169 02:41:47 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:22:14.169 02:41:47 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:14.169 02:41:47 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:22:14.169 Found net devices under 0000:18:00.0: mlx_0_0 00:22:14.169 02:41:47 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:22:14.169 02:41:47 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:22:14.169 02:41:47 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:14.169 02:41:47 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:22:14.169 02:41:47 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:14.169 02:41:47 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:22:14.169 Found net devices under 0000:18:00.1: mlx_0_1 00:22:14.169 02:41:47 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:22:14.169 02:41:47 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:22:14.169 02:41:47 -- nvmf/common.sh@403 -- # is_hw=yes 00:22:14.169 02:41:47 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:22:14.169 02:41:47 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:22:14.169 02:41:47 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:22:14.169 02:41:47 -- nvmf/common.sh@409 -- # rdma_device_init 00:22:14.169 02:41:47 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:22:14.169 02:41:47 -- nvmf/common.sh@58 -- # uname 00:22:14.169 02:41:47 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:22:14.169 02:41:47 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:22:14.169 02:41:47 -- nvmf/common.sh@63 -- # modprobe ib_core 00:22:14.170 02:41:47 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:22:14.170 02:41:47 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:22:14.170 02:41:47 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:22:14.170 02:41:47 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:22:14.170 02:41:47 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:22:14.170 02:41:47 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:22:14.170 02:41:47 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:22:14.170 02:41:47 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:22:14.170 02:41:47 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:22:14.170 02:41:47 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:22:14.170 02:41:47 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:22:14.170 02:41:47 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:22:14.170 02:41:47 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:22:14.170 02:41:47 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:14.170 02:41:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:14.170 02:41:47 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:22:14.170 02:41:47 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:22:14.170 02:41:47 -- nvmf/common.sh@105 -- # continue 2 00:22:14.170 02:41:47 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:14.170 02:41:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:14.170 02:41:47 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:22:14.170 02:41:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:14.170 02:41:47 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:22:14.170 02:41:47 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:22:14.170 02:41:47 -- nvmf/common.sh@105 -- # continue 2 00:22:14.170 02:41:47 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:22:14.170 02:41:47 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:22:14.170 02:41:47 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:22:14.170 02:41:47 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:22:14.170 02:41:47 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:14.170 02:41:47 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:14.170 02:41:47 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:22:14.170 02:41:47 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:22:14.170 02:41:47 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:22:14.170 64: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:22:14.170 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:22:14.170 altname enp24s0f0np0 00:22:14.170 altname ens785f0np0 00:22:14.170 inet 192.168.100.8/24 scope global mlx_0_0 00:22:14.170 valid_lft forever preferred_lft forever 00:22:14.170 02:41:47 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:22:14.170 02:41:47 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:22:14.170 02:41:47 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:22:14.170 02:41:47 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:22:14.170 02:41:47 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:14.170 02:41:47 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:14.170 02:41:47 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:22:14.170 02:41:47 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:22:14.170 02:41:47 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:22:14.170 65: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:22:14.170 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:22:14.170 altname enp24s0f1np1 00:22:14.170 altname ens785f1np1 00:22:14.170 inet 192.168.100.9/24 scope global mlx_0_1 00:22:14.170 valid_lft forever preferred_lft forever 00:22:14.170 02:41:47 -- nvmf/common.sh@411 -- # return 0 00:22:14.170 02:41:47 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:22:14.170 02:41:47 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:22:14.170 02:41:47 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:22:14.170 02:41:47 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:22:14.170 02:41:47 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:22:14.170 02:41:47 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:22:14.170 02:41:47 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:22:14.170 02:41:47 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:22:14.170 02:41:47 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:22:14.170 02:41:47 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:22:14.170 02:41:47 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:14.170 02:41:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:14.170 02:41:47 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:22:14.170 02:41:47 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:22:14.170 02:41:47 -- nvmf/common.sh@105 -- # continue 2 00:22:14.170 02:41:47 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:14.170 02:41:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:14.170 02:41:47 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:22:14.170 02:41:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:14.170 02:41:47 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:22:14.170 02:41:47 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:22:14.170 02:41:47 -- nvmf/common.sh@105 -- # continue 2 00:22:14.170 02:41:47 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:22:14.170 02:41:47 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:22:14.170 02:41:47 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:22:14.170 02:41:47 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:22:14.170 02:41:47 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:14.170 02:41:47 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:14.170 02:41:47 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:22:14.170 02:41:47 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:22:14.170 02:41:47 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:22:14.170 02:41:47 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:22:14.170 02:41:47 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:14.170 02:41:47 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:14.170 02:41:47 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:22:14.170 192.168.100.9' 00:22:14.170 02:41:47 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:22:14.170 192.168.100.9' 00:22:14.170 02:41:47 -- nvmf/common.sh@446 -- # head -n 1 00:22:14.170 02:41:47 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:22:14.170 02:41:47 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:22:14.170 192.168.100.9' 00:22:14.170 02:41:47 -- nvmf/common.sh@447 -- # tail -n +2 00:22:14.170 02:41:47 -- nvmf/common.sh@447 -- # head -n 1 00:22:14.170 02:41:47 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:22:14.170 02:41:47 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:22:14.170 02:41:47 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:22:14.170 02:41:47 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:22:14.170 02:41:47 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:22:14.170 02:41:47 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:22:14.170 02:41:47 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:22:14.170 02:41:47 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:22:14.170 02:41:47 -- common/autotest_common.sh@710 -- # xtrace_disable 00:22:14.170 02:41:47 -- common/autotest_common.sh@10 -- # set +x 00:22:14.170 02:41:47 -- nvmf/common.sh@470 -- # nvmfpid=1625126 00:22:14.170 02:41:47 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:22:14.170 02:41:47 -- nvmf/common.sh@471 -- # waitforlisten 1625126 00:22:14.170 02:41:47 -- common/autotest_common.sh@817 -- # '[' -z 1625126 ']' 00:22:14.170 02:41:47 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:14.170 02:41:47 -- common/autotest_common.sh@822 -- # local max_retries=100 00:22:14.170 02:41:47 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:14.170 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:14.170 02:41:47 -- common/autotest_common.sh@826 -- # xtrace_disable 00:22:14.170 02:41:47 -- common/autotest_common.sh@10 -- # set +x 00:22:14.170 [2024-04-27 02:41:47.519359] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:22:14.170 [2024-04-27 02:41:47.519429] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:14.170 EAL: No free 2048 kB hugepages reported on node 1 00:22:14.170 [2024-04-27 02:41:47.593159] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:22:14.170 [2024-04-27 02:41:47.679260] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:14.170 [2024-04-27 02:41:47.679307] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:14.170 [2024-04-27 02:41:47.679318] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:22:14.170 [2024-04-27 02:41:47.679328] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:22:14.170 [2024-04-27 02:41:47.679343] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:14.170 [2024-04-27 02:41:47.679402] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:14.170 [2024-04-27 02:41:47.679488] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:14.170 [2024-04-27 02:41:47.679490] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:14.734 02:41:48 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:22:14.734 02:41:48 -- common/autotest_common.sh@850 -- # return 0 00:22:14.734 02:41:48 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:22:14.734 02:41:48 -- common/autotest_common.sh@716 -- # xtrace_disable 00:22:14.734 02:41:48 -- common/autotest_common.sh@10 -- # set +x 00:22:14.991 02:41:48 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:14.991 02:41:48 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:22:14.991 [2024-04-27 02:41:48.557374] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1363d30/0x1368220) succeed. 00:22:14.991 [2024-04-27 02:41:48.567764] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x13652d0/0x13a98b0) succeed. 00:22:15.249 02:41:48 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:22:15.250 Malloc0 00:22:15.507 02:41:48 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:15.507 02:41:49 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:15.765 02:41:49 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:22:16.022 [2024-04-27 02:41:49.438948] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:22:16.022 02:41:49 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4421 00:22:16.022 [2024-04-27 02:41:49.623314] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4421 *** 00:22:16.280 02:41:49 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4422 00:22:16.280 [2024-04-27 02:41:49.807974] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4422 *** 00:22:16.280 02:41:49 -- host/failover.sh@31 -- # bdevperf_pid=1625514 00:22:16.280 02:41:49 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:22:16.280 02:41:49 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:16.280 02:41:49 -- host/failover.sh@34 -- # waitforlisten 1625514 /var/tmp/bdevperf.sock 00:22:16.280 02:41:49 -- common/autotest_common.sh@817 -- # '[' -z 1625514 ']' 00:22:16.280 02:41:49 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:16.280 02:41:49 -- common/autotest_common.sh@822 -- # local max_retries=100 00:22:16.280 02:41:49 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:16.280 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:16.280 02:41:49 -- common/autotest_common.sh@826 -- # xtrace_disable 00:22:16.280 02:41:49 -- common/autotest_common.sh@10 -- # set +x 00:22:17.214 02:41:50 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:22:17.214 02:41:50 -- common/autotest_common.sh@850 -- # return 0 00:22:17.214 02:41:50 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:22:17.471 NVMe0n1 00:22:17.471 02:41:50 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:22:17.729 00:22:17.729 02:41:51 -- host/failover.sh@39 -- # run_test_pid=1625700 00:22:17.729 02:41:51 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:22:17.729 02:41:51 -- host/failover.sh@41 -- # sleep 1 00:22:18.663 02:41:52 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:22:18.920 [2024-04-27 02:41:52.371334] rdma.c:4595:nvmf_rdma_log_wc_status: *ERROR*: Error on CQ 0x7ff46402f600, (qp state 3, in_error 1) request 0x35184850688352, type RECV, status: (16): aborted error 00:22:18.920 02:41:52 -- host/failover.sh@45 -- # sleep 3 00:22:22.204 02:41:55 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:22:22.204 00:22:22.204 02:41:55 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4421 00:22:22.462 02:41:55 -- host/failover.sh@50 -- # sleep 3 00:22:25.743 02:41:58 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:22:25.743 [2024-04-27 02:41:59.016358] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:22:25.743 02:41:59 -- host/failover.sh@55 -- # sleep 1 00:22:26.672 02:42:00 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4422 00:22:26.672 02:42:00 -- host/failover.sh@59 -- # wait 1625700 00:22:33.234 0 00:22:33.234 02:42:06 -- host/failover.sh@61 -- # killprocess 1625514 00:22:33.234 02:42:06 -- common/autotest_common.sh@936 -- # '[' -z 1625514 ']' 00:22:33.234 02:42:06 -- common/autotest_common.sh@940 -- # kill -0 1625514 00:22:33.234 02:42:06 -- common/autotest_common.sh@941 -- # uname 00:22:33.234 02:42:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:33.234 02:42:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1625514 00:22:33.234 02:42:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:33.234 02:42:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:33.234 02:42:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1625514' 00:22:33.234 killing process with pid 1625514 00:22:33.234 02:42:06 -- common/autotest_common.sh@955 -- # kill 1625514 00:22:33.234 02:42:06 -- common/autotest_common.sh@960 -- # wait 1625514 00:22:33.234 02:42:06 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/try.txt 00:22:33.234 [2024-04-27 02:41:49.879354] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:22:33.234 [2024-04-27 02:41:49.879416] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1625514 ] 00:22:33.234 EAL: No free 2048 kB hugepages reported on node 1 00:22:33.234 [2024-04-27 02:41:49.950252] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:33.234 [2024-04-27 02:41:50.033960] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:33.234 Running I/O for 15 seconds... 00:22:33.235 [2024-04-27 02:41:53.380793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:22848 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007550000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.380836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.380857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:22856 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007552000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.380868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.380882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:22864 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007554000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.380892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.380903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:22872 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007556000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.380914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.380926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:22880 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007558000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.380936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.380948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:22888 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755a000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.380960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.380973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:22896 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755c000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.380982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.380994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:22904 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755e000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:22912 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007560000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22920 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007562000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:22928 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007564000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:22936 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007566000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:22944 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007568000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:22952 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756a000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:22960 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756c000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:22968 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756e000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:22976 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007570000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:22984 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007572000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:22992 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007574000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:23000 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007576000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:23008 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007578000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:23016 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757a000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:23024 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757c000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:23032 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757e000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:23040 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007580000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:23048 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007582000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:23056 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007584000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:23064 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007586000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23072 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007588000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:23080 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758a000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23088 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758c000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:23096 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758e000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:23104 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007590000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:23112 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007592000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:23120 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007594000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:23128 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007596000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:23136 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007598000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:23144 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759a000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:23152 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759c000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23160 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759e000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:23168 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a0000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:23176 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a2000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:23184 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a4000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23192 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a6000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:23200 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a8000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:23208 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075aa000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23216 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ac000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:23224 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ae000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:23232 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b0000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:23240 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b2000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:23248 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b4000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:23256 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b6000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:23264 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b8000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.381988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.381999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:23272 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ba000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.382008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.382019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:23280 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075bc000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.382028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.382040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:23288 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075be000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.382050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.382062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:23296 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c0000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.382072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.382083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:23304 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c2000 len:0x1000 key:0x3d000 00:22:33.235 [2024-04-27 02:41:53.382092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.235 [2024-04-27 02:41:53.382103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:23312 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c4000 len:0x1000 key:0x3d000 00:22:33.236 [2024-04-27 02:41:53.382113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.382125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:23320 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c6000 len:0x1000 key:0x3d000 00:22:33.236 [2024-04-27 02:41:53.382134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.382145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:23328 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c8000 len:0x1000 key:0x3d000 00:22:33.236 [2024-04-27 02:41:53.382155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.382166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:23336 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ca000 len:0x1000 key:0x3d000 00:22:33.236 [2024-04-27 02:41:53.382176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.382188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23344 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075cc000 len:0x1000 key:0x3d000 00:22:33.236 [2024-04-27 02:41:53.382197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.382208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:23352 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ce000 len:0x1000 key:0x3d000 00:22:33.236 [2024-04-27 02:41:53.382220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.382232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:23360 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d0000 len:0x1000 key:0x3d000 00:22:33.236 [2024-04-27 02:41:53.382242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.382254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:23368 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d2000 len:0x1000 key:0x3d000 00:22:33.236 [2024-04-27 02:41:53.382263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.382274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:23376 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d4000 len:0x1000 key:0x3d000 00:22:33.236 [2024-04-27 02:41:53.382284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.382296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:23384 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d6000 len:0x1000 key:0x3d000 00:22:33.236 [2024-04-27 02:41:53.382307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.382318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:23392 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d8000 len:0x1000 key:0x3d000 00:22:33.236 [2024-04-27 02:41:53.382328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.382344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23400 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075da000 len:0x1000 key:0x3d000 00:22:33.236 [2024-04-27 02:41:53.382354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.382366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:23408 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075dc000 len:0x1000 key:0x3d000 00:22:33.236 [2024-04-27 02:41:53.382376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.382387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:23416 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075de000 len:0x1000 key:0x3d000 00:22:33.236 [2024-04-27 02:41:53.382396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.382407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:23424 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e0000 len:0x1000 key:0x3d000 00:22:33.236 [2024-04-27 02:41:53.382417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.382429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:23432 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e2000 len:0x1000 key:0x3d000 00:22:33.236 [2024-04-27 02:41:53.382438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.382449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:23440 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e4000 len:0x1000 key:0x3d000 00:22:33.236 [2024-04-27 02:41:53.382458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.382470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:23448 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e6000 len:0x1000 key:0x3d000 00:22:33.236 [2024-04-27 02:41:53.382479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.382490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:23456 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e8000 len:0x1000 key:0x3d000 00:22:33.236 [2024-04-27 02:41:53.382500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.382511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:23464 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ea000 len:0x1000 key:0x3d000 00:22:33.236 [2024-04-27 02:41:53.382520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.382532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:23472 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ec000 len:0x1000 key:0x3d000 00:22:33.236 [2024-04-27 02:41:53.382541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.382555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23480 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ee000 len:0x1000 key:0x3d000 00:22:33.236 [2024-04-27 02:41:53.382564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.382576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:23488 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f0000 len:0x1000 key:0x3d000 00:22:33.236 [2024-04-27 02:41:53.382585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.382596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:23496 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f2000 len:0x1000 key:0x3d000 00:22:33.236 [2024-04-27 02:41:53.382606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.382617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:23504 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f4000 len:0x1000 key:0x3d000 00:22:33.236 [2024-04-27 02:41:53.382627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.382638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:23512 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f6000 len:0x1000 key:0x3d000 00:22:33.236 [2024-04-27 02:41:53.382647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.382658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:23520 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f8000 len:0x1000 key:0x3d000 00:22:33.236 [2024-04-27 02:41:53.382668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.382679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:23528 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075fa000 len:0x1000 key:0x3d000 00:22:33.236 [2024-04-27 02:41:53.382689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.382700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:23536 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075fc000 len:0x1000 key:0x3d000 00:22:33.236 [2024-04-27 02:41:53.382709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.382720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:23544 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075fe000 len:0x1000 key:0x3d000 00:22:33.236 [2024-04-27 02:41:53.382730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.382741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.236 [2024-04-27 02:41:53.382751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.382762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:23560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.236 [2024-04-27 02:41:53.382771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.382782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:23568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.236 [2024-04-27 02:41:53.382794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.382805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:23576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.236 [2024-04-27 02:41:53.382815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.382825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:23584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.236 [2024-04-27 02:41:53.382835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.382847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:23592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.236 [2024-04-27 02:41:53.382857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.382868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:23600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.236 [2024-04-27 02:41:53.382877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.382887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:23608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.236 [2024-04-27 02:41:53.382898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.382909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:23616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.236 [2024-04-27 02:41:53.382918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.382929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:23624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.236 [2024-04-27 02:41:53.382938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.382949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:23632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.236 [2024-04-27 02:41:53.382958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.382969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:23640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.236 [2024-04-27 02:41:53.382979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.382990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:23648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.236 [2024-04-27 02:41:53.382999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.383010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:23656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.236 [2024-04-27 02:41:53.383019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.383031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:23664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.236 [2024-04-27 02:41:53.383040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.383053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:23672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.236 [2024-04-27 02:41:53.383062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.383073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:23680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.236 [2024-04-27 02:41:53.383082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.383093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:23688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.236 [2024-04-27 02:41:53.383103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.383114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:23696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.236 [2024-04-27 02:41:53.383123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.383134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:23704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.236 [2024-04-27 02:41:53.383145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.383156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:23712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.236 [2024-04-27 02:41:53.383166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.383177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:23720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.236 [2024-04-27 02:41:53.383187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.383198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:23728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.236 [2024-04-27 02:41:53.383207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.383219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:23736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.236 [2024-04-27 02:41:53.383228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.383239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:23744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.236 [2024-04-27 02:41:53.383248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.383259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:23752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.236 [2024-04-27 02:41:53.383268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.383280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:23760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.236 [2024-04-27 02:41:53.383289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.383300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:23768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.236 [2024-04-27 02:41:53.383311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.383322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:23776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.236 [2024-04-27 02:41:53.383332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.383349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:23784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.236 [2024-04-27 02:41:53.383358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.383369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:23792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.236 [2024-04-27 02:41:53.383379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.383390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:23800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.236 [2024-04-27 02:41:53.383400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.383411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:23808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.236 [2024-04-27 02:41:53.383420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.383431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:23816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.236 [2024-04-27 02:41:53.383441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.383452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:23824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.236 [2024-04-27 02:41:53.383462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.383474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:23832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.236 [2024-04-27 02:41:53.383484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.236 [2024-04-27 02:41:53.383494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:23840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.236 [2024-04-27 02:41:53.383504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:53.383515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:23848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.237 [2024-04-27 02:41:53.383525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:53.383537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:23856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.237 [2024-04-27 02:41:53.383547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:53.385500] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:22:33.237 [2024-04-27 02:41:53.385515] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:22:33.237 [2024-04-27 02:41:53.385525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23864 len:8 PRP1 0x0 PRP2 0x0 00:22:33.237 [2024-04-27 02:41:53.385538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:53.385583] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192e4a00 was disconnected and freed. reset controller. 00:22:33.237 [2024-04-27 02:41:53.385595] bdev_nvme.c:1857:bdev_nvme_failover_trid: *NOTICE*: Start failover from 192.168.100.8:4420 to 192.168.100.8:4421 00:22:33.237 [2024-04-27 02:41:53.385605] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:33.237 [2024-04-27 02:41:53.388413] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:33.237 [2024-04-27 02:41:53.403098] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:22:33.237 [2024-04-27 02:41:53.449884] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:22:33.237 [2024-04-27 02:41:56.815349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:114968 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e6000 len:0x1000 key:0x3d000 00:22:33.237 [2024-04-27 02:41:56.815395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:56.815415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:114976 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e4000 len:0x1000 key:0x3d000 00:22:33.237 [2024-04-27 02:41:56.815426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:56.815438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:114984 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e2000 len:0x1000 key:0x3d000 00:22:33.237 [2024-04-27 02:41:56.815448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:56.815459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:114992 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e0000 len:0x1000 key:0x3d000 00:22:33.237 [2024-04-27 02:41:56.815469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:56.815480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:115448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.237 [2024-04-27 02:41:56.815490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:56.815501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:115456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.237 [2024-04-27 02:41:56.815511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:56.815522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:115464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.237 [2024-04-27 02:41:56.815531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:56.815543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:115472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.237 [2024-04-27 02:41:56.815552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:56.815563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:115000 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b8000 len:0x1000 key:0x3d000 00:22:33.237 [2024-04-27 02:41:56.815574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:56.815596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:115008 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ba000 len:0x1000 key:0x3d000 00:22:33.237 [2024-04-27 02:41:56.815605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:56.815617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:115016 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075bc000 len:0x1000 key:0x3d000 00:22:33.237 [2024-04-27 02:41:56.815627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:56.815638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:115024 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075be000 len:0x1000 key:0x3d000 00:22:33.237 [2024-04-27 02:41:56.815651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:56.815662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:115032 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759e000 len:0x1000 key:0x3d000 00:22:33.237 [2024-04-27 02:41:56.815673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:56.815685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:115040 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759c000 len:0x1000 key:0x3d000 00:22:33.237 [2024-04-27 02:41:56.815696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:56.815707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:115048 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759a000 len:0x1000 key:0x3d000 00:22:33.237 [2024-04-27 02:41:56.815716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:56.815729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:115056 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007598000 len:0x1000 key:0x3d000 00:22:33.237 [2024-04-27 02:41:56.815740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:56.815753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:115480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.237 [2024-04-27 02:41:56.815763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:56.815776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:115488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.237 [2024-04-27 02:41:56.815786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:56.815798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:115496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.237 [2024-04-27 02:41:56.815809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:56.815821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:115504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.237 [2024-04-27 02:41:56.815832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:56.815844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:115064 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758e000 len:0x1000 key:0x3d000 00:22:33.237 [2024-04-27 02:41:56.815855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:56.815870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:115072 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758c000 len:0x1000 key:0x3d000 00:22:33.237 [2024-04-27 02:41:56.815881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:56.815893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:115080 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758a000 len:0x1000 key:0x3d000 00:22:33.237 [2024-04-27 02:41:56.815903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:56.815914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:115088 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007588000 len:0x1000 key:0x3d000 00:22:33.237 [2024-04-27 02:41:56.815923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:56.815935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:115096 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007566000 len:0x1000 key:0x3d000 00:22:33.237 [2024-04-27 02:41:56.815945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:56.815957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:115104 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007564000 len:0x1000 key:0x3d000 00:22:33.237 [2024-04-27 02:41:56.815967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:56.815978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:115112 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007562000 len:0x1000 key:0x3d000 00:22:33.237 [2024-04-27 02:41:56.815988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:56.816000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:115120 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007560000 len:0x1000 key:0x3d000 00:22:33.237 [2024-04-27 02:41:56.816009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:56.816020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:115512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.237 [2024-04-27 02:41:56.816031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:56.816042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:115520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.237 [2024-04-27 02:41:56.816052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:56.816063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:115528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.237 [2024-04-27 02:41:56.816073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:56.816084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:115536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.237 [2024-04-27 02:41:56.816095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:56.816106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:115544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.237 [2024-04-27 02:41:56.816116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:56.816130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:115552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.237 [2024-04-27 02:41:56.816140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:56.816151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:115560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.237 [2024-04-27 02:41:56.816160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:56.816171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:115568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.237 [2024-04-27 02:41:56.816180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:56.816191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:115128 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756e000 len:0x1000 key:0x3d000 00:22:33.237 [2024-04-27 02:41:56.816201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:56.816212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:115136 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756c000 len:0x1000 key:0x3d000 00:22:33.237 [2024-04-27 02:41:56.816221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:56.816232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:115144 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756a000 len:0x1000 key:0x3d000 00:22:33.237 [2024-04-27 02:41:56.816242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:56.816254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:115152 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007568000 len:0x1000 key:0x3d000 00:22:33.237 [2024-04-27 02:41:56.816264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:56.816276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:115160 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a6000 len:0x1000 key:0x3d000 00:22:33.237 [2024-04-27 02:41:56.816286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:56.816297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:115168 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a4000 len:0x1000 key:0x3d000 00:22:33.237 [2024-04-27 02:41:56.816306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.237 [2024-04-27 02:41:56.816317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:115176 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a2000 len:0x1000 key:0x3d000 00:22:33.237 [2024-04-27 02:41:56.816326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.816342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:115184 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a0000 len:0x1000 key:0x3d000 00:22:33.238 [2024-04-27 02:41:56.816352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.816363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:115576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.238 [2024-04-27 02:41:56.816374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.816386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:115584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.238 [2024-04-27 02:41:56.816396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.816407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:115592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.238 [2024-04-27 02:41:56.816417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.816428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:115600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.238 [2024-04-27 02:41:56.816438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.816449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:115608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.238 [2024-04-27 02:41:56.816458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.816469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:115616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.238 [2024-04-27 02:41:56.816479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.816490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:115624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.238 [2024-04-27 02:41:56.816500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.816511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:115632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.238 [2024-04-27 02:41:56.816521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.816532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:115192 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d0000 len:0x1000 key:0x3d000 00:22:33.238 [2024-04-27 02:41:56.816542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.816554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:115200 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d2000 len:0x1000 key:0x3d000 00:22:33.238 [2024-04-27 02:41:56.816564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.816575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:115208 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d4000 len:0x1000 key:0x3d000 00:22:33.238 [2024-04-27 02:41:56.816584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.816595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:115216 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d6000 len:0x1000 key:0x3d000 00:22:33.238 [2024-04-27 02:41:56.816605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.816616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:115224 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f6000 len:0x1000 key:0x3d000 00:22:33.238 [2024-04-27 02:41:56.816628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.816639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:115232 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f4000 len:0x1000 key:0x3d000 00:22:33.238 [2024-04-27 02:41:56.816649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.816660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:115240 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f2000 len:0x1000 key:0x3d000 00:22:33.238 [2024-04-27 02:41:56.816671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.816682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:115248 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f0000 len:0x1000 key:0x3d000 00:22:33.238 [2024-04-27 02:41:56.816692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.816703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:115640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.238 [2024-04-27 02:41:56.816712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.816724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:115648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.238 [2024-04-27 02:41:56.816734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.816745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:115656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.238 [2024-04-27 02:41:56.816755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.816766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:115664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.238 [2024-04-27 02:41:56.816775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.816785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:115672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.238 [2024-04-27 02:41:56.816795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.816806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:115680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.238 [2024-04-27 02:41:56.816816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.816827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:115688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.238 [2024-04-27 02:41:56.816837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.816849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:115696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.238 [2024-04-27 02:41:56.816859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.816870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:115704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.238 [2024-04-27 02:41:56.816880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.816892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:115712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.238 [2024-04-27 02:41:56.816902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.816913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:115720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.238 [2024-04-27 02:41:56.816923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.816933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:115728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.238 [2024-04-27 02:41:56.816943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.816953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:115736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.238 [2024-04-27 02:41:56.816963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.816974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:115744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.238 [2024-04-27 02:41:56.816984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.816995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:115752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.238 [2024-04-27 02:41:56.817005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.817015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:115760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.238 [2024-04-27 02:41:56.817025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.817036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:115256 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757e000 len:0x1000 key:0x3d000 00:22:33.238 [2024-04-27 02:41:56.817046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.817058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:115264 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757c000 len:0x1000 key:0x3d000 00:22:33.238 [2024-04-27 02:41:56.817067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.817078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:115272 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757a000 len:0x1000 key:0x3d000 00:22:33.238 [2024-04-27 02:41:56.817088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.817099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:115280 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007578000 len:0x1000 key:0x3d000 00:22:33.238 [2024-04-27 02:41:56.817109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.817120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:115768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.238 [2024-04-27 02:41:56.817130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.817142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:115776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.238 [2024-04-27 02:41:56.817153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.817165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:115784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.238 [2024-04-27 02:41:56.817174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.817185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:115792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.238 [2024-04-27 02:41:56.817194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.817205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:115800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.238 [2024-04-27 02:41:56.817216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.817227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:115808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.238 [2024-04-27 02:41:56.817237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.817248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:115816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.238 [2024-04-27 02:41:56.817257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.817268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:115824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.238 [2024-04-27 02:41:56.817278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.817290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:115288 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e8000 len:0x1000 key:0x3d000 00:22:33.238 [2024-04-27 02:41:56.817300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.817310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:115296 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ea000 len:0x1000 key:0x3d000 00:22:33.238 [2024-04-27 02:41:56.817320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.817330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:115304 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ec000 len:0x1000 key:0x3d000 00:22:33.238 [2024-04-27 02:41:56.817345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.817356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:115312 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ee000 len:0x1000 key:0x3d000 00:22:33.238 [2024-04-27 02:41:56.817366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.817378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:115320 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ce000 len:0x1000 key:0x3d000 00:22:33.238 [2024-04-27 02:41:56.817388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.817401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:115328 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075cc000 len:0x1000 key:0x3d000 00:22:33.238 [2024-04-27 02:41:56.817411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.817422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:115336 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ca000 len:0x1000 key:0x3d000 00:22:33.238 [2024-04-27 02:41:56.817432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.817444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:115344 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c8000 len:0x1000 key:0x3d000 00:22:33.238 [2024-04-27 02:41:56.817454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.817465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:115352 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007576000 len:0x1000 key:0x3d000 00:22:33.238 [2024-04-27 02:41:56.817475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.817487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:115360 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007574000 len:0x1000 key:0x3d000 00:22:33.238 [2024-04-27 02:41:56.817496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.817507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:115368 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007572000 len:0x1000 key:0x3d000 00:22:33.238 [2024-04-27 02:41:56.817517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.817528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:115376 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007570000 len:0x1000 key:0x3d000 00:22:33.238 [2024-04-27 02:41:56.817538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.817550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:115384 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ae000 len:0x1000 key:0x3d000 00:22:33.238 [2024-04-27 02:41:56.817559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.817570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:115392 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ac000 len:0x1000 key:0x3d000 00:22:33.238 [2024-04-27 02:41:56.817580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.817591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:115400 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075aa000 len:0x1000 key:0x3d000 00:22:33.238 [2024-04-27 02:41:56.817601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.817612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:115408 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a8000 len:0x1000 key:0x3d000 00:22:33.238 [2024-04-27 02:41:56.817621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.238 [2024-04-27 02:41:56.817632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:115832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.238 [2024-04-27 02:41:56.817643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:41:56.817654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:115840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.239 [2024-04-27 02:41:56.817665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:41:56.817675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:115848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.239 [2024-04-27 02:41:56.817688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:41:56.817698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:115856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.239 [2024-04-27 02:41:56.817708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:41:56.817720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:115864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.239 [2024-04-27 02:41:56.817733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:41:56.817744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:115872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.239 [2024-04-27 02:41:56.817753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:41:56.817764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:115880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.239 [2024-04-27 02:41:56.817774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:41:56.817785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:115888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.239 [2024-04-27 02:41:56.817794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:41:56.817805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:115416 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b6000 len:0x1000 key:0x3d000 00:22:33.239 [2024-04-27 02:41:56.817815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:41:56.817825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:115424 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b4000 len:0x1000 key:0x3d000 00:22:33.239 [2024-04-27 02:41:56.817835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:41:56.817847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:115432 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b2000 len:0x1000 key:0x3d000 00:22:33.239 [2024-04-27 02:41:56.817857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:41:56.817868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:115440 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b0000 len:0x1000 key:0x3d000 00:22:33.239 [2024-04-27 02:41:56.817877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:41:56.817888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:115896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.239 [2024-04-27 02:41:56.817900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:41:56.817911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:115904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.239 [2024-04-27 02:41:56.817921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:41:56.817931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:115912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.239 [2024-04-27 02:41:56.817941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:41:56.817952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:115920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.239 [2024-04-27 02:41:56.817962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:41:56.817973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:115928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.239 [2024-04-27 02:41:56.817982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:41:56.817993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:115936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.239 [2024-04-27 02:41:56.818002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:41:56.818014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:115944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.239 [2024-04-27 02:41:56.818025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:41:56.818036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:115952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.239 [2024-04-27 02:41:56.818045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:41:56.818055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:115960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.239 [2024-04-27 02:41:56.818065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:41:56.818076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:115968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.239 [2024-04-27 02:41:56.818086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:41:56.818097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:115976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.239 [2024-04-27 02:41:56.818107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:41:56.819961] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:22:33.239 [2024-04-27 02:41:56.819976] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:22:33.239 [2024-04-27 02:41:56.819985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:115984 len:8 PRP1 0x0 PRP2 0x0 00:22:33.239 [2024-04-27 02:41:56.819996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:41:56.820042] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192e4940 was disconnected and freed. reset controller. 00:22:33.239 [2024-04-27 02:41:56.820058] bdev_nvme.c:1857:bdev_nvme_failover_trid: *NOTICE*: Start failover from 192.168.100.8:4421 to 192.168.100.8:4422 00:22:33.239 [2024-04-27 02:41:56.820068] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:33.239 [2024-04-27 02:41:56.822843] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:33.239 [2024-04-27 02:41:56.837477] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:22:33.239 [2024-04-27 02:41:56.878940] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:22:33.239 [2024-04-27 02:42:01.231104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:93912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.239 [2024-04-27 02:42:01.231149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:42:01.231167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:93920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.239 [2024-04-27 02:42:01.231179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:42:01.231191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:93928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.239 [2024-04-27 02:42:01.231201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:42:01.231213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:93936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.239 [2024-04-27 02:42:01.231223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:42:01.231234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:93944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.239 [2024-04-27 02:42:01.231245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:42:01.231257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:93952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.239 [2024-04-27 02:42:01.231268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:42:01.231280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:93960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.239 [2024-04-27 02:42:01.231291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:42:01.231302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:93968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.239 [2024-04-27 02:42:01.231312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:42:01.231324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:93976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.239 [2024-04-27 02:42:01.231341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:42:01.231352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:93984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.239 [2024-04-27 02:42:01.231362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:42:01.231373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:93992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.239 [2024-04-27 02:42:01.231391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:42:01.231403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:94000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.239 [2024-04-27 02:42:01.231413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:42:01.231425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:94008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.239 [2024-04-27 02:42:01.231436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:42:01.231447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:94016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.239 [2024-04-27 02:42:01.231457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:42:01.231468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:94024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.239 [2024-04-27 02:42:01.231478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:42:01.231490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:93352 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007578000 len:0x1000 key:0x3d000 00:22:33.239 [2024-04-27 02:42:01.231500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:42:01.231512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:93360 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e8000 len:0x1000 key:0x3d000 00:22:33.239 [2024-04-27 02:42:01.231521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:42:01.231534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:93368 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ea000 len:0x1000 key:0x3d000 00:22:33.239 [2024-04-27 02:42:01.231544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:42:01.231555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:93376 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ec000 len:0x1000 key:0x3d000 00:22:33.239 [2024-04-27 02:42:01.231565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:42:01.231577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:93384 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ee000 len:0x1000 key:0x3d000 00:22:33.239 [2024-04-27 02:42:01.231588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:42:01.231599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:94032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.239 [2024-04-27 02:42:01.231610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:42:01.231621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:94040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.239 [2024-04-27 02:42:01.231631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:42:01.231643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:94048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.239 [2024-04-27 02:42:01.231655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:42:01.231667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:94056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.239 [2024-04-27 02:42:01.231677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:42:01.231688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:94064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.239 [2024-04-27 02:42:01.231698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:42:01.231709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:94072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.239 [2024-04-27 02:42:01.231719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:42:01.231730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:94080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.239 [2024-04-27 02:42:01.231740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:42:01.231752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:94088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.239 [2024-04-27 02:42:01.231761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:42:01.231773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:93392 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757e000 len:0x1000 key:0x3d000 00:22:33.239 [2024-04-27 02:42:01.231783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:42:01.231794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:93400 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b2000 len:0x1000 key:0x3d000 00:22:33.239 [2024-04-27 02:42:01.231804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:42:01.231815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:93408 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b4000 len:0x1000 key:0x3d000 00:22:33.239 [2024-04-27 02:42:01.231826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:42:01.231837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:93416 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b6000 len:0x1000 key:0x3d000 00:22:33.239 [2024-04-27 02:42:01.231848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:42:01.231859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:93424 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a8000 len:0x1000 key:0x3d000 00:22:33.239 [2024-04-27 02:42:01.231869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:42:01.231881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:93432 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075aa000 len:0x1000 key:0x3d000 00:22:33.239 [2024-04-27 02:42:01.231891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:42:01.231902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:93440 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ac000 len:0x1000 key:0x3d000 00:22:33.239 [2024-04-27 02:42:01.231914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:42:01.231926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:93448 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ae000 len:0x1000 key:0x3d000 00:22:33.239 [2024-04-27 02:42:01.231935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:42:01.231946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:94096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.239 [2024-04-27 02:42:01.231957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.239 [2024-04-27 02:42:01.231967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:94104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.239 [2024-04-27 02:42:01.231977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.231989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:94112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.240 [2024-04-27 02:42:01.231999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:94120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.240 [2024-04-27 02:42:01.232020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:94128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.240 [2024-04-27 02:42:01.232041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:94136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.240 [2024-04-27 02:42:01.232062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:94144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.240 [2024-04-27 02:42:01.232083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:94152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.240 [2024-04-27 02:42:01.232104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:94160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.240 [2024-04-27 02:42:01.232125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:94168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.240 [2024-04-27 02:42:01.232147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:94176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.240 [2024-04-27 02:42:01.232167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:94184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.240 [2024-04-27 02:42:01.232190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:94192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.240 [2024-04-27 02:42:01.232212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:94200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.240 [2024-04-27 02:42:01.232234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:94208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.240 [2024-04-27 02:42:01.232255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:94216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.240 [2024-04-27 02:42:01.232276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:94224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.240 [2024-04-27 02:42:01.232297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:93456 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a0000 len:0x1000 key:0x3d000 00:22:33.240 [2024-04-27 02:42:01.232319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:93464 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d0000 len:0x1000 key:0x3d000 00:22:33.240 [2024-04-27 02:42:01.232344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:93472 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d2000 len:0x1000 key:0x3d000 00:22:33.240 [2024-04-27 02:42:01.232366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:93480 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d4000 len:0x1000 key:0x3d000 00:22:33.240 [2024-04-27 02:42:01.232387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:93488 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d6000 len:0x1000 key:0x3d000 00:22:33.240 [2024-04-27 02:42:01.232409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:93496 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f6000 len:0x1000 key:0x3d000 00:22:33.240 [2024-04-27 02:42:01.232430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:93504 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f4000 len:0x1000 key:0x3d000 00:22:33.240 [2024-04-27 02:42:01.232453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:93512 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f2000 len:0x1000 key:0x3d000 00:22:33.240 [2024-04-27 02:42:01.232475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:93520 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f0000 len:0x1000 key:0x3d000 00:22:33.240 [2024-04-27 02:42:01.232496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:93528 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007570000 len:0x1000 key:0x3d000 00:22:33.240 [2024-04-27 02:42:01.232519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:93536 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007572000 len:0x1000 key:0x3d000 00:22:33.240 [2024-04-27 02:42:01.232540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:93544 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007574000 len:0x1000 key:0x3d000 00:22:33.240 [2024-04-27 02:42:01.232562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:93552 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007576000 len:0x1000 key:0x3d000 00:22:33.240 [2024-04-27 02:42:01.232583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:93560 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c8000 len:0x1000 key:0x3d000 00:22:33.240 [2024-04-27 02:42:01.232605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:93568 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ca000 len:0x1000 key:0x3d000 00:22:33.240 [2024-04-27 02:42:01.232627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:93576 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075cc000 len:0x1000 key:0x3d000 00:22:33.240 [2024-04-27 02:42:01.232649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:93584 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ce000 len:0x1000 key:0x3d000 00:22:33.240 [2024-04-27 02:42:01.232670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:93592 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b0000 len:0x1000 key:0x3d000 00:22:33.240 [2024-04-27 02:42:01.232694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:93600 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007562000 len:0x1000 key:0x3d000 00:22:33.240 [2024-04-27 02:42:01.232716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:93608 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007564000 len:0x1000 key:0x3d000 00:22:33.240 [2024-04-27 02:42:01.232738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:93616 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007566000 len:0x1000 key:0x3d000 00:22:33.240 [2024-04-27 02:42:01.232760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:93624 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007588000 len:0x1000 key:0x3d000 00:22:33.240 [2024-04-27 02:42:01.232781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:93632 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758a000 len:0x1000 key:0x3d000 00:22:33.240 [2024-04-27 02:42:01.232803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:93640 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758c000 len:0x1000 key:0x3d000 00:22:33.240 [2024-04-27 02:42:01.232825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:93648 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758e000 len:0x1000 key:0x3d000 00:22:33.240 [2024-04-27 02:42:01.232847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:93656 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007598000 len:0x1000 key:0x3d000 00:22:33.240 [2024-04-27 02:42:01.232869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:94232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.240 [2024-04-27 02:42:01.232891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:94240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.240 [2024-04-27 02:42:01.232912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:94248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.240 [2024-04-27 02:42:01.232933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:94256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.240 [2024-04-27 02:42:01.232956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:94264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.240 [2024-04-27 02:42:01.232978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.232989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:94272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.240 [2024-04-27 02:42:01.233000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.233011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:94280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.240 [2024-04-27 02:42:01.233021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.233032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:94288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.240 [2024-04-27 02:42:01.233042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.233054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:93664 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759a000 len:0x1000 key:0x3d000 00:22:33.240 [2024-04-27 02:42:01.233064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.233075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:93672 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759c000 len:0x1000 key:0x3d000 00:22:33.240 [2024-04-27 02:42:01.233085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.233096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:93680 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759e000 len:0x1000 key:0x3d000 00:22:33.240 [2024-04-27 02:42:01.233106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.233118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:93688 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075be000 len:0x1000 key:0x3d000 00:22:33.240 [2024-04-27 02:42:01.233128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.240 [2024-04-27 02:42:01.233139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:93696 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075bc000 len:0x1000 key:0x3d000 00:22:33.241 [2024-04-27 02:42:01.233149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.241 [2024-04-27 02:42:01.233160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:93704 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ba000 len:0x1000 key:0x3d000 00:22:33.241 [2024-04-27 02:42:01.233170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.241 [2024-04-27 02:42:01.233181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:93712 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b8000 len:0x1000 key:0x3d000 00:22:33.241 [2024-04-27 02:42:01.233191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.241 [2024-04-27 02:42:01.233205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:93720 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e0000 len:0x1000 key:0x3d000 00:22:33.241 [2024-04-27 02:42:01.233215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.241 [2024-04-27 02:42:01.233226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:93728 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e2000 len:0x1000 key:0x3d000 00:22:33.241 [2024-04-27 02:42:01.233236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.241 [2024-04-27 02:42:01.233248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:93736 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e4000 len:0x1000 key:0x3d000 00:22:33.241 [2024-04-27 02:42:01.233257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.241 [2024-04-27 02:42:01.233268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:93744 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e6000 len:0x1000 key:0x3d000 00:22:33.241 [2024-04-27 02:42:01.233279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.241 [2024-04-27 02:42:01.233290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:93752 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d8000 len:0x1000 key:0x3d000 00:22:33.241 [2024-04-27 02:42:01.233300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.241 [2024-04-27 02:42:01.233312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:93760 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075da000 len:0x1000 key:0x3d000 00:22:33.241 [2024-04-27 02:42:01.233322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.241 [2024-04-27 02:42:01.233333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:93768 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075dc000 len:0x1000 key:0x3d000 00:22:33.241 [2024-04-27 02:42:01.233348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.241 [2024-04-27 02:42:01.233359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:93776 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075de000 len:0x1000 key:0x3d000 00:22:33.241 [2024-04-27 02:42:01.233369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.241 [2024-04-27 02:42:01.233380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:93784 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007580000 len:0x1000 key:0x3d000 00:22:33.241 [2024-04-27 02:42:01.233391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.241 [2024-04-27 02:42:01.233402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:93792 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007582000 len:0x1000 key:0x3d000 00:22:33.241 [2024-04-27 02:42:01.233412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.241 [2024-04-27 02:42:01.233424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:93800 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007584000 len:0x1000 key:0x3d000 00:22:33.241 [2024-04-27 02:42:01.233434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.241 [2024-04-27 02:42:01.233445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:93808 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007586000 len:0x1000 key:0x3d000 00:22:33.241 [2024-04-27 02:42:01.233460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.241 [2024-04-27 02:42:01.233472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:93816 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c6000 len:0x1000 key:0x3d000 00:22:33.241 [2024-04-27 02:42:01.233482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.241 [2024-04-27 02:42:01.233494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:93824 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c4000 len:0x1000 key:0x3d000 00:22:33.241 [2024-04-27 02:42:01.233503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.241 [2024-04-27 02:42:01.233515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:93832 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c2000 len:0x1000 key:0x3d000 00:22:33.241 [2024-04-27 02:42:01.233525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.241 [2024-04-27 02:42:01.233536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:94296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.241 [2024-04-27 02:42:01.233549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.241 [2024-04-27 02:42:01.233561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:94304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.241 [2024-04-27 02:42:01.233570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.241 [2024-04-27 02:42:01.233582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:94312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.241 [2024-04-27 02:42:01.233592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.241 [2024-04-27 02:42:01.233604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:94320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.241 [2024-04-27 02:42:01.233614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.241 [2024-04-27 02:42:01.233626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:94328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.241 [2024-04-27 02:42:01.233636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.241 [2024-04-27 02:42:01.233647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:94336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.241 [2024-04-27 02:42:01.233657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.241 [2024-04-27 02:42:01.233668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:94344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.241 [2024-04-27 02:42:01.233678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.241 [2024-04-27 02:42:01.233690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:94352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.241 [2024-04-27 02:42:01.233700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.241 [2024-04-27 02:42:01.233711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:93840 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007560000 len:0x1000 key:0x3d000 00:22:33.241 [2024-04-27 02:42:01.233723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.241 [2024-04-27 02:42:01.233735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:93848 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756e000 len:0x1000 key:0x3d000 00:22:33.241 [2024-04-27 02:42:01.233745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.241 [2024-04-27 02:42:01.233757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:93856 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756c000 len:0x1000 key:0x3d000 00:22:33.241 [2024-04-27 02:42:01.233767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.241 [2024-04-27 02:42:01.233778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:93864 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756a000 len:0x1000 key:0x3d000 00:22:33.241 [2024-04-27 02:42:01.233788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.241 [2024-04-27 02:42:01.233799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:93872 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007568000 len:0x1000 key:0x3d000 00:22:33.241 [2024-04-27 02:42:01.233809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.241 [2024-04-27 02:42:01.233821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:93880 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a6000 len:0x1000 key:0x3d000 00:22:33.241 [2024-04-27 02:42:01.233831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.241 [2024-04-27 02:42:01.233842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:93888 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a4000 len:0x1000 key:0x3d000 00:22:33.241 [2024-04-27 02:42:01.233852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.241 [2024-04-27 02:42:01.233863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:93896 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a2000 len:0x1000 key:0x3d000 00:22:33.241 [2024-04-27 02:42:01.233872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.241 [2024-04-27 02:42:01.233884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:94360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.241 [2024-04-27 02:42:01.233895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.241 [2024-04-27 02:42:01.233907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:94368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:33.241 [2024-04-27 02:42:01.233917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:33.241 [2024-04-27 02:42:01.235689] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:22:33.241 [2024-04-27 02:42:01.235704] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:22:33.241 [2024-04-27 02:42:01.235713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:93904 len:8 PRP1 0x0 PRP2 0x0 00:22:33.241 [2024-04-27 02:42:01.235724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:33.241 [2024-04-27 02:42:01.235764] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192e4940 was disconnected and freed. reset controller. 00:22:33.241 [2024-04-27 02:42:01.235776] bdev_nvme.c:1857:bdev_nvme_failover_trid: *NOTICE*: Start failover from 192.168.100.8:4422 to 192.168.100.8:4420 00:22:33.241 [2024-04-27 02:42:01.235790] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:33.241 [2024-04-27 02:42:01.238584] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:33.241 [2024-04-27 02:42:01.252704] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:22:33.241 [2024-04-27 02:42:01.300215] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:22:33.241 00:22:33.241 Latency(us) 00:22:33.241 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:33.241 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:22:33.241 Verification LBA range: start 0x0 length 0x4000 00:22:33.241 NVMe0n1 : 15.01 14346.13 56.04 311.69 0.00 8711.63 352.61 1021221.84 00:22:33.241 =================================================================================================================== 00:22:33.241 Total : 14346.13 56.04 311.69 0.00 8711.63 352.61 1021221.84 00:22:33.241 Received shutdown signal, test time was about 15.000000 seconds 00:22:33.241 00:22:33.241 Latency(us) 00:22:33.241 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:33.241 =================================================================================================================== 00:22:33.241 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:22:33.241 02:42:06 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:22:33.241 02:42:06 -- host/failover.sh@65 -- # count=3 00:22:33.241 02:42:06 -- host/failover.sh@67 -- # (( count != 3 )) 00:22:33.241 02:42:06 -- host/failover.sh@73 -- # bdevperf_pid=1628195 00:22:33.241 02:42:06 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:22:33.241 02:42:06 -- host/failover.sh@75 -- # waitforlisten 1628195 /var/tmp/bdevperf.sock 00:22:33.241 02:42:06 -- common/autotest_common.sh@817 -- # '[' -z 1628195 ']' 00:22:33.241 02:42:06 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:33.241 02:42:06 -- common/autotest_common.sh@822 -- # local max_retries=100 00:22:33.241 02:42:06 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:33.241 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:33.241 02:42:06 -- common/autotest_common.sh@826 -- # xtrace_disable 00:22:33.241 02:42:06 -- common/autotest_common.sh@10 -- # set +x 00:22:34.176 02:42:07 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:22:34.176 02:42:07 -- common/autotest_common.sh@850 -- # return 0 00:22:34.176 02:42:07 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4421 00:22:34.176 [2024-04-27 02:42:07.675138] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4421 *** 00:22:34.176 02:42:07 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4422 00:22:34.434 [2024-04-27 02:42:07.847753] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4422 *** 00:22:34.434 02:42:07 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:22:34.693 NVMe0n1 00:22:34.693 02:42:08 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:22:34.951 00:22:34.951 02:42:08 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:22:35.210 00:22:35.210 02:42:08 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:22:35.210 02:42:08 -- host/failover.sh@82 -- # grep -q NVMe0 00:22:35.210 02:42:08 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:22:35.468 02:42:08 -- host/failover.sh@87 -- # sleep 3 00:22:38.752 02:42:11 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:22:38.752 02:42:11 -- host/failover.sh@88 -- # grep -q NVMe0 00:22:38.752 02:42:12 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:22:38.752 02:42:12 -- host/failover.sh@90 -- # run_test_pid=1628927 00:22:38.752 02:42:12 -- host/failover.sh@92 -- # wait 1628927 00:22:39.686 0 00:22:39.686 02:42:13 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/try.txt 00:22:39.686 [2024-04-27 02:42:06.694717] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:22:39.686 [2024-04-27 02:42:06.694782] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1628195 ] 00:22:39.686 EAL: No free 2048 kB hugepages reported on node 1 00:22:39.686 [2024-04-27 02:42:06.767615] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:39.686 [2024-04-27 02:42:06.845601] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:39.686 [2024-04-27 02:42:08.940383] bdev_nvme.c:1857:bdev_nvme_failover_trid: *NOTICE*: Start failover from 192.168.100.8:4420 to 192.168.100.8:4421 00:22:39.686 [2024-04-27 02:42:08.940980] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:39.687 [2024-04-27 02:42:08.941013] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:39.687 [2024-04-27 02:42:08.960522] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:22:39.687 [2024-04-27 02:42:08.976721] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:22:39.687 Running I/O for 1 seconds... 00:22:39.687 00:22:39.687 Latency(us) 00:22:39.687 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:39.687 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:22:39.687 Verification LBA range: start 0x0 length 0x4000 00:22:39.687 NVMe0n1 : 1.00 18139.44 70.86 0.00 0.00 7012.78 918.93 14702.86 00:22:39.687 =================================================================================================================== 00:22:39.687 Total : 18139.44 70.86 0.00 0.00 7012.78 918.93 14702.86 00:22:39.687 02:42:13 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:22:39.687 02:42:13 -- host/failover.sh@95 -- # grep -q NVMe0 00:22:39.944 02:42:13 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t rdma -a 192.168.100.8 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:22:40.202 02:42:13 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:22:40.202 02:42:13 -- host/failover.sh@99 -- # grep -q NVMe0 00:22:40.460 02:42:13 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t rdma -a 192.168.100.8 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:22:40.460 02:42:14 -- host/failover.sh@101 -- # sleep 3 00:22:43.740 02:42:17 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:22:43.740 02:42:17 -- host/failover.sh@103 -- # grep -q NVMe0 00:22:43.740 02:42:17 -- host/failover.sh@108 -- # killprocess 1628195 00:22:43.740 02:42:17 -- common/autotest_common.sh@936 -- # '[' -z 1628195 ']' 00:22:43.740 02:42:17 -- common/autotest_common.sh@940 -- # kill -0 1628195 00:22:43.740 02:42:17 -- common/autotest_common.sh@941 -- # uname 00:22:43.740 02:42:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:43.740 02:42:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1628195 00:22:43.740 02:42:17 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:43.740 02:42:17 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:43.740 02:42:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1628195' 00:22:43.740 killing process with pid 1628195 00:22:43.740 02:42:17 -- common/autotest_common.sh@955 -- # kill 1628195 00:22:43.740 02:42:17 -- common/autotest_common.sh@960 -- # wait 1628195 00:22:43.997 02:42:17 -- host/failover.sh@110 -- # sync 00:22:43.997 02:42:17 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:44.255 02:42:17 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:22:44.255 02:42:17 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/try.txt 00:22:44.255 02:42:17 -- host/failover.sh@116 -- # nvmftestfini 00:22:44.255 02:42:17 -- nvmf/common.sh@477 -- # nvmfcleanup 00:22:44.255 02:42:17 -- nvmf/common.sh@117 -- # sync 00:22:44.255 02:42:17 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:22:44.255 02:42:17 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:22:44.255 02:42:17 -- nvmf/common.sh@120 -- # set +e 00:22:44.255 02:42:17 -- nvmf/common.sh@121 -- # for i in {1..20} 00:22:44.255 02:42:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:22:44.255 rmmod nvme_rdma 00:22:44.255 rmmod nvme_fabrics 00:22:44.255 02:42:17 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:22:44.255 02:42:17 -- nvmf/common.sh@124 -- # set -e 00:22:44.255 02:42:17 -- nvmf/common.sh@125 -- # return 0 00:22:44.255 02:42:17 -- nvmf/common.sh@478 -- # '[' -n 1625126 ']' 00:22:44.255 02:42:17 -- nvmf/common.sh@479 -- # killprocess 1625126 00:22:44.255 02:42:17 -- common/autotest_common.sh@936 -- # '[' -z 1625126 ']' 00:22:44.255 02:42:17 -- common/autotest_common.sh@940 -- # kill -0 1625126 00:22:44.255 02:42:17 -- common/autotest_common.sh@941 -- # uname 00:22:44.255 02:42:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:44.255 02:42:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1625126 00:22:44.255 02:42:17 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:44.255 02:42:17 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:44.255 02:42:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1625126' 00:22:44.255 killing process with pid 1625126 00:22:44.255 02:42:17 -- common/autotest_common.sh@955 -- # kill 1625126 00:22:44.255 02:42:17 -- common/autotest_common.sh@960 -- # wait 1625126 00:22:44.513 [2024-04-27 02:42:17.881439] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:22:44.772 02:42:18 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:22:44.772 02:42:18 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:22:44.772 00:22:44.772 real 0m37.071s 00:22:44.772 user 2m4.111s 00:22:44.772 sys 0m7.400s 00:22:44.772 02:42:18 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:22:44.772 02:42:18 -- common/autotest_common.sh@10 -- # set +x 00:22:44.772 ************************************ 00:22:44.772 END TEST nvmf_failover 00:22:44.772 ************************************ 00:22:44.772 02:42:18 -- nvmf/nvmf.sh@99 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=rdma 00:22:44.772 02:42:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:44.772 02:42:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:44.772 02:42:18 -- common/autotest_common.sh@10 -- # set +x 00:22:44.772 ************************************ 00:22:44.772 START TEST nvmf_discovery 00:22:44.772 ************************************ 00:22:44.772 02:42:18 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=rdma 00:22:45.031 * Looking for test storage... 00:22:45.031 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:22:45.031 02:42:18 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:22:45.031 02:42:18 -- nvmf/common.sh@7 -- # uname -s 00:22:45.031 02:42:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:45.031 02:42:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:45.031 02:42:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:45.031 02:42:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:45.031 02:42:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:45.031 02:42:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:45.031 02:42:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:45.031 02:42:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:45.031 02:42:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:45.031 02:42:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:45.031 02:42:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:22:45.031 02:42:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:22:45.031 02:42:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:45.031 02:42:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:45.031 02:42:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:45.031 02:42:18 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:22:45.031 02:42:18 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:22:45.031 02:42:18 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:45.031 02:42:18 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:45.031 02:42:18 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:45.031 02:42:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:45.031 02:42:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:45.031 02:42:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:45.031 02:42:18 -- paths/export.sh@5 -- # export PATH 00:22:45.031 02:42:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:45.031 02:42:18 -- nvmf/common.sh@47 -- # : 0 00:22:45.031 02:42:18 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:22:45.031 02:42:18 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:22:45.031 02:42:18 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:22:45.031 02:42:18 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:45.031 02:42:18 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:45.031 02:42:18 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:22:45.031 02:42:18 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:22:45.031 02:42:18 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:22:45.031 02:42:18 -- host/discovery.sh@11 -- # '[' rdma == rdma ']' 00:22:45.031 02:42:18 -- host/discovery.sh@12 -- # echo 'Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target.' 00:22:45.031 Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target. 00:22:45.031 02:42:18 -- host/discovery.sh@13 -- # exit 0 00:22:45.031 00:22:45.032 real 0m0.150s 00:22:45.032 user 0m0.069s 00:22:45.032 sys 0m0.092s 00:22:45.032 02:42:18 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:22:45.032 02:42:18 -- common/autotest_common.sh@10 -- # set +x 00:22:45.032 ************************************ 00:22:45.032 END TEST nvmf_discovery 00:22:45.032 ************************************ 00:22:45.032 02:42:18 -- nvmf/nvmf.sh@100 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=rdma 00:22:45.032 02:42:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:45.032 02:42:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:45.032 02:42:18 -- common/autotest_common.sh@10 -- # set +x 00:22:45.291 ************************************ 00:22:45.291 START TEST nvmf_discovery_remove_ifc 00:22:45.291 ************************************ 00:22:45.291 02:42:18 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=rdma 00:22:45.291 * Looking for test storage... 00:22:45.291 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:22:45.291 02:42:18 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:22:45.291 02:42:18 -- nvmf/common.sh@7 -- # uname -s 00:22:45.291 02:42:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:45.291 02:42:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:45.291 02:42:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:45.291 02:42:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:45.291 02:42:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:45.291 02:42:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:45.291 02:42:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:45.291 02:42:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:45.291 02:42:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:45.291 02:42:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:45.291 02:42:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:22:45.291 02:42:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:22:45.291 02:42:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:45.291 02:42:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:45.291 02:42:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:45.291 02:42:18 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:22:45.291 02:42:18 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:22:45.291 02:42:18 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:45.291 02:42:18 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:45.291 02:42:18 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:45.291 02:42:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:45.291 02:42:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:45.291 02:42:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:45.291 02:42:18 -- paths/export.sh@5 -- # export PATH 00:22:45.291 02:42:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:45.291 02:42:18 -- nvmf/common.sh@47 -- # : 0 00:22:45.291 02:42:18 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:22:45.291 02:42:18 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:22:45.291 02:42:18 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:22:45.291 02:42:18 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:45.291 02:42:18 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:45.291 02:42:18 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:22:45.291 02:42:18 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:22:45.291 02:42:18 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:22:45.291 02:42:18 -- host/discovery_remove_ifc.sh@14 -- # '[' rdma == rdma ']' 00:22:45.291 02:42:18 -- host/discovery_remove_ifc.sh@15 -- # echo 'Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target.' 00:22:45.291 Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target. 00:22:45.291 02:42:18 -- host/discovery_remove_ifc.sh@16 -- # exit 0 00:22:45.291 00:22:45.291 real 0m0.130s 00:22:45.291 user 0m0.047s 00:22:45.291 sys 0m0.094s 00:22:45.291 02:42:18 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:22:45.291 02:42:18 -- common/autotest_common.sh@10 -- # set +x 00:22:45.291 ************************************ 00:22:45.291 END TEST nvmf_discovery_remove_ifc 00:22:45.291 ************************************ 00:22:45.291 02:42:18 -- nvmf/nvmf.sh@101 -- # run_test nvmf_identify_kernel_target /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/identify_kernel_nvmf.sh --transport=rdma 00:22:45.291 02:42:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:45.291 02:42:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:45.291 02:42:18 -- common/autotest_common.sh@10 -- # set +x 00:22:45.550 ************************************ 00:22:45.550 START TEST nvmf_identify_kernel_target 00:22:45.550 ************************************ 00:22:45.550 02:42:19 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/identify_kernel_nvmf.sh --transport=rdma 00:22:45.550 * Looking for test storage... 00:22:45.550 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:22:45.550 02:42:19 -- host/identify_kernel_nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:22:45.550 02:42:19 -- nvmf/common.sh@7 -- # uname -s 00:22:45.550 02:42:19 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:45.550 02:42:19 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:45.550 02:42:19 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:45.550 02:42:19 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:45.550 02:42:19 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:45.550 02:42:19 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:45.550 02:42:19 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:45.550 02:42:19 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:45.550 02:42:19 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:45.550 02:42:19 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:45.550 02:42:19 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:22:45.550 02:42:19 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:22:45.550 02:42:19 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:45.550 02:42:19 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:45.550 02:42:19 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:45.550 02:42:19 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:22:45.550 02:42:19 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:22:45.550 02:42:19 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:45.550 02:42:19 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:45.550 02:42:19 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:45.550 02:42:19 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:45.550 02:42:19 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:45.550 02:42:19 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:45.550 02:42:19 -- paths/export.sh@5 -- # export PATH 00:22:45.550 02:42:19 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:45.550 02:42:19 -- nvmf/common.sh@47 -- # : 0 00:22:45.550 02:42:19 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:22:45.808 02:42:19 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:22:45.808 02:42:19 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:22:45.808 02:42:19 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:45.808 02:42:19 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:45.808 02:42:19 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:22:45.808 02:42:19 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:22:45.808 02:42:19 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:22:45.808 02:42:19 -- host/identify_kernel_nvmf.sh@11 -- # nvmftestinit 00:22:45.808 02:42:19 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:22:45.808 02:42:19 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:45.808 02:42:19 -- nvmf/common.sh@437 -- # prepare_net_devs 00:22:45.808 02:42:19 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:22:45.808 02:42:19 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:22:45.808 02:42:19 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:45.808 02:42:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:45.808 02:42:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:45.809 02:42:19 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:22:45.809 02:42:19 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:22:45.809 02:42:19 -- nvmf/common.sh@285 -- # xtrace_disable 00:22:45.809 02:42:19 -- common/autotest_common.sh@10 -- # set +x 00:22:52.373 02:42:25 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:52.373 02:42:25 -- nvmf/common.sh@291 -- # pci_devs=() 00:22:52.373 02:42:25 -- nvmf/common.sh@291 -- # local -a pci_devs 00:22:52.373 02:42:25 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:22:52.373 02:42:25 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:22:52.373 02:42:25 -- nvmf/common.sh@293 -- # pci_drivers=() 00:22:52.373 02:42:25 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:22:52.373 02:42:25 -- nvmf/common.sh@295 -- # net_devs=() 00:22:52.373 02:42:25 -- nvmf/common.sh@295 -- # local -ga net_devs 00:22:52.373 02:42:25 -- nvmf/common.sh@296 -- # e810=() 00:22:52.373 02:42:25 -- nvmf/common.sh@296 -- # local -ga e810 00:22:52.373 02:42:25 -- nvmf/common.sh@297 -- # x722=() 00:22:52.373 02:42:25 -- nvmf/common.sh@297 -- # local -ga x722 00:22:52.373 02:42:25 -- nvmf/common.sh@298 -- # mlx=() 00:22:52.373 02:42:25 -- nvmf/common.sh@298 -- # local -ga mlx 00:22:52.373 02:42:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:52.373 02:42:25 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:52.373 02:42:25 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:52.373 02:42:25 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:52.373 02:42:25 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:52.373 02:42:25 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:52.373 02:42:25 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:52.373 02:42:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:52.373 02:42:25 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:52.373 02:42:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:52.373 02:42:25 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:52.373 02:42:25 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:22:52.373 02:42:25 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:22:52.373 02:42:25 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:22:52.373 02:42:25 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:22:52.373 02:42:25 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:22:52.373 02:42:25 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:22:52.373 02:42:25 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:22:52.373 02:42:25 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:22:52.373 02:42:25 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:22:52.373 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:22:52.373 02:42:25 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:22:52.374 02:42:25 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:22:52.374 02:42:25 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:22:52.374 02:42:25 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:22:52.374 02:42:25 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:22:52.374 02:42:25 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:22:52.374 02:42:25 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:22:52.374 02:42:25 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:22:52.374 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:22:52.374 02:42:25 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:22:52.374 02:42:25 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:22:52.374 02:42:25 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:22:52.374 02:42:25 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:22:52.374 02:42:25 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:22:52.374 02:42:25 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:22:52.374 02:42:25 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:22:52.374 02:42:25 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:22:52.374 02:42:25 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:22:52.374 02:42:25 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:52.374 02:42:25 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:22:52.374 02:42:25 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:52.374 02:42:25 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:22:52.374 Found net devices under 0000:18:00.0: mlx_0_0 00:22:52.374 02:42:25 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:22:52.374 02:42:25 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:22:52.374 02:42:25 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:52.374 02:42:25 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:22:52.374 02:42:25 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:52.374 02:42:25 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:22:52.374 Found net devices under 0000:18:00.1: mlx_0_1 00:22:52.374 02:42:25 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:22:52.374 02:42:25 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:22:52.374 02:42:25 -- nvmf/common.sh@403 -- # is_hw=yes 00:22:52.374 02:42:25 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:22:52.374 02:42:25 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:22:52.374 02:42:25 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:22:52.374 02:42:25 -- nvmf/common.sh@409 -- # rdma_device_init 00:22:52.374 02:42:25 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:22:52.374 02:42:25 -- nvmf/common.sh@58 -- # uname 00:22:52.374 02:42:25 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:22:52.374 02:42:25 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:22:52.374 02:42:25 -- nvmf/common.sh@63 -- # modprobe ib_core 00:22:52.374 02:42:25 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:22:52.374 02:42:25 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:22:52.374 02:42:25 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:22:52.374 02:42:25 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:22:52.374 02:42:25 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:22:52.374 02:42:25 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:22:52.374 02:42:25 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:22:52.374 02:42:25 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:22:52.374 02:42:25 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:22:52.374 02:42:25 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:22:52.374 02:42:25 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:22:52.374 02:42:25 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:22:52.374 02:42:25 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:22:52.374 02:42:25 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:52.374 02:42:25 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:52.374 02:42:25 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:22:52.374 02:42:25 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:22:52.374 02:42:25 -- nvmf/common.sh@105 -- # continue 2 00:22:52.374 02:42:25 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:52.374 02:42:25 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:52.374 02:42:25 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:22:52.374 02:42:25 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:52.374 02:42:25 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:22:52.374 02:42:25 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:22:52.374 02:42:25 -- nvmf/common.sh@105 -- # continue 2 00:22:52.374 02:42:25 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:22:52.374 02:42:25 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:22:52.374 02:42:25 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:22:52.374 02:42:25 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:22:52.374 02:42:25 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:52.374 02:42:25 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:52.374 02:42:25 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:22:52.374 02:42:25 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:22:52.374 02:42:25 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:22:52.374 64: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:22:52.374 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:22:52.374 altname enp24s0f0np0 00:22:52.374 altname ens785f0np0 00:22:52.374 inet 192.168.100.8/24 scope global mlx_0_0 00:22:52.374 valid_lft forever preferred_lft forever 00:22:52.374 02:42:25 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:22:52.374 02:42:25 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:22:52.374 02:42:25 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:22:52.374 02:42:25 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:22:52.374 02:42:25 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:52.374 02:42:25 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:52.374 02:42:25 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:22:52.374 02:42:25 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:22:52.374 02:42:25 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:22:52.374 65: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:22:52.374 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:22:52.374 altname enp24s0f1np1 00:22:52.374 altname ens785f1np1 00:22:52.374 inet 192.168.100.9/24 scope global mlx_0_1 00:22:52.374 valid_lft forever preferred_lft forever 00:22:52.374 02:42:25 -- nvmf/common.sh@411 -- # return 0 00:22:52.374 02:42:25 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:22:52.374 02:42:25 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:22:52.374 02:42:25 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:22:52.374 02:42:25 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:22:52.374 02:42:25 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:22:52.374 02:42:25 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:22:52.374 02:42:25 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:22:52.374 02:42:25 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:22:52.374 02:42:25 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:22:52.374 02:42:25 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:22:52.374 02:42:25 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:52.374 02:42:25 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:52.374 02:42:25 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:22:52.374 02:42:25 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:22:52.374 02:42:25 -- nvmf/common.sh@105 -- # continue 2 00:22:52.374 02:42:25 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:52.374 02:42:25 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:52.374 02:42:25 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:22:52.375 02:42:25 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:52.375 02:42:25 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:22:52.375 02:42:25 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:22:52.375 02:42:25 -- nvmf/common.sh@105 -- # continue 2 00:22:52.375 02:42:25 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:22:52.375 02:42:25 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:22:52.375 02:42:25 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:22:52.375 02:42:25 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:22:52.375 02:42:25 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:52.375 02:42:25 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:52.375 02:42:25 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:22:52.375 02:42:25 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:22:52.375 02:42:25 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:22:52.375 02:42:25 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:22:52.375 02:42:25 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:52.375 02:42:25 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:52.375 02:42:25 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:22:52.375 192.168.100.9' 00:22:52.375 02:42:25 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:22:52.375 192.168.100.9' 00:22:52.375 02:42:25 -- nvmf/common.sh@446 -- # head -n 1 00:22:52.375 02:42:25 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:22:52.375 02:42:25 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:22:52.375 192.168.100.9' 00:22:52.375 02:42:25 -- nvmf/common.sh@447 -- # tail -n +2 00:22:52.375 02:42:25 -- nvmf/common.sh@447 -- # head -n 1 00:22:52.375 02:42:25 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:22:52.375 02:42:25 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:22:52.375 02:42:25 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:22:52.375 02:42:25 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:22:52.375 02:42:25 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:22:52.375 02:42:25 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:22:52.375 02:42:25 -- host/identify_kernel_nvmf.sh@13 -- # trap 'nvmftestfini || :; clean_kernel_target' EXIT 00:22:52.375 02:42:25 -- host/identify_kernel_nvmf.sh@15 -- # get_main_ns_ip 00:22:52.375 02:42:25 -- nvmf/common.sh@717 -- # local ip 00:22:52.375 02:42:25 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:52.375 02:42:25 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:52.375 02:42:25 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:52.375 02:42:25 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:52.375 02:42:25 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:52.375 02:42:25 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:52.375 02:42:25 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:52.375 02:42:25 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:52.375 02:42:25 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:52.375 02:42:25 -- host/identify_kernel_nvmf.sh@15 -- # target_ip=192.168.100.8 00:22:52.375 02:42:25 -- host/identify_kernel_nvmf.sh@16 -- # configure_kernel_target nqn.2016-06.io.spdk:testnqn 192.168.100.8 00:22:52.375 02:42:25 -- nvmf/common.sh@621 -- # local kernel_name=nqn.2016-06.io.spdk:testnqn kernel_target_ip=192.168.100.8 00:22:52.375 02:42:25 -- nvmf/common.sh@623 -- # nvmet=/sys/kernel/config/nvmet 00:22:52.375 02:42:25 -- nvmf/common.sh@624 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn 00:22:52.375 02:42:25 -- nvmf/common.sh@625 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn/namespaces/1 00:22:52.375 02:42:25 -- nvmf/common.sh@626 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:22:52.375 02:42:25 -- nvmf/common.sh@628 -- # local block nvme 00:22:52.375 02:42:25 -- nvmf/common.sh@630 -- # [[ ! -e /sys/module/nvmet ]] 00:22:52.375 02:42:25 -- nvmf/common.sh@631 -- # modprobe nvmet 00:22:52.375 02:42:25 -- nvmf/common.sh@634 -- # [[ -e /sys/kernel/config/nvmet ]] 00:22:52.375 02:42:25 -- nvmf/common.sh@636 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:22:55.655 Waiting for block devices as requested 00:22:55.655 0000:5f:00.0 (8086 0a54): vfio-pci -> nvme 00:22:55.655 0000:00:04.7 (8086 2021): vfio-pci -> ioatdma 00:22:55.913 0000:00:04.6 (8086 2021): vfio-pci -> ioatdma 00:22:55.913 0000:00:04.5 (8086 2021): vfio-pci -> ioatdma 00:22:55.913 0000:00:04.4 (8086 2021): vfio-pci -> ioatdma 00:22:56.171 0000:00:04.3 (8086 2021): vfio-pci -> ioatdma 00:22:56.171 0000:00:04.2 (8086 2021): vfio-pci -> ioatdma 00:22:56.171 0000:00:04.1 (8086 2021): vfio-pci -> ioatdma 00:22:56.171 0000:00:04.0 (8086 2021): vfio-pci -> ioatdma 00:22:56.446 0000:80:04.7 (8086 2021): vfio-pci -> ioatdma 00:22:56.446 0000:80:04.6 (8086 2021): vfio-pci -> ioatdma 00:22:56.446 0000:80:04.5 (8086 2021): vfio-pci -> ioatdma 00:22:56.711 0000:80:04.4 (8086 2021): vfio-pci -> ioatdma 00:22:56.711 0000:80:04.3 (8086 2021): vfio-pci -> ioatdma 00:22:56.711 0000:80:04.2 (8086 2021): vfio-pci -> ioatdma 00:22:56.969 0000:80:04.1 (8086 2021): vfio-pci -> ioatdma 00:22:56.969 0000:80:04.0 (8086 2021): vfio-pci -> ioatdma 00:22:56.969 02:42:30 -- nvmf/common.sh@639 -- # for block in /sys/block/nvme* 00:22:56.969 02:42:30 -- nvmf/common.sh@640 -- # [[ -e /sys/block/nvme0n1 ]] 00:22:56.969 02:42:30 -- nvmf/common.sh@641 -- # is_block_zoned nvme0n1 00:22:56.969 02:42:30 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:22:56.969 02:42:30 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:22:56.969 02:42:30 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:22:56.969 02:42:30 -- nvmf/common.sh@642 -- # block_in_use nvme0n1 00:22:56.969 02:42:30 -- scripts/common.sh@378 -- # local block=nvme0n1 pt 00:22:56.969 02:42:30 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:22:57.228 No valid GPT data, bailing 00:22:57.228 02:42:30 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:22:57.228 02:42:30 -- scripts/common.sh@391 -- # pt= 00:22:57.228 02:42:30 -- scripts/common.sh@392 -- # return 1 00:22:57.228 02:42:30 -- nvmf/common.sh@642 -- # nvme=/dev/nvme0n1 00:22:57.228 02:42:30 -- nvmf/common.sh@645 -- # [[ -b /dev/nvme0n1 ]] 00:22:57.228 02:42:30 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn 00:22:57.228 02:42:30 -- nvmf/common.sh@648 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn/namespaces/1 00:22:57.228 02:42:30 -- nvmf/common.sh@649 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:22:57.228 02:42:30 -- nvmf/common.sh@654 -- # echo SPDK-nqn.2016-06.io.spdk:testnqn 00:22:57.228 02:42:30 -- nvmf/common.sh@656 -- # echo 1 00:22:57.228 02:42:30 -- nvmf/common.sh@657 -- # echo /dev/nvme0n1 00:22:57.228 02:42:30 -- nvmf/common.sh@658 -- # echo 1 00:22:57.228 02:42:30 -- nvmf/common.sh@660 -- # echo 192.168.100.8 00:22:57.228 02:42:30 -- nvmf/common.sh@661 -- # echo rdma 00:22:57.228 02:42:30 -- nvmf/common.sh@662 -- # echo 4420 00:22:57.228 02:42:30 -- nvmf/common.sh@663 -- # echo ipv4 00:22:57.228 02:42:30 -- nvmf/common.sh@666 -- # ln -s /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn /sys/kernel/config/nvmet/ports/1/subsystems/ 00:22:57.228 02:42:30 -- nvmf/common.sh@669 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -a 192.168.100.8 -t rdma -s 4420 00:22:57.228 00:22:57.228 Discovery Log Number of Records 2, Generation counter 2 00:22:57.228 =====Discovery Log Entry 0====== 00:22:57.228 trtype: rdma 00:22:57.228 adrfam: ipv4 00:22:57.228 subtype: current discovery subsystem 00:22:57.228 treq: not specified, sq flow control disable supported 00:22:57.228 portid: 1 00:22:57.228 trsvcid: 4420 00:22:57.228 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:22:57.228 traddr: 192.168.100.8 00:22:57.228 eflags: none 00:22:57.228 rdma_prtype: not specified 00:22:57.228 rdma_qptype: connected 00:22:57.228 rdma_cms: rdma-cm 00:22:57.228 rdma_pkey: 0x0000 00:22:57.228 =====Discovery Log Entry 1====== 00:22:57.228 trtype: rdma 00:22:57.228 adrfam: ipv4 00:22:57.229 subtype: nvme subsystem 00:22:57.229 treq: not specified, sq flow control disable supported 00:22:57.229 portid: 1 00:22:57.229 trsvcid: 4420 00:22:57.229 subnqn: nqn.2016-06.io.spdk:testnqn 00:22:57.229 traddr: 192.168.100.8 00:22:57.229 eflags: none 00:22:57.229 rdma_prtype: not specified 00:22:57.229 rdma_qptype: connected 00:22:57.229 rdma_cms: rdma-cm 00:22:57.229 rdma_pkey: 0x0000 00:22:57.229 02:42:30 -- host/identify_kernel_nvmf.sh@18 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 00:22:57.229 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' 00:22:57.489 EAL: No free 2048 kB hugepages reported on node 1 00:22:57.489 ===================================================== 00:22:57.489 NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2014-08.org.nvmexpress.discovery 00:22:57.489 ===================================================== 00:22:57.489 Controller Capabilities/Features 00:22:57.489 ================================ 00:22:57.489 Vendor ID: 0000 00:22:57.489 Subsystem Vendor ID: 0000 00:22:57.489 Serial Number: 902a0c92b9aa96f78a7f 00:22:57.489 Model Number: Linux 00:22:57.489 Firmware Version: 6.7.0-68 00:22:57.489 Recommended Arb Burst: 0 00:22:57.489 IEEE OUI Identifier: 00 00 00 00:22:57.489 Multi-path I/O 00:22:57.489 May have multiple subsystem ports: No 00:22:57.489 May have multiple controllers: No 00:22:57.489 Associated with SR-IOV VF: No 00:22:57.489 Max Data Transfer Size: Unlimited 00:22:57.489 Max Number of Namespaces: 0 00:22:57.489 Max Number of I/O Queues: 1024 00:22:57.489 NVMe Specification Version (VS): 1.3 00:22:57.489 NVMe Specification Version (Identify): 1.3 00:22:57.489 Maximum Queue Entries: 128 00:22:57.489 Contiguous Queues Required: No 00:22:57.489 Arbitration Mechanisms Supported 00:22:57.489 Weighted Round Robin: Not Supported 00:22:57.489 Vendor Specific: Not Supported 00:22:57.489 Reset Timeout: 7500 ms 00:22:57.489 Doorbell Stride: 4 bytes 00:22:57.489 NVM Subsystem Reset: Not Supported 00:22:57.489 Command Sets Supported 00:22:57.489 NVM Command Set: Supported 00:22:57.489 Boot Partition: Not Supported 00:22:57.489 Memory Page Size Minimum: 4096 bytes 00:22:57.489 Memory Page Size Maximum: 4096 bytes 00:22:57.489 Persistent Memory Region: Not Supported 00:22:57.489 Optional Asynchronous Events Supported 00:22:57.489 Namespace Attribute Notices: Not Supported 00:22:57.489 Firmware Activation Notices: Not Supported 00:22:57.489 ANA Change Notices: Not Supported 00:22:57.489 PLE Aggregate Log Change Notices: Not Supported 00:22:57.489 LBA Status Info Alert Notices: Not Supported 00:22:57.489 EGE Aggregate Log Change Notices: Not Supported 00:22:57.489 Normal NVM Subsystem Shutdown event: Not Supported 00:22:57.489 Zone Descriptor Change Notices: Not Supported 00:22:57.489 Discovery Log Change Notices: Supported 00:22:57.489 Controller Attributes 00:22:57.489 128-bit Host Identifier: Not Supported 00:22:57.489 Non-Operational Permissive Mode: Not Supported 00:22:57.489 NVM Sets: Not Supported 00:22:57.489 Read Recovery Levels: Not Supported 00:22:57.489 Endurance Groups: Not Supported 00:22:57.489 Predictable Latency Mode: Not Supported 00:22:57.489 Traffic Based Keep ALive: Not Supported 00:22:57.489 Namespace Granularity: Not Supported 00:22:57.489 SQ Associations: Not Supported 00:22:57.489 UUID List: Not Supported 00:22:57.489 Multi-Domain Subsystem: Not Supported 00:22:57.489 Fixed Capacity Management: Not Supported 00:22:57.489 Variable Capacity Management: Not Supported 00:22:57.489 Delete Endurance Group: Not Supported 00:22:57.489 Delete NVM Set: Not Supported 00:22:57.489 Extended LBA Formats Supported: Not Supported 00:22:57.489 Flexible Data Placement Supported: Not Supported 00:22:57.489 00:22:57.489 Controller Memory Buffer Support 00:22:57.489 ================================ 00:22:57.489 Supported: No 00:22:57.489 00:22:57.489 Persistent Memory Region Support 00:22:57.489 ================================ 00:22:57.489 Supported: No 00:22:57.489 00:22:57.489 Admin Command Set Attributes 00:22:57.489 ============================ 00:22:57.489 Security Send/Receive: Not Supported 00:22:57.489 Format NVM: Not Supported 00:22:57.489 Firmware Activate/Download: Not Supported 00:22:57.489 Namespace Management: Not Supported 00:22:57.489 Device Self-Test: Not Supported 00:22:57.489 Directives: Not Supported 00:22:57.489 NVMe-MI: Not Supported 00:22:57.489 Virtualization Management: Not Supported 00:22:57.489 Doorbell Buffer Config: Not Supported 00:22:57.489 Get LBA Status Capability: Not Supported 00:22:57.489 Command & Feature Lockdown Capability: Not Supported 00:22:57.489 Abort Command Limit: 1 00:22:57.489 Async Event Request Limit: 1 00:22:57.489 Number of Firmware Slots: N/A 00:22:57.489 Firmware Slot 1 Read-Only: N/A 00:22:57.489 Firmware Activation Without Reset: N/A 00:22:57.489 Multiple Update Detection Support: N/A 00:22:57.489 Firmware Update Granularity: No Information Provided 00:22:57.489 Per-Namespace SMART Log: No 00:22:57.489 Asymmetric Namespace Access Log Page: Not Supported 00:22:57.489 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:22:57.489 Command Effects Log Page: Not Supported 00:22:57.489 Get Log Page Extended Data: Supported 00:22:57.489 Telemetry Log Pages: Not Supported 00:22:57.489 Persistent Event Log Pages: Not Supported 00:22:57.489 Supported Log Pages Log Page: May Support 00:22:57.489 Commands Supported & Effects Log Page: Not Supported 00:22:57.489 Feature Identifiers & Effects Log Page:May Support 00:22:57.489 NVMe-MI Commands & Effects Log Page: May Support 00:22:57.489 Data Area 4 for Telemetry Log: Not Supported 00:22:57.489 Error Log Page Entries Supported: 1 00:22:57.489 Keep Alive: Not Supported 00:22:57.489 00:22:57.489 NVM Command Set Attributes 00:22:57.489 ========================== 00:22:57.489 Submission Queue Entry Size 00:22:57.489 Max: 1 00:22:57.489 Min: 1 00:22:57.489 Completion Queue Entry Size 00:22:57.489 Max: 1 00:22:57.489 Min: 1 00:22:57.489 Number of Namespaces: 0 00:22:57.489 Compare Command: Not Supported 00:22:57.489 Write Uncorrectable Command: Not Supported 00:22:57.489 Dataset Management Command: Not Supported 00:22:57.489 Write Zeroes Command: Not Supported 00:22:57.489 Set Features Save Field: Not Supported 00:22:57.489 Reservations: Not Supported 00:22:57.489 Timestamp: Not Supported 00:22:57.489 Copy: Not Supported 00:22:57.489 Volatile Write Cache: Not Present 00:22:57.489 Atomic Write Unit (Normal): 1 00:22:57.489 Atomic Write Unit (PFail): 1 00:22:57.489 Atomic Compare & Write Unit: 1 00:22:57.489 Fused Compare & Write: Not Supported 00:22:57.489 Scatter-Gather List 00:22:57.489 SGL Command Set: Supported 00:22:57.489 SGL Keyed: Supported 00:22:57.489 SGL Bit Bucket Descriptor: Not Supported 00:22:57.489 SGL Metadata Pointer: Not Supported 00:22:57.489 Oversized SGL: Not Supported 00:22:57.489 SGL Metadata Address: Not Supported 00:22:57.489 SGL Offset: Supported 00:22:57.489 Transport SGL Data Block: Not Supported 00:22:57.489 Replay Protected Memory Block: Not Supported 00:22:57.489 00:22:57.489 Firmware Slot Information 00:22:57.489 ========================= 00:22:57.489 Active slot: 0 00:22:57.489 00:22:57.489 00:22:57.489 Error Log 00:22:57.489 ========= 00:22:57.490 00:22:57.490 Active Namespaces 00:22:57.490 ================= 00:22:57.490 Discovery Log Page 00:22:57.490 ================== 00:22:57.490 Generation Counter: 2 00:22:57.490 Number of Records: 2 00:22:57.490 Record Format: 0 00:22:57.490 00:22:57.490 Discovery Log Entry 0 00:22:57.490 ---------------------- 00:22:57.490 Transport Type: 1 (RDMA) 00:22:57.490 Address Family: 1 (IPv4) 00:22:57.490 Subsystem Type: 3 (Current Discovery Subsystem) 00:22:57.490 Entry Flags: 00:22:57.490 Duplicate Returned Information: 0 00:22:57.490 Explicit Persistent Connection Support for Discovery: 0 00:22:57.490 Transport Requirements: 00:22:57.490 Secure Channel: Not Specified 00:22:57.490 Port ID: 1 (0x0001) 00:22:57.490 Controller ID: 65535 (0xffff) 00:22:57.490 Admin Max SQ Size: 32 00:22:57.490 Transport Service Identifier: 4420 00:22:57.490 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:22:57.490 Transport Address: 192.168.100.8 00:22:57.490 Transport Specific Address Subtype - RDMA 00:22:57.490 RDMA QP Service Type: 1 (Reliable Connected) 00:22:57.490 RDMA Provider Type: 1 (No provider specified) 00:22:57.490 RDMA CM Service: 1 (RDMA_CM) 00:22:57.490 Discovery Log Entry 1 00:22:57.490 ---------------------- 00:22:57.490 Transport Type: 1 (RDMA) 00:22:57.490 Address Family: 1 (IPv4) 00:22:57.490 Subsystem Type: 2 (NVM Subsystem) 00:22:57.490 Entry Flags: 00:22:57.490 Duplicate Returned Information: 0 00:22:57.490 Explicit Persistent Connection Support for Discovery: 0 00:22:57.490 Transport Requirements: 00:22:57.490 Secure Channel: Not Specified 00:22:57.490 Port ID: 1 (0x0001) 00:22:57.490 Controller ID: 65535 (0xffff) 00:22:57.490 Admin Max SQ Size: 32 00:22:57.490 Transport Service Identifier: 4420 00:22:57.490 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:testnqn 00:22:57.490 Transport Address: 192.168.100.8 00:22:57.490 Transport Specific Address Subtype - RDMA 00:22:57.490 RDMA QP Service Type: 1 (Reliable Connected) 00:22:57.490 RDMA Provider Type: 1 (No provider specified) 00:22:57.490 RDMA CM Service: 1 (RDMA_CM) 00:22:57.490 02:42:30 -- host/identify_kernel_nvmf.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:testnqn' 00:22:57.490 EAL: No free 2048 kB hugepages reported on node 1 00:22:57.490 get_feature(0x01) failed 00:22:57.490 get_feature(0x02) failed 00:22:57.490 get_feature(0x04) failed 00:22:57.490 ===================================================== 00:22:57.490 NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:testnqn 00:22:57.490 ===================================================== 00:22:57.490 Controller Capabilities/Features 00:22:57.490 ================================ 00:22:57.490 Vendor ID: 0000 00:22:57.490 Subsystem Vendor ID: 0000 00:22:57.490 Serial Number: e29151fc2f5bc626b08c 00:22:57.490 Model Number: SPDK-nqn.2016-06.io.spdk:testnqn 00:22:57.490 Firmware Version: 6.7.0-68 00:22:57.490 Recommended Arb Burst: 6 00:22:57.490 IEEE OUI Identifier: 00 00 00 00:22:57.490 Multi-path I/O 00:22:57.490 May have multiple subsystem ports: Yes 00:22:57.490 May have multiple controllers: Yes 00:22:57.490 Associated with SR-IOV VF: No 00:22:57.490 Max Data Transfer Size: 1048576 00:22:57.490 Max Number of Namespaces: 1024 00:22:57.490 Max Number of I/O Queues: 128 00:22:57.490 NVMe Specification Version (VS): 1.3 00:22:57.490 NVMe Specification Version (Identify): 1.3 00:22:57.490 Maximum Queue Entries: 128 00:22:57.490 Contiguous Queues Required: No 00:22:57.490 Arbitration Mechanisms Supported 00:22:57.490 Weighted Round Robin: Not Supported 00:22:57.490 Vendor Specific: Not Supported 00:22:57.490 Reset Timeout: 7500 ms 00:22:57.490 Doorbell Stride: 4 bytes 00:22:57.490 NVM Subsystem Reset: Not Supported 00:22:57.490 Command Sets Supported 00:22:57.490 NVM Command Set: Supported 00:22:57.490 Boot Partition: Not Supported 00:22:57.490 Memory Page Size Minimum: 4096 bytes 00:22:57.490 Memory Page Size Maximum: 4096 bytes 00:22:57.490 Persistent Memory Region: Not Supported 00:22:57.490 Optional Asynchronous Events Supported 00:22:57.490 Namespace Attribute Notices: Supported 00:22:57.490 Firmware Activation Notices: Not Supported 00:22:57.490 ANA Change Notices: Supported 00:22:57.490 PLE Aggregate Log Change Notices: Not Supported 00:22:57.490 LBA Status Info Alert Notices: Not Supported 00:22:57.490 EGE Aggregate Log Change Notices: Not Supported 00:22:57.490 Normal NVM Subsystem Shutdown event: Not Supported 00:22:57.490 Zone Descriptor Change Notices: Not Supported 00:22:57.490 Discovery Log Change Notices: Not Supported 00:22:57.490 Controller Attributes 00:22:57.490 128-bit Host Identifier: Supported 00:22:57.490 Non-Operational Permissive Mode: Not Supported 00:22:57.490 NVM Sets: Not Supported 00:22:57.490 Read Recovery Levels: Not Supported 00:22:57.490 Endurance Groups: Not Supported 00:22:57.490 Predictable Latency Mode: Not Supported 00:22:57.490 Traffic Based Keep ALive: Supported 00:22:57.490 Namespace Granularity: Not Supported 00:22:57.490 SQ Associations: Not Supported 00:22:57.490 UUID List: Not Supported 00:22:57.490 Multi-Domain Subsystem: Not Supported 00:22:57.490 Fixed Capacity Management: Not Supported 00:22:57.490 Variable Capacity Management: Not Supported 00:22:57.490 Delete Endurance Group: Not Supported 00:22:57.490 Delete NVM Set: Not Supported 00:22:57.490 Extended LBA Formats Supported: Not Supported 00:22:57.490 Flexible Data Placement Supported: Not Supported 00:22:57.490 00:22:57.490 Controller Memory Buffer Support 00:22:57.490 ================================ 00:22:57.490 Supported: No 00:22:57.490 00:22:57.490 Persistent Memory Region Support 00:22:57.490 ================================ 00:22:57.490 Supported: No 00:22:57.490 00:22:57.490 Admin Command Set Attributes 00:22:57.490 ============================ 00:22:57.490 Security Send/Receive: Not Supported 00:22:57.490 Format NVM: Not Supported 00:22:57.490 Firmware Activate/Download: Not Supported 00:22:57.490 Namespace Management: Not Supported 00:22:57.490 Device Self-Test: Not Supported 00:22:57.490 Directives: Not Supported 00:22:57.490 NVMe-MI: Not Supported 00:22:57.490 Virtualization Management: Not Supported 00:22:57.490 Doorbell Buffer Config: Not Supported 00:22:57.490 Get LBA Status Capability: Not Supported 00:22:57.490 Command & Feature Lockdown Capability: Not Supported 00:22:57.490 Abort Command Limit: 4 00:22:57.490 Async Event Request Limit: 4 00:22:57.490 Number of Firmware Slots: N/A 00:22:57.490 Firmware Slot 1 Read-Only: N/A 00:22:57.490 Firmware Activation Without Reset: N/A 00:22:57.490 Multiple Update Detection Support: N/A 00:22:57.490 Firmware Update Granularity: No Information Provided 00:22:57.490 Per-Namespace SMART Log: Yes 00:22:57.490 Asymmetric Namespace Access Log Page: Supported 00:22:57.490 ANA Transition Time : 10 sec 00:22:57.490 00:22:57.490 Asymmetric Namespace Access Capabilities 00:22:57.490 ANA Optimized State : Supported 00:22:57.490 ANA Non-Optimized State : Supported 00:22:57.490 ANA Inaccessible State : Supported 00:22:57.490 ANA Persistent Loss State : Supported 00:22:57.490 ANA Change State : Supported 00:22:57.490 ANAGRPID is not changed : No 00:22:57.490 Non-Zero ANAGRPID for NS Mgmt Cmd : Not Supported 00:22:57.490 00:22:57.490 ANA Group Identifier Maximum : 128 00:22:57.490 Number of ANA Group Identifiers : 128 00:22:57.490 Max Number of Allowed Namespaces : 1024 00:22:57.490 Subsystem NQN: nqn.2016-06.io.spdk:testnqn 00:22:57.490 Command Effects Log Page: Supported 00:22:57.490 Get Log Page Extended Data: Supported 00:22:57.490 Telemetry Log Pages: Not Supported 00:22:57.490 Persistent Event Log Pages: Not Supported 00:22:57.490 Supported Log Pages Log Page: May Support 00:22:57.490 Commands Supported & Effects Log Page: Not Supported 00:22:57.490 Feature Identifiers & Effects Log Page:May Support 00:22:57.490 NVMe-MI Commands & Effects Log Page: May Support 00:22:57.490 Data Area 4 for Telemetry Log: Not Supported 00:22:57.490 Error Log Page Entries Supported: 128 00:22:57.490 Keep Alive: Supported 00:22:57.490 Keep Alive Granularity: 1000 ms 00:22:57.490 00:22:57.490 NVM Command Set Attributes 00:22:57.490 ========================== 00:22:57.490 Submission Queue Entry Size 00:22:57.490 Max: 64 00:22:57.490 Min: 64 00:22:57.490 Completion Queue Entry Size 00:22:57.490 Max: 16 00:22:57.490 Min: 16 00:22:57.490 Number of Namespaces: 1024 00:22:57.490 Compare Command: Not Supported 00:22:57.490 Write Uncorrectable Command: Not Supported 00:22:57.490 Dataset Management Command: Supported 00:22:57.490 Write Zeroes Command: Supported 00:22:57.490 Set Features Save Field: Not Supported 00:22:57.490 Reservations: Not Supported 00:22:57.490 Timestamp: Not Supported 00:22:57.490 Copy: Not Supported 00:22:57.490 Volatile Write Cache: Present 00:22:57.490 Atomic Write Unit (Normal): 1 00:22:57.490 Atomic Write Unit (PFail): 1 00:22:57.491 Atomic Compare & Write Unit: 1 00:22:57.491 Fused Compare & Write: Not Supported 00:22:57.491 Scatter-Gather List 00:22:57.491 SGL Command Set: Supported 00:22:57.491 SGL Keyed: Supported 00:22:57.491 SGL Bit Bucket Descriptor: Not Supported 00:22:57.491 SGL Metadata Pointer: Not Supported 00:22:57.491 Oversized SGL: Not Supported 00:22:57.491 SGL Metadata Address: Not Supported 00:22:57.491 SGL Offset: Supported 00:22:57.491 Transport SGL Data Block: Not Supported 00:22:57.491 Replay Protected Memory Block: Not Supported 00:22:57.491 00:22:57.491 Firmware Slot Information 00:22:57.491 ========================= 00:22:57.491 Active slot: 0 00:22:57.491 00:22:57.491 Asymmetric Namespace Access 00:22:57.491 =========================== 00:22:57.491 Change Count : 0 00:22:57.491 Number of ANA Group Descriptors : 1 00:22:57.491 ANA Group Descriptor : 0 00:22:57.491 ANA Group ID : 1 00:22:57.491 Number of NSID Values : 1 00:22:57.491 Change Count : 0 00:22:57.491 ANA State : 1 00:22:57.491 Namespace Identifier : 1 00:22:57.491 00:22:57.491 Commands Supported and Effects 00:22:57.491 ============================== 00:22:57.491 Admin Commands 00:22:57.491 -------------- 00:22:57.491 Get Log Page (02h): Supported 00:22:57.491 Identify (06h): Supported 00:22:57.491 Abort (08h): Supported 00:22:57.491 Set Features (09h): Supported 00:22:57.491 Get Features (0Ah): Supported 00:22:57.491 Asynchronous Event Request (0Ch): Supported 00:22:57.491 Keep Alive (18h): Supported 00:22:57.491 I/O Commands 00:22:57.491 ------------ 00:22:57.491 Flush (00h): Supported 00:22:57.491 Write (01h): Supported LBA-Change 00:22:57.491 Read (02h): Supported 00:22:57.491 Write Zeroes (08h): Supported LBA-Change 00:22:57.491 Dataset Management (09h): Supported 00:22:57.491 00:22:57.491 Error Log 00:22:57.491 ========= 00:22:57.491 Entry: 0 00:22:57.491 Error Count: 0x3 00:22:57.491 Submission Queue Id: 0x0 00:22:57.491 Command Id: 0x5 00:22:57.491 Phase Bit: 0 00:22:57.491 Status Code: 0x2 00:22:57.491 Status Code Type: 0x0 00:22:57.491 Do Not Retry: 1 00:22:57.491 Error Location: 0x28 00:22:57.491 LBA: 0x0 00:22:57.491 Namespace: 0x0 00:22:57.491 Vendor Log Page: 0x0 00:22:57.491 ----------- 00:22:57.491 Entry: 1 00:22:57.491 Error Count: 0x2 00:22:57.491 Submission Queue Id: 0x0 00:22:57.491 Command Id: 0x5 00:22:57.491 Phase Bit: 0 00:22:57.491 Status Code: 0x2 00:22:57.491 Status Code Type: 0x0 00:22:57.491 Do Not Retry: 1 00:22:57.491 Error Location: 0x28 00:22:57.491 LBA: 0x0 00:22:57.491 Namespace: 0x0 00:22:57.491 Vendor Log Page: 0x0 00:22:57.491 ----------- 00:22:57.491 Entry: 2 00:22:57.491 Error Count: 0x1 00:22:57.491 Submission Queue Id: 0x0 00:22:57.491 Command Id: 0x0 00:22:57.491 Phase Bit: 0 00:22:57.491 Status Code: 0x2 00:22:57.491 Status Code Type: 0x0 00:22:57.491 Do Not Retry: 1 00:22:57.491 Error Location: 0x28 00:22:57.491 LBA: 0x0 00:22:57.491 Namespace: 0x0 00:22:57.491 Vendor Log Page: 0x0 00:22:57.491 00:22:57.491 Number of Queues 00:22:57.491 ================ 00:22:57.491 Number of I/O Submission Queues: 128 00:22:57.491 Number of I/O Completion Queues: 128 00:22:57.491 00:22:57.491 ZNS Specific Controller Data 00:22:57.491 ============================ 00:22:57.491 Zone Append Size Limit: 0 00:22:57.491 00:22:57.491 00:22:57.491 Active Namespaces 00:22:57.491 ================= 00:22:57.491 get_feature(0x05) failed 00:22:57.491 Namespace ID:1 00:22:57.491 Command Set Identifier: NVM (00h) 00:22:57.491 Deallocate: Supported 00:22:57.491 Deallocated/Unwritten Error: Not Supported 00:22:57.491 Deallocated Read Value: Unknown 00:22:57.491 Deallocate in Write Zeroes: Not Supported 00:22:57.491 Deallocated Guard Field: 0xFFFF 00:22:57.491 Flush: Supported 00:22:57.491 Reservation: Not Supported 00:22:57.491 Namespace Sharing Capabilities: Multiple Controllers 00:22:57.491 Size (in LBAs): 7814037168 (3726GiB) 00:22:57.491 Capacity (in LBAs): 7814037168 (3726GiB) 00:22:57.491 Utilization (in LBAs): 7814037168 (3726GiB) 00:22:57.491 UUID: daa34ac9-be1b-4723-a298-2d0a08412274 00:22:57.491 Thin Provisioning: Not Supported 00:22:57.491 Per-NS Atomic Units: Yes 00:22:57.491 Atomic Boundary Size (Normal): 0 00:22:57.491 Atomic Boundary Size (PFail): 0 00:22:57.491 Atomic Boundary Offset: 0 00:22:57.491 NGUID/EUI64 Never Reused: No 00:22:57.491 ANA group ID: 1 00:22:57.491 Namespace Write Protected: No 00:22:57.491 Number of LBA Formats: 1 00:22:57.491 Current LBA Format: LBA Format #00 00:22:57.491 LBA Format #00: Data Size: 512 Metadata Size: 0 00:22:57.491 00:22:57.491 02:42:31 -- host/identify_kernel_nvmf.sh@1 -- # nvmftestfini 00:22:57.491 02:42:31 -- nvmf/common.sh@477 -- # nvmfcleanup 00:22:57.491 02:42:31 -- nvmf/common.sh@117 -- # sync 00:22:57.491 02:42:31 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:22:57.491 02:42:31 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:22:57.491 02:42:31 -- nvmf/common.sh@120 -- # set +e 00:22:57.491 02:42:31 -- nvmf/common.sh@121 -- # for i in {1..20} 00:22:57.491 02:42:31 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:22:57.750 rmmod nvme_rdma 00:22:57.750 rmmod nvme_fabrics 00:22:57.750 02:42:31 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:22:57.750 02:42:31 -- nvmf/common.sh@124 -- # set -e 00:22:57.750 02:42:31 -- nvmf/common.sh@125 -- # return 0 00:22:57.750 02:42:31 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:22:57.750 02:42:31 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:22:57.750 02:42:31 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:22:57.750 02:42:31 -- host/identify_kernel_nvmf.sh@1 -- # clean_kernel_target 00:22:57.750 02:42:31 -- nvmf/common.sh@673 -- # [[ -e /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn ]] 00:22:57.750 02:42:31 -- nvmf/common.sh@675 -- # echo 0 00:22:57.750 02:42:31 -- nvmf/common.sh@677 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/nqn.2016-06.io.spdk:testnqn 00:22:57.750 02:42:31 -- nvmf/common.sh@678 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn/namespaces/1 00:22:57.750 02:42:31 -- nvmf/common.sh@679 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:22:57.750 02:42:31 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn 00:22:57.750 02:42:31 -- nvmf/common.sh@682 -- # modules=(/sys/module/nvmet/holders/*) 00:22:57.750 02:42:31 -- nvmf/common.sh@684 -- # modprobe -r nvmet_rdma nvmet 00:22:57.750 02:42:31 -- nvmf/common.sh@687 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:23:01.035 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:23:01.035 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:23:01.035 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:23:01.035 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:23:01.035 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:23:01.035 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:23:01.035 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:23:01.035 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:23:01.035 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:23:01.035 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:23:01.035 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:23:01.035 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:23:01.035 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:23:01.035 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:23:01.035 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:23:01.035 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:23:04.323 0000:5f:00.0 (8086 0a54): nvme -> vfio-pci 00:23:04.323 00:23:04.323 real 0m18.538s 00:23:04.323 user 0m4.618s 00:23:04.323 sys 0m10.067s 00:23:04.323 02:42:37 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:23:04.323 02:42:37 -- common/autotest_common.sh@10 -- # set +x 00:23:04.323 ************************************ 00:23:04.323 END TEST nvmf_identify_kernel_target 00:23:04.323 ************************************ 00:23:04.323 02:42:37 -- nvmf/nvmf.sh@102 -- # run_test nvmf_auth /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/auth.sh --transport=rdma 00:23:04.323 02:42:37 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:04.323 02:42:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:04.323 02:42:37 -- common/autotest_common.sh@10 -- # set +x 00:23:04.323 ************************************ 00:23:04.323 START TEST nvmf_auth 00:23:04.323 ************************************ 00:23:04.323 02:42:37 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/auth.sh --transport=rdma 00:23:04.323 * Looking for test storage... 00:23:04.323 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:23:04.323 02:42:37 -- host/auth.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:23:04.323 02:42:37 -- nvmf/common.sh@7 -- # uname -s 00:23:04.323 02:42:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:04.323 02:42:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:04.323 02:42:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:04.323 02:42:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:04.323 02:42:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:04.323 02:42:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:04.323 02:42:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:04.323 02:42:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:04.323 02:42:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:04.323 02:42:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:04.323 02:42:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:23:04.323 02:42:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:23:04.323 02:42:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:04.323 02:42:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:04.323 02:42:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:04.323 02:42:37 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:23:04.323 02:42:37 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:23:04.323 02:42:37 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:04.323 02:42:37 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:04.323 02:42:37 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:04.324 02:42:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:04.324 02:42:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:04.324 02:42:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:04.324 02:42:37 -- paths/export.sh@5 -- # export PATH 00:23:04.324 02:42:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:04.324 02:42:37 -- nvmf/common.sh@47 -- # : 0 00:23:04.324 02:42:37 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:23:04.324 02:42:37 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:23:04.324 02:42:37 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:23:04.324 02:42:37 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:04.324 02:42:37 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:04.324 02:42:37 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:23:04.324 02:42:37 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:23:04.324 02:42:37 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:23:04.324 02:42:37 -- host/auth.sh@13 -- # digests=("sha256" "sha384" "sha512") 00:23:04.324 02:42:37 -- host/auth.sh@16 -- # dhgroups=("ffdhe2048" "ffdhe3072" "ffdhe4096" "ffdhe6144" "ffdhe8192") 00:23:04.324 02:42:37 -- host/auth.sh@17 -- # subnqn=nqn.2024-02.io.spdk:cnode0 00:23:04.324 02:42:37 -- host/auth.sh@18 -- # hostnqn=nqn.2024-02.io.spdk:host0 00:23:04.324 02:42:37 -- host/auth.sh@19 -- # nvmet_subsys=/sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:23:04.324 02:42:37 -- host/auth.sh@20 -- # nvmet_host=/sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 00:23:04.324 02:42:37 -- host/auth.sh@21 -- # keys=() 00:23:04.324 02:42:37 -- host/auth.sh@77 -- # nvmftestinit 00:23:04.324 02:42:37 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:23:04.324 02:42:37 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:04.324 02:42:37 -- nvmf/common.sh@437 -- # prepare_net_devs 00:23:04.324 02:42:37 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:23:04.324 02:42:37 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:23:04.324 02:42:37 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:04.324 02:42:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:04.324 02:42:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:04.324 02:42:37 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:23:04.324 02:42:37 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:23:04.324 02:42:37 -- nvmf/common.sh@285 -- # xtrace_disable 00:23:04.324 02:42:37 -- common/autotest_common.sh@10 -- # set +x 00:23:10.892 02:42:43 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:10.892 02:42:43 -- nvmf/common.sh@291 -- # pci_devs=() 00:23:10.892 02:42:43 -- nvmf/common.sh@291 -- # local -a pci_devs 00:23:10.892 02:42:43 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:23:10.892 02:42:43 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:23:10.892 02:42:43 -- nvmf/common.sh@293 -- # pci_drivers=() 00:23:10.892 02:42:43 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:23:10.892 02:42:43 -- nvmf/common.sh@295 -- # net_devs=() 00:23:10.892 02:42:43 -- nvmf/common.sh@295 -- # local -ga net_devs 00:23:10.892 02:42:43 -- nvmf/common.sh@296 -- # e810=() 00:23:10.892 02:42:43 -- nvmf/common.sh@296 -- # local -ga e810 00:23:10.892 02:42:43 -- nvmf/common.sh@297 -- # x722=() 00:23:10.892 02:42:43 -- nvmf/common.sh@297 -- # local -ga x722 00:23:10.892 02:42:43 -- nvmf/common.sh@298 -- # mlx=() 00:23:10.892 02:42:43 -- nvmf/common.sh@298 -- # local -ga mlx 00:23:10.892 02:42:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:10.892 02:42:43 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:10.892 02:42:43 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:10.892 02:42:43 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:10.892 02:42:43 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:10.892 02:42:43 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:10.892 02:42:43 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:10.892 02:42:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:10.892 02:42:43 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:10.892 02:42:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:10.892 02:42:43 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:10.892 02:42:43 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:23:10.892 02:42:43 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:23:10.892 02:42:43 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:23:10.892 02:42:43 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:23:10.892 02:42:43 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:23:10.892 02:42:43 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:23:10.892 02:42:43 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:23:10.892 02:42:43 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:23:10.892 02:42:43 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:23:10.892 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:23:10.892 02:42:43 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:23:10.892 02:42:43 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:23:10.892 02:42:43 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:23:10.892 02:42:43 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:23:10.892 02:42:43 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:23:10.892 02:42:43 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:23:10.892 02:42:43 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:23:10.892 02:42:43 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:23:10.892 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:23:10.892 02:42:43 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:23:10.892 02:42:43 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:23:10.892 02:42:43 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:23:10.892 02:42:43 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:23:10.892 02:42:43 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:23:10.892 02:42:43 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:23:10.892 02:42:43 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:23:10.892 02:42:43 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:23:10.892 02:42:43 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:23:10.892 02:42:43 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:10.892 02:42:43 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:23:10.892 02:42:43 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:10.892 02:42:43 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:23:10.892 Found net devices under 0000:18:00.0: mlx_0_0 00:23:10.892 02:42:43 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:23:10.892 02:42:43 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:23:10.892 02:42:43 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:10.892 02:42:43 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:23:10.892 02:42:43 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:10.892 02:42:43 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:23:10.892 Found net devices under 0000:18:00.1: mlx_0_1 00:23:10.892 02:42:43 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:23:10.892 02:42:43 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:23:10.892 02:42:43 -- nvmf/common.sh@403 -- # is_hw=yes 00:23:10.892 02:42:43 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:23:10.892 02:42:43 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:23:10.892 02:42:43 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:23:10.892 02:42:43 -- nvmf/common.sh@409 -- # rdma_device_init 00:23:10.892 02:42:43 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:23:10.892 02:42:43 -- nvmf/common.sh@58 -- # uname 00:23:10.892 02:42:43 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:23:10.892 02:42:43 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:23:10.892 02:42:43 -- nvmf/common.sh@63 -- # modprobe ib_core 00:23:10.892 02:42:43 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:23:10.892 02:42:43 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:23:10.892 02:42:43 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:23:10.892 02:42:43 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:23:10.892 02:42:43 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:23:10.892 02:42:43 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:23:10.892 02:42:43 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:23:10.892 02:42:43 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:23:10.892 02:42:43 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:23:10.892 02:42:43 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:23:10.892 02:42:43 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:23:10.892 02:42:43 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:23:10.892 02:42:43 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:23:10.892 02:42:43 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:23:10.892 02:42:43 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:10.892 02:42:43 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:23:10.892 02:42:43 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:23:10.892 02:42:43 -- nvmf/common.sh@105 -- # continue 2 00:23:10.892 02:42:43 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:23:10.892 02:42:43 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:10.892 02:42:43 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:23:10.892 02:42:43 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:10.892 02:42:43 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:23:10.892 02:42:43 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:23:10.892 02:42:43 -- nvmf/common.sh@105 -- # continue 2 00:23:10.892 02:42:43 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:23:10.892 02:42:43 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:23:10.892 02:42:43 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:23:10.892 02:42:43 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:23:10.892 02:42:43 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:10.892 02:42:43 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:10.892 02:42:43 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:23:10.892 02:42:43 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:23:10.892 02:42:43 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:23:10.892 64: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:23:10.892 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:23:10.892 altname enp24s0f0np0 00:23:10.892 altname ens785f0np0 00:23:10.892 inet 192.168.100.8/24 scope global mlx_0_0 00:23:10.892 valid_lft forever preferred_lft forever 00:23:10.892 02:42:43 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:23:10.892 02:42:43 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:23:10.892 02:42:43 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:23:10.892 02:42:43 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:23:10.893 02:42:43 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:10.893 02:42:43 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:10.893 02:42:43 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:23:10.893 02:42:43 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:23:10.893 02:42:43 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:23:10.893 65: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:23:10.893 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:23:10.893 altname enp24s0f1np1 00:23:10.893 altname ens785f1np1 00:23:10.893 inet 192.168.100.9/24 scope global mlx_0_1 00:23:10.893 valid_lft forever preferred_lft forever 00:23:10.893 02:42:43 -- nvmf/common.sh@411 -- # return 0 00:23:10.893 02:42:43 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:23:10.893 02:42:43 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:23:10.893 02:42:43 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:23:10.893 02:42:43 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:23:10.893 02:42:43 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:23:10.893 02:42:43 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:23:10.893 02:42:43 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:23:10.893 02:42:43 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:23:10.893 02:42:43 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:23:10.893 02:42:43 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:23:10.893 02:42:43 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:23:10.893 02:42:43 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:10.893 02:42:43 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:23:10.893 02:42:43 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:23:10.893 02:42:43 -- nvmf/common.sh@105 -- # continue 2 00:23:10.893 02:42:43 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:23:10.893 02:42:43 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:10.893 02:42:43 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:23:10.893 02:42:43 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:10.893 02:42:43 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:23:10.893 02:42:43 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:23:10.893 02:42:43 -- nvmf/common.sh@105 -- # continue 2 00:23:10.893 02:42:43 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:23:10.893 02:42:43 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:23:10.893 02:42:43 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:23:10.893 02:42:43 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:23:10.893 02:42:43 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:10.893 02:42:43 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:10.893 02:42:43 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:23:10.893 02:42:43 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:23:10.893 02:42:43 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:23:10.893 02:42:43 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:23:10.893 02:42:43 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:10.893 02:42:43 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:10.893 02:42:43 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:23:10.893 192.168.100.9' 00:23:10.893 02:42:43 -- nvmf/common.sh@446 -- # head -n 1 00:23:10.893 02:42:43 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:23:10.893 192.168.100.9' 00:23:10.893 02:42:43 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:23:10.893 02:42:43 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:23:10.893 192.168.100.9' 00:23:10.893 02:42:43 -- nvmf/common.sh@447 -- # tail -n +2 00:23:10.893 02:42:43 -- nvmf/common.sh@447 -- # head -n 1 00:23:10.893 02:42:43 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:23:10.893 02:42:43 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:23:10.893 02:42:43 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:23:10.893 02:42:43 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:23:10.893 02:42:43 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:23:10.893 02:42:43 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:23:10.893 02:42:43 -- host/auth.sh@78 -- # nvmfappstart -L nvme_auth 00:23:10.893 02:42:43 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:23:10.893 02:42:43 -- common/autotest_common.sh@710 -- # xtrace_disable 00:23:10.893 02:42:43 -- common/autotest_common.sh@10 -- # set +x 00:23:10.893 02:42:43 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -L nvme_auth 00:23:10.893 02:42:43 -- nvmf/common.sh@470 -- # nvmfpid=1638414 00:23:10.893 02:42:43 -- nvmf/common.sh@471 -- # waitforlisten 1638414 00:23:10.893 02:42:43 -- common/autotest_common.sh@817 -- # '[' -z 1638414 ']' 00:23:10.893 02:42:43 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:10.893 02:42:43 -- common/autotest_common.sh@822 -- # local max_retries=100 00:23:10.893 02:42:43 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:10.893 02:42:43 -- common/autotest_common.sh@826 -- # xtrace_disable 00:23:10.893 02:42:43 -- common/autotest_common.sh@10 -- # set +x 00:23:10.893 02:42:44 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:23:10.893 02:42:44 -- common/autotest_common.sh@850 -- # return 0 00:23:10.893 02:42:44 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:23:10.893 02:42:44 -- common/autotest_common.sh@716 -- # xtrace_disable 00:23:10.893 02:42:44 -- common/autotest_common.sh@10 -- # set +x 00:23:11.152 02:42:44 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:11.152 02:42:44 -- host/auth.sh@79 -- # trap 'cat /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/nvme-auth.log; cleanup' SIGINT SIGTERM EXIT 00:23:11.152 02:42:44 -- host/auth.sh@81 -- # gen_key null 32 00:23:11.152 02:42:44 -- host/auth.sh@53 -- # local digest len file key 00:23:11.152 02:42:44 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:23:11.152 02:42:44 -- host/auth.sh@54 -- # local -A digests 00:23:11.152 02:42:44 -- host/auth.sh@56 -- # digest=null 00:23:11.152 02:42:44 -- host/auth.sh@56 -- # len=32 00:23:11.152 02:42:44 -- host/auth.sh@57 -- # xxd -p -c0 -l 16 /dev/urandom 00:23:11.152 02:42:44 -- host/auth.sh@57 -- # key=a5aa7ab5b02f26330c948489737a26f6 00:23:11.152 02:42:44 -- host/auth.sh@58 -- # mktemp -t spdk.key-null.XXX 00:23:11.152 02:42:44 -- host/auth.sh@58 -- # file=/tmp/spdk.key-null.bmm 00:23:11.152 02:42:44 -- host/auth.sh@59 -- # format_dhchap_key a5aa7ab5b02f26330c948489737a26f6 0 00:23:11.152 02:42:44 -- nvmf/common.sh@708 -- # format_key DHHC-1 a5aa7ab5b02f26330c948489737a26f6 0 00:23:11.152 02:42:44 -- nvmf/common.sh@691 -- # local prefix key digest 00:23:11.152 02:42:44 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:23:11.152 02:42:44 -- nvmf/common.sh@693 -- # key=a5aa7ab5b02f26330c948489737a26f6 00:23:11.152 02:42:44 -- nvmf/common.sh@693 -- # digest=0 00:23:11.152 02:42:44 -- nvmf/common.sh@694 -- # python - 00:23:11.152 02:42:44 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-null.bmm 00:23:11.152 02:42:44 -- host/auth.sh@62 -- # echo /tmp/spdk.key-null.bmm 00:23:11.152 02:42:44 -- host/auth.sh@81 -- # keys[0]=/tmp/spdk.key-null.bmm 00:23:11.152 02:42:44 -- host/auth.sh@82 -- # gen_key null 48 00:23:11.152 02:42:44 -- host/auth.sh@53 -- # local digest len file key 00:23:11.152 02:42:44 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:23:11.152 02:42:44 -- host/auth.sh@54 -- # local -A digests 00:23:11.152 02:42:44 -- host/auth.sh@56 -- # digest=null 00:23:11.152 02:42:44 -- host/auth.sh@56 -- # len=48 00:23:11.152 02:42:44 -- host/auth.sh@57 -- # xxd -p -c0 -l 24 /dev/urandom 00:23:11.152 02:42:44 -- host/auth.sh@57 -- # key=88c6454aed1e52a58be76ef86b974f5263e5cea9a062962b 00:23:11.152 02:42:44 -- host/auth.sh@58 -- # mktemp -t spdk.key-null.XXX 00:23:11.152 02:42:44 -- host/auth.sh@58 -- # file=/tmp/spdk.key-null.mbq 00:23:11.152 02:42:44 -- host/auth.sh@59 -- # format_dhchap_key 88c6454aed1e52a58be76ef86b974f5263e5cea9a062962b 0 00:23:11.152 02:42:44 -- nvmf/common.sh@708 -- # format_key DHHC-1 88c6454aed1e52a58be76ef86b974f5263e5cea9a062962b 0 00:23:11.152 02:42:44 -- nvmf/common.sh@691 -- # local prefix key digest 00:23:11.152 02:42:44 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:23:11.152 02:42:44 -- nvmf/common.sh@693 -- # key=88c6454aed1e52a58be76ef86b974f5263e5cea9a062962b 00:23:11.152 02:42:44 -- nvmf/common.sh@693 -- # digest=0 00:23:11.152 02:42:44 -- nvmf/common.sh@694 -- # python - 00:23:11.152 02:42:44 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-null.mbq 00:23:11.152 02:42:44 -- host/auth.sh@62 -- # echo /tmp/spdk.key-null.mbq 00:23:11.152 02:42:44 -- host/auth.sh@82 -- # keys[1]=/tmp/spdk.key-null.mbq 00:23:11.152 02:42:44 -- host/auth.sh@83 -- # gen_key sha256 32 00:23:11.152 02:42:44 -- host/auth.sh@53 -- # local digest len file key 00:23:11.152 02:42:44 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:23:11.152 02:42:44 -- host/auth.sh@54 -- # local -A digests 00:23:11.152 02:42:44 -- host/auth.sh@56 -- # digest=sha256 00:23:11.152 02:42:44 -- host/auth.sh@56 -- # len=32 00:23:11.152 02:42:44 -- host/auth.sh@57 -- # xxd -p -c0 -l 16 /dev/urandom 00:23:11.152 02:42:44 -- host/auth.sh@57 -- # key=7761a525b90995194be1071144df085c 00:23:11.152 02:42:44 -- host/auth.sh@58 -- # mktemp -t spdk.key-sha256.XXX 00:23:11.152 02:42:44 -- host/auth.sh@58 -- # file=/tmp/spdk.key-sha256.ffU 00:23:11.152 02:42:44 -- host/auth.sh@59 -- # format_dhchap_key 7761a525b90995194be1071144df085c 1 00:23:11.152 02:42:44 -- nvmf/common.sh@708 -- # format_key DHHC-1 7761a525b90995194be1071144df085c 1 00:23:11.152 02:42:44 -- nvmf/common.sh@691 -- # local prefix key digest 00:23:11.152 02:42:44 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:23:11.152 02:42:44 -- nvmf/common.sh@693 -- # key=7761a525b90995194be1071144df085c 00:23:11.152 02:42:44 -- nvmf/common.sh@693 -- # digest=1 00:23:11.152 02:42:44 -- nvmf/common.sh@694 -- # python - 00:23:11.152 02:42:44 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-sha256.ffU 00:23:11.152 02:42:44 -- host/auth.sh@62 -- # echo /tmp/spdk.key-sha256.ffU 00:23:11.152 02:42:44 -- host/auth.sh@83 -- # keys[2]=/tmp/spdk.key-sha256.ffU 00:23:11.152 02:42:44 -- host/auth.sh@84 -- # gen_key sha384 48 00:23:11.152 02:42:44 -- host/auth.sh@53 -- # local digest len file key 00:23:11.152 02:42:44 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:23:11.152 02:42:44 -- host/auth.sh@54 -- # local -A digests 00:23:11.152 02:42:44 -- host/auth.sh@56 -- # digest=sha384 00:23:11.152 02:42:44 -- host/auth.sh@56 -- # len=48 00:23:11.152 02:42:44 -- host/auth.sh@57 -- # xxd -p -c0 -l 24 /dev/urandom 00:23:11.152 02:42:44 -- host/auth.sh@57 -- # key=35a707dd49a4ff2eb4f9cc9c5124b768d4d9037c5ee1df64 00:23:11.152 02:42:44 -- host/auth.sh@58 -- # mktemp -t spdk.key-sha384.XXX 00:23:11.152 02:42:44 -- host/auth.sh@58 -- # file=/tmp/spdk.key-sha384.II8 00:23:11.152 02:42:44 -- host/auth.sh@59 -- # format_dhchap_key 35a707dd49a4ff2eb4f9cc9c5124b768d4d9037c5ee1df64 2 00:23:11.152 02:42:44 -- nvmf/common.sh@708 -- # format_key DHHC-1 35a707dd49a4ff2eb4f9cc9c5124b768d4d9037c5ee1df64 2 00:23:11.152 02:42:44 -- nvmf/common.sh@691 -- # local prefix key digest 00:23:11.152 02:42:44 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:23:11.152 02:42:44 -- nvmf/common.sh@693 -- # key=35a707dd49a4ff2eb4f9cc9c5124b768d4d9037c5ee1df64 00:23:11.152 02:42:44 -- nvmf/common.sh@693 -- # digest=2 00:23:11.152 02:42:44 -- nvmf/common.sh@694 -- # python - 00:23:11.411 02:42:44 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-sha384.II8 00:23:11.411 02:42:44 -- host/auth.sh@62 -- # echo /tmp/spdk.key-sha384.II8 00:23:11.411 02:42:44 -- host/auth.sh@84 -- # keys[3]=/tmp/spdk.key-sha384.II8 00:23:11.411 02:42:44 -- host/auth.sh@85 -- # gen_key sha512 64 00:23:11.411 02:42:44 -- host/auth.sh@53 -- # local digest len file key 00:23:11.411 02:42:44 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:23:11.411 02:42:44 -- host/auth.sh@54 -- # local -A digests 00:23:11.411 02:42:44 -- host/auth.sh@56 -- # digest=sha512 00:23:11.411 02:42:44 -- host/auth.sh@56 -- # len=64 00:23:11.411 02:42:44 -- host/auth.sh@57 -- # xxd -p -c0 -l 32 /dev/urandom 00:23:11.411 02:42:44 -- host/auth.sh@57 -- # key=9954dda0b20a17508815b41aa48f8c3c90347723dda545f1530eb43cbf4450f4 00:23:11.411 02:42:44 -- host/auth.sh@58 -- # mktemp -t spdk.key-sha512.XXX 00:23:11.411 02:42:44 -- host/auth.sh@58 -- # file=/tmp/spdk.key-sha512.fct 00:23:11.411 02:42:44 -- host/auth.sh@59 -- # format_dhchap_key 9954dda0b20a17508815b41aa48f8c3c90347723dda545f1530eb43cbf4450f4 3 00:23:11.411 02:42:44 -- nvmf/common.sh@708 -- # format_key DHHC-1 9954dda0b20a17508815b41aa48f8c3c90347723dda545f1530eb43cbf4450f4 3 00:23:11.411 02:42:44 -- nvmf/common.sh@691 -- # local prefix key digest 00:23:11.411 02:42:44 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:23:11.411 02:42:44 -- nvmf/common.sh@693 -- # key=9954dda0b20a17508815b41aa48f8c3c90347723dda545f1530eb43cbf4450f4 00:23:11.411 02:42:44 -- nvmf/common.sh@693 -- # digest=3 00:23:11.411 02:42:44 -- nvmf/common.sh@694 -- # python - 00:23:11.411 02:42:44 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-sha512.fct 00:23:11.411 02:42:44 -- host/auth.sh@62 -- # echo /tmp/spdk.key-sha512.fct 00:23:11.411 02:42:44 -- host/auth.sh@85 -- # keys[4]=/tmp/spdk.key-sha512.fct 00:23:11.411 02:42:44 -- host/auth.sh@87 -- # waitforlisten 1638414 00:23:11.411 02:42:44 -- common/autotest_common.sh@817 -- # '[' -z 1638414 ']' 00:23:11.411 02:42:44 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:11.411 02:42:44 -- common/autotest_common.sh@822 -- # local max_retries=100 00:23:11.411 02:42:44 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:11.411 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:11.411 02:42:44 -- common/autotest_common.sh@826 -- # xtrace_disable 00:23:11.411 02:42:44 -- common/autotest_common.sh@10 -- # set +x 00:23:11.669 02:42:45 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:23:11.670 02:42:45 -- common/autotest_common.sh@850 -- # return 0 00:23:11.670 02:42:45 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:23:11.670 02:42:45 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key0 /tmp/spdk.key-null.bmm 00:23:11.670 02:42:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:11.670 02:42:45 -- common/autotest_common.sh@10 -- # set +x 00:23:11.670 02:42:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:11.670 02:42:45 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:23:11.670 02:42:45 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key1 /tmp/spdk.key-null.mbq 00:23:11.670 02:42:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:11.670 02:42:45 -- common/autotest_common.sh@10 -- # set +x 00:23:11.670 02:42:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:11.670 02:42:45 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:23:11.670 02:42:45 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key2 /tmp/spdk.key-sha256.ffU 00:23:11.670 02:42:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:11.670 02:42:45 -- common/autotest_common.sh@10 -- # set +x 00:23:11.670 02:42:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:11.670 02:42:45 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:23:11.670 02:42:45 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key3 /tmp/spdk.key-sha384.II8 00:23:11.670 02:42:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:11.670 02:42:45 -- common/autotest_common.sh@10 -- # set +x 00:23:11.670 02:42:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:11.670 02:42:45 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:23:11.670 02:42:45 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key4 /tmp/spdk.key-sha512.fct 00:23:11.670 02:42:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:11.670 02:42:45 -- common/autotest_common.sh@10 -- # set +x 00:23:11.670 02:42:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:11.670 02:42:45 -- host/auth.sh@92 -- # nvmet_auth_init 00:23:11.670 02:42:45 -- host/auth.sh@35 -- # get_main_ns_ip 00:23:11.670 02:42:45 -- nvmf/common.sh@717 -- # local ip 00:23:11.670 02:42:45 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:11.670 02:42:45 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:11.670 02:42:45 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:11.670 02:42:45 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:11.670 02:42:45 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:11.670 02:42:45 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:11.670 02:42:45 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:11.670 02:42:45 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:11.670 02:42:45 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:11.670 02:42:45 -- host/auth.sh@35 -- # configure_kernel_target nqn.2024-02.io.spdk:cnode0 192.168.100.8 00:23:11.670 02:42:45 -- nvmf/common.sh@621 -- # local kernel_name=nqn.2024-02.io.spdk:cnode0 kernel_target_ip=192.168.100.8 00:23:11.670 02:42:45 -- nvmf/common.sh@623 -- # nvmet=/sys/kernel/config/nvmet 00:23:11.670 02:42:45 -- nvmf/common.sh@624 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:23:11.670 02:42:45 -- nvmf/common.sh@625 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/namespaces/1 00:23:11.670 02:42:45 -- nvmf/common.sh@626 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:23:11.670 02:42:45 -- nvmf/common.sh@628 -- # local block nvme 00:23:11.670 02:42:45 -- nvmf/common.sh@630 -- # [[ ! -e /sys/module/nvmet ]] 00:23:11.670 02:42:45 -- nvmf/common.sh@631 -- # modprobe nvmet 00:23:11.670 02:42:45 -- nvmf/common.sh@634 -- # [[ -e /sys/kernel/config/nvmet ]] 00:23:11.670 02:42:45 -- nvmf/common.sh@636 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:23:14.949 Waiting for block devices as requested 00:23:14.949 0000:5f:00.0 (8086 0a54): vfio-pci -> nvme 00:23:14.949 0000:00:04.7 (8086 2021): vfio-pci -> ioatdma 00:23:14.949 0000:00:04.6 (8086 2021): vfio-pci -> ioatdma 00:23:14.950 0000:00:04.5 (8086 2021): vfio-pci -> ioatdma 00:23:15.207 0000:00:04.4 (8086 2021): vfio-pci -> ioatdma 00:23:15.207 0000:00:04.3 (8086 2021): vfio-pci -> ioatdma 00:23:15.207 0000:00:04.2 (8086 2021): vfio-pci -> ioatdma 00:23:15.465 0000:00:04.1 (8086 2021): vfio-pci -> ioatdma 00:23:15.465 0000:00:04.0 (8086 2021): vfio-pci -> ioatdma 00:23:15.465 0000:80:04.7 (8086 2021): vfio-pci -> ioatdma 00:23:15.721 0000:80:04.6 (8086 2021): vfio-pci -> ioatdma 00:23:15.721 0000:80:04.5 (8086 2021): vfio-pci -> ioatdma 00:23:15.721 0000:80:04.4 (8086 2021): vfio-pci -> ioatdma 00:23:15.721 0000:80:04.3 (8086 2021): vfio-pci -> ioatdma 00:23:15.978 0000:80:04.2 (8086 2021): vfio-pci -> ioatdma 00:23:15.978 0000:80:04.1 (8086 2021): vfio-pci -> ioatdma 00:23:15.978 0000:80:04.0 (8086 2021): vfio-pci -> ioatdma 00:23:16.909 02:42:50 -- nvmf/common.sh@639 -- # for block in /sys/block/nvme* 00:23:16.909 02:42:50 -- nvmf/common.sh@640 -- # [[ -e /sys/block/nvme0n1 ]] 00:23:16.909 02:42:50 -- nvmf/common.sh@641 -- # is_block_zoned nvme0n1 00:23:16.909 02:42:50 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:23:16.909 02:42:50 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:23:16.909 02:42:50 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:23:16.909 02:42:50 -- nvmf/common.sh@642 -- # block_in_use nvme0n1 00:23:16.909 02:42:50 -- scripts/common.sh@378 -- # local block=nvme0n1 pt 00:23:16.909 02:42:50 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:23:16.909 No valid GPT data, bailing 00:23:16.909 02:42:50 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:23:16.909 02:42:50 -- scripts/common.sh@391 -- # pt= 00:23:16.909 02:42:50 -- scripts/common.sh@392 -- # return 1 00:23:16.909 02:42:50 -- nvmf/common.sh@642 -- # nvme=/dev/nvme0n1 00:23:16.909 02:42:50 -- nvmf/common.sh@645 -- # [[ -b /dev/nvme0n1 ]] 00:23:16.909 02:42:50 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:23:16.909 02:42:50 -- nvmf/common.sh@648 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/namespaces/1 00:23:16.909 02:42:50 -- nvmf/common.sh@649 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:23:16.909 02:42:50 -- nvmf/common.sh@654 -- # echo SPDK-nqn.2024-02.io.spdk:cnode0 00:23:16.909 02:42:50 -- nvmf/common.sh@656 -- # echo 1 00:23:16.909 02:42:50 -- nvmf/common.sh@657 -- # echo /dev/nvme0n1 00:23:16.909 02:42:50 -- nvmf/common.sh@658 -- # echo 1 00:23:16.909 02:42:50 -- nvmf/common.sh@660 -- # echo 192.168.100.8 00:23:16.909 02:42:50 -- nvmf/common.sh@661 -- # echo rdma 00:23:16.909 02:42:50 -- nvmf/common.sh@662 -- # echo 4420 00:23:16.909 02:42:50 -- nvmf/common.sh@663 -- # echo ipv4 00:23:16.909 02:42:50 -- nvmf/common.sh@666 -- # ln -s /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 /sys/kernel/config/nvmet/ports/1/subsystems/ 00:23:16.909 02:42:50 -- nvmf/common.sh@669 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -a 192.168.100.8 -t rdma -s 4420 00:23:17.166 00:23:17.166 Discovery Log Number of Records 2, Generation counter 2 00:23:17.166 =====Discovery Log Entry 0====== 00:23:17.166 trtype: rdma 00:23:17.166 adrfam: ipv4 00:23:17.166 subtype: current discovery subsystem 00:23:17.166 treq: not specified, sq flow control disable supported 00:23:17.166 portid: 1 00:23:17.166 trsvcid: 4420 00:23:17.166 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:23:17.166 traddr: 192.168.100.8 00:23:17.166 eflags: none 00:23:17.166 rdma_prtype: not specified 00:23:17.166 rdma_qptype: connected 00:23:17.166 rdma_cms: rdma-cm 00:23:17.166 rdma_pkey: 0x0000 00:23:17.166 =====Discovery Log Entry 1====== 00:23:17.166 trtype: rdma 00:23:17.166 adrfam: ipv4 00:23:17.166 subtype: nvme subsystem 00:23:17.166 treq: not specified, sq flow control disable supported 00:23:17.166 portid: 1 00:23:17.166 trsvcid: 4420 00:23:17.166 subnqn: nqn.2024-02.io.spdk:cnode0 00:23:17.166 traddr: 192.168.100.8 00:23:17.166 eflags: none 00:23:17.166 rdma_prtype: not specified 00:23:17.166 rdma_qptype: connected 00:23:17.166 rdma_cms: rdma-cm 00:23:17.166 rdma_pkey: 0x0000 00:23:17.166 02:42:50 -- host/auth.sh@36 -- # mkdir /sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 00:23:17.166 02:42:50 -- host/auth.sh@37 -- # echo 0 00:23:17.166 02:42:50 -- host/auth.sh@38 -- # ln -s /sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/allowed_hosts/nqn.2024-02.io.spdk:host0 00:23:17.166 02:42:50 -- host/auth.sh@95 -- # nvmet_auth_set_key sha256 ffdhe2048 1 00:23:17.166 02:42:50 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:17.166 02:42:50 -- host/auth.sh@44 -- # digest=sha256 00:23:17.166 02:42:50 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:23:17.166 02:42:50 -- host/auth.sh@44 -- # keyid=1 00:23:17.166 02:42:50 -- host/auth.sh@45 -- # key=DHHC-1:00:ODhjNjQ1NGFlZDFlNTJhNThiZTc2ZWY4NmI5NzRmNTI2M2U1Y2VhOWEwNjI5NjJiyej8LQ==: 00:23:17.166 02:42:50 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:23:17.166 02:42:50 -- host/auth.sh@48 -- # echo ffdhe2048 00:23:17.166 02:42:50 -- host/auth.sh@49 -- # echo DHHC-1:00:ODhjNjQ1NGFlZDFlNTJhNThiZTc2ZWY4NmI5NzRmNTI2M2U1Y2VhOWEwNjI5NjJiyej8LQ==: 00:23:17.166 02:42:50 -- host/auth.sh@100 -- # IFS=, 00:23:17.166 02:42:50 -- host/auth.sh@101 -- # printf %s sha256,sha384,sha512 00:23:17.166 02:42:50 -- host/auth.sh@100 -- # IFS=, 00:23:17.166 02:42:50 -- host/auth.sh@101 -- # printf %s ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:23:17.166 02:42:50 -- host/auth.sh@100 -- # connect_authenticate sha256,sha384,sha512 ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 1 00:23:17.166 02:42:50 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:17.166 02:42:50 -- host/auth.sh@68 -- # digest=sha256,sha384,sha512 00:23:17.166 02:42:50 -- host/auth.sh@68 -- # dhgroup=ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:23:17.166 02:42:50 -- host/auth.sh@68 -- # keyid=1 00:23:17.166 02:42:50 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256,sha384,sha512 --dhchap-dhgroups ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:23:17.166 02:42:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:17.166 02:42:50 -- common/autotest_common.sh@10 -- # set +x 00:23:17.166 02:42:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:17.166 02:42:50 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:17.166 02:42:50 -- nvmf/common.sh@717 -- # local ip 00:23:17.166 02:42:50 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:17.166 02:42:50 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:17.166 02:42:50 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:17.166 02:42:50 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:17.166 02:42:50 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:17.166 02:42:50 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:17.167 02:42:50 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:17.167 02:42:50 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:17.167 02:42:50 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:17.167 02:42:50 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:23:17.167 02:42:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:17.167 02:42:50 -- common/autotest_common.sh@10 -- # set +x 00:23:17.425 nvme0n1 00:23:17.425 02:42:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:17.425 02:42:50 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:17.425 02:42:50 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:17.425 02:42:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:17.425 02:42:50 -- common/autotest_common.sh@10 -- # set +x 00:23:17.425 02:42:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:17.425 02:42:50 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:17.425 02:42:50 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:17.425 02:42:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:17.425 02:42:50 -- common/autotest_common.sh@10 -- # set +x 00:23:17.425 02:42:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:17.425 02:42:50 -- host/auth.sh@107 -- # for digest in "${digests[@]}" 00:23:17.425 02:42:50 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:23:17.425 02:42:50 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:17.425 02:42:50 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 0 00:23:17.425 02:42:50 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:17.425 02:42:50 -- host/auth.sh@44 -- # digest=sha256 00:23:17.425 02:42:50 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:23:17.425 02:42:50 -- host/auth.sh@44 -- # keyid=0 00:23:17.425 02:42:50 -- host/auth.sh@45 -- # key=DHHC-1:00:YTVhYTdhYjViMDJmMjYzMzBjOTQ4NDg5NzM3YTI2Zjb26OQB: 00:23:17.425 02:42:50 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:23:17.425 02:42:50 -- host/auth.sh@48 -- # echo ffdhe2048 00:23:17.425 02:42:50 -- host/auth.sh@49 -- # echo DHHC-1:00:YTVhYTdhYjViMDJmMjYzMzBjOTQ4NDg5NzM3YTI2Zjb26OQB: 00:23:17.425 02:42:50 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 0 00:23:17.425 02:42:50 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:17.425 02:42:50 -- host/auth.sh@68 -- # digest=sha256 00:23:17.425 02:42:50 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:23:17.425 02:42:50 -- host/auth.sh@68 -- # keyid=0 00:23:17.425 02:42:50 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:23:17.425 02:42:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:17.425 02:42:50 -- common/autotest_common.sh@10 -- # set +x 00:23:17.425 02:42:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:17.425 02:42:50 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:17.425 02:42:50 -- nvmf/common.sh@717 -- # local ip 00:23:17.425 02:42:50 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:17.425 02:42:50 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:17.425 02:42:50 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:17.425 02:42:50 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:17.425 02:42:50 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:17.425 02:42:50 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:17.425 02:42:50 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:17.425 02:42:50 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:17.425 02:42:50 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:17.425 02:42:50 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:23:17.425 02:42:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:17.425 02:42:50 -- common/autotest_common.sh@10 -- # set +x 00:23:17.683 nvme0n1 00:23:17.683 02:42:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:17.683 02:42:51 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:17.683 02:42:51 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:17.683 02:42:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:17.683 02:42:51 -- common/autotest_common.sh@10 -- # set +x 00:23:17.683 02:42:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:17.683 02:42:51 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:17.683 02:42:51 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:17.683 02:42:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:17.683 02:42:51 -- common/autotest_common.sh@10 -- # set +x 00:23:17.683 02:42:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:17.683 02:42:51 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:17.683 02:42:51 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 1 00:23:17.683 02:42:51 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:17.683 02:42:51 -- host/auth.sh@44 -- # digest=sha256 00:23:17.683 02:42:51 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:23:17.683 02:42:51 -- host/auth.sh@44 -- # keyid=1 00:23:17.683 02:42:51 -- host/auth.sh@45 -- # key=DHHC-1:00:ODhjNjQ1NGFlZDFlNTJhNThiZTc2ZWY4NmI5NzRmNTI2M2U1Y2VhOWEwNjI5NjJiyej8LQ==: 00:23:17.683 02:42:51 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:23:17.683 02:42:51 -- host/auth.sh@48 -- # echo ffdhe2048 00:23:17.683 02:42:51 -- host/auth.sh@49 -- # echo DHHC-1:00:ODhjNjQ1NGFlZDFlNTJhNThiZTc2ZWY4NmI5NzRmNTI2M2U1Y2VhOWEwNjI5NjJiyej8LQ==: 00:23:17.683 02:42:51 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 1 00:23:17.683 02:42:51 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:17.683 02:42:51 -- host/auth.sh@68 -- # digest=sha256 00:23:17.683 02:42:51 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:23:17.683 02:42:51 -- host/auth.sh@68 -- # keyid=1 00:23:17.683 02:42:51 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:23:17.683 02:42:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:17.683 02:42:51 -- common/autotest_common.sh@10 -- # set +x 00:23:17.683 02:42:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:17.683 02:42:51 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:17.683 02:42:51 -- nvmf/common.sh@717 -- # local ip 00:23:17.683 02:42:51 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:17.683 02:42:51 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:17.683 02:42:51 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:17.683 02:42:51 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:17.683 02:42:51 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:17.683 02:42:51 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:17.683 02:42:51 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:17.683 02:42:51 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:17.683 02:42:51 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:17.683 02:42:51 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:23:17.683 02:42:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:17.683 02:42:51 -- common/autotest_common.sh@10 -- # set +x 00:23:17.941 nvme0n1 00:23:17.941 02:42:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:17.941 02:42:51 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:17.941 02:42:51 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:17.942 02:42:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:17.942 02:42:51 -- common/autotest_common.sh@10 -- # set +x 00:23:17.942 02:42:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:17.942 02:42:51 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:17.942 02:42:51 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:17.942 02:42:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:17.942 02:42:51 -- common/autotest_common.sh@10 -- # set +x 00:23:17.942 02:42:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:17.942 02:42:51 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:17.942 02:42:51 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 2 00:23:17.942 02:42:51 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:17.942 02:42:51 -- host/auth.sh@44 -- # digest=sha256 00:23:17.942 02:42:51 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:23:17.942 02:42:51 -- host/auth.sh@44 -- # keyid=2 00:23:17.942 02:42:51 -- host/auth.sh@45 -- # key=DHHC-1:01:Nzc2MWE1MjViOTA5OTUxOTRiZTEwNzExNDRkZjA4NWPly9CM: 00:23:17.942 02:42:51 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:23:17.942 02:42:51 -- host/auth.sh@48 -- # echo ffdhe2048 00:23:17.942 02:42:51 -- host/auth.sh@49 -- # echo DHHC-1:01:Nzc2MWE1MjViOTA5OTUxOTRiZTEwNzExNDRkZjA4NWPly9CM: 00:23:17.942 02:42:51 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 2 00:23:17.942 02:42:51 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:17.942 02:42:51 -- host/auth.sh@68 -- # digest=sha256 00:23:17.942 02:42:51 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:23:17.942 02:42:51 -- host/auth.sh@68 -- # keyid=2 00:23:17.942 02:42:51 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:23:17.942 02:42:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:17.942 02:42:51 -- common/autotest_common.sh@10 -- # set +x 00:23:17.942 02:42:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:17.942 02:42:51 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:17.942 02:42:51 -- nvmf/common.sh@717 -- # local ip 00:23:17.942 02:42:51 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:17.942 02:42:51 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:17.942 02:42:51 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:17.942 02:42:51 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:17.942 02:42:51 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:17.942 02:42:51 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:17.942 02:42:51 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:17.942 02:42:51 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:17.942 02:42:51 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:17.942 02:42:51 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:23:17.942 02:42:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:17.942 02:42:51 -- common/autotest_common.sh@10 -- # set +x 00:23:18.199 nvme0n1 00:23:18.199 02:42:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:18.199 02:42:51 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:18.199 02:42:51 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:18.199 02:42:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:18.199 02:42:51 -- common/autotest_common.sh@10 -- # set +x 00:23:18.199 02:42:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:18.199 02:42:51 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:18.199 02:42:51 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:18.199 02:42:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:18.199 02:42:51 -- common/autotest_common.sh@10 -- # set +x 00:23:18.199 02:42:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:18.199 02:42:51 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:18.199 02:42:51 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 3 00:23:18.199 02:42:51 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:18.199 02:42:51 -- host/auth.sh@44 -- # digest=sha256 00:23:18.199 02:42:51 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:23:18.199 02:42:51 -- host/auth.sh@44 -- # keyid=3 00:23:18.199 02:42:51 -- host/auth.sh@45 -- # key=DHHC-1:02:MzVhNzA3ZGQ0OWE0ZmYyZWI0ZjljYzljNTEyNGI3NjhkNGQ5MDM3YzVlZTFkZjY01CDZag==: 00:23:18.199 02:42:51 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:23:18.199 02:42:51 -- host/auth.sh@48 -- # echo ffdhe2048 00:23:18.199 02:42:51 -- host/auth.sh@49 -- # echo DHHC-1:02:MzVhNzA3ZGQ0OWE0ZmYyZWI0ZjljYzljNTEyNGI3NjhkNGQ5MDM3YzVlZTFkZjY01CDZag==: 00:23:18.199 02:42:51 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 3 00:23:18.199 02:42:51 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:18.199 02:42:51 -- host/auth.sh@68 -- # digest=sha256 00:23:18.199 02:42:51 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:23:18.199 02:42:51 -- host/auth.sh@68 -- # keyid=3 00:23:18.199 02:42:51 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:23:18.199 02:42:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:18.199 02:42:51 -- common/autotest_common.sh@10 -- # set +x 00:23:18.199 02:42:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:18.199 02:42:51 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:18.199 02:42:51 -- nvmf/common.sh@717 -- # local ip 00:23:18.199 02:42:51 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:18.199 02:42:51 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:18.199 02:42:51 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:18.199 02:42:51 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:18.199 02:42:51 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:18.199 02:42:51 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:18.199 02:42:51 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:18.199 02:42:51 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:18.199 02:42:51 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:18.199 02:42:51 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:23:18.199 02:42:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:18.199 02:42:51 -- common/autotest_common.sh@10 -- # set +x 00:23:18.456 nvme0n1 00:23:18.456 02:42:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:18.456 02:42:51 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:18.456 02:42:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:18.456 02:42:51 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:18.456 02:42:51 -- common/autotest_common.sh@10 -- # set +x 00:23:18.456 02:42:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:18.456 02:42:51 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:18.456 02:42:51 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:18.456 02:42:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:18.456 02:42:51 -- common/autotest_common.sh@10 -- # set +x 00:23:18.456 02:42:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:18.456 02:42:51 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:18.456 02:42:51 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 4 00:23:18.456 02:42:51 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:18.456 02:42:51 -- host/auth.sh@44 -- # digest=sha256 00:23:18.456 02:42:51 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:23:18.456 02:42:51 -- host/auth.sh@44 -- # keyid=4 00:23:18.456 02:42:51 -- host/auth.sh@45 -- # key=DHHC-1:03:OTk1NGRkYTBiMjBhMTc1MDg4MTViNDFhYTQ4ZjhjM2M5MDM0NzcyM2RkYTU0NWYxNTMwZWI0M2NiZjQ0NTBmNAr9IOk=: 00:23:18.456 02:42:52 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:23:18.456 02:42:52 -- host/auth.sh@48 -- # echo ffdhe2048 00:23:18.456 02:42:52 -- host/auth.sh@49 -- # echo DHHC-1:03:OTk1NGRkYTBiMjBhMTc1MDg4MTViNDFhYTQ4ZjhjM2M5MDM0NzcyM2RkYTU0NWYxNTMwZWI0M2NiZjQ0NTBmNAr9IOk=: 00:23:18.456 02:42:52 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 4 00:23:18.456 02:42:52 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:18.456 02:42:52 -- host/auth.sh@68 -- # digest=sha256 00:23:18.456 02:42:52 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:23:18.456 02:42:52 -- host/auth.sh@68 -- # keyid=4 00:23:18.456 02:42:52 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:23:18.456 02:42:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:18.456 02:42:52 -- common/autotest_common.sh@10 -- # set +x 00:23:18.456 02:42:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:18.456 02:42:52 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:18.456 02:42:52 -- nvmf/common.sh@717 -- # local ip 00:23:18.456 02:42:52 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:18.456 02:42:52 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:18.456 02:42:52 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:18.456 02:42:52 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:18.456 02:42:52 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:18.456 02:42:52 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:18.456 02:42:52 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:18.456 02:42:52 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:18.456 02:42:52 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:18.456 02:42:52 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:23:18.456 02:42:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:18.456 02:42:52 -- common/autotest_common.sh@10 -- # set +x 00:23:18.714 nvme0n1 00:23:18.714 02:42:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:18.714 02:42:52 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:18.714 02:42:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:18.714 02:42:52 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:18.714 02:42:52 -- common/autotest_common.sh@10 -- # set +x 00:23:18.714 02:42:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:18.714 02:42:52 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:18.714 02:42:52 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:18.714 02:42:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:18.714 02:42:52 -- common/autotest_common.sh@10 -- # set +x 00:23:18.714 02:42:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:18.714 02:42:52 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:23:18.714 02:42:52 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:18.714 02:42:52 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 0 00:23:18.714 02:42:52 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:18.714 02:42:52 -- host/auth.sh@44 -- # digest=sha256 00:23:18.714 02:42:52 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:23:18.714 02:42:52 -- host/auth.sh@44 -- # keyid=0 00:23:18.714 02:42:52 -- host/auth.sh@45 -- # key=DHHC-1:00:YTVhYTdhYjViMDJmMjYzMzBjOTQ4NDg5NzM3YTI2Zjb26OQB: 00:23:18.714 02:42:52 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:23:18.714 02:42:52 -- host/auth.sh@48 -- # echo ffdhe3072 00:23:18.714 02:42:52 -- host/auth.sh@49 -- # echo DHHC-1:00:YTVhYTdhYjViMDJmMjYzMzBjOTQ4NDg5NzM3YTI2Zjb26OQB: 00:23:18.714 02:42:52 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 0 00:23:18.714 02:42:52 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:18.714 02:42:52 -- host/auth.sh@68 -- # digest=sha256 00:23:18.714 02:42:52 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:23:18.714 02:42:52 -- host/auth.sh@68 -- # keyid=0 00:23:18.714 02:42:52 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:23:18.714 02:42:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:18.714 02:42:52 -- common/autotest_common.sh@10 -- # set +x 00:23:18.714 02:42:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:18.714 02:42:52 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:18.714 02:42:52 -- nvmf/common.sh@717 -- # local ip 00:23:18.714 02:42:52 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:18.714 02:42:52 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:18.714 02:42:52 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:18.714 02:42:52 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:18.714 02:42:52 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:18.714 02:42:52 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:18.714 02:42:52 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:18.714 02:42:52 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:18.714 02:42:52 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:18.714 02:42:52 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:23:18.714 02:42:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:18.714 02:42:52 -- common/autotest_common.sh@10 -- # set +x 00:23:18.972 nvme0n1 00:23:18.972 02:42:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:18.972 02:42:52 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:18.972 02:42:52 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:18.972 02:42:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:18.972 02:42:52 -- common/autotest_common.sh@10 -- # set +x 00:23:18.972 02:42:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:18.972 02:42:52 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:18.972 02:42:52 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:18.972 02:42:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:18.972 02:42:52 -- common/autotest_common.sh@10 -- # set +x 00:23:18.972 02:42:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:18.972 02:42:52 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:18.972 02:42:52 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 1 00:23:18.972 02:42:52 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:18.972 02:42:52 -- host/auth.sh@44 -- # digest=sha256 00:23:18.972 02:42:52 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:23:18.972 02:42:52 -- host/auth.sh@44 -- # keyid=1 00:23:18.972 02:42:52 -- host/auth.sh@45 -- # key=DHHC-1:00:ODhjNjQ1NGFlZDFlNTJhNThiZTc2ZWY4NmI5NzRmNTI2M2U1Y2VhOWEwNjI5NjJiyej8LQ==: 00:23:18.972 02:42:52 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:23:18.972 02:42:52 -- host/auth.sh@48 -- # echo ffdhe3072 00:23:18.972 02:42:52 -- host/auth.sh@49 -- # echo DHHC-1:00:ODhjNjQ1NGFlZDFlNTJhNThiZTc2ZWY4NmI5NzRmNTI2M2U1Y2VhOWEwNjI5NjJiyej8LQ==: 00:23:18.972 02:42:52 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 1 00:23:18.972 02:42:52 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:18.972 02:42:52 -- host/auth.sh@68 -- # digest=sha256 00:23:18.972 02:42:52 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:23:18.972 02:42:52 -- host/auth.sh@68 -- # keyid=1 00:23:18.972 02:42:52 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:23:18.972 02:42:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:18.972 02:42:52 -- common/autotest_common.sh@10 -- # set +x 00:23:18.972 02:42:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:18.972 02:42:52 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:18.972 02:42:52 -- nvmf/common.sh@717 -- # local ip 00:23:18.972 02:42:52 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:18.972 02:42:52 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:18.972 02:42:52 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:18.972 02:42:52 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:18.972 02:42:52 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:18.972 02:42:52 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:18.972 02:42:52 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:18.972 02:42:52 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:18.972 02:42:52 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:18.972 02:42:52 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:23:18.972 02:42:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:18.972 02:42:52 -- common/autotest_common.sh@10 -- # set +x 00:23:19.230 nvme0n1 00:23:19.230 02:42:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:19.230 02:42:52 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:19.230 02:42:52 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:19.230 02:42:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:19.230 02:42:52 -- common/autotest_common.sh@10 -- # set +x 00:23:19.230 02:42:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:19.230 02:42:52 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:19.230 02:42:52 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:19.230 02:42:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:19.230 02:42:52 -- common/autotest_common.sh@10 -- # set +x 00:23:19.230 02:42:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:19.230 02:42:52 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:19.230 02:42:52 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 2 00:23:19.230 02:42:52 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:19.230 02:42:52 -- host/auth.sh@44 -- # digest=sha256 00:23:19.230 02:42:52 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:23:19.230 02:42:52 -- host/auth.sh@44 -- # keyid=2 00:23:19.230 02:42:52 -- host/auth.sh@45 -- # key=DHHC-1:01:Nzc2MWE1MjViOTA5OTUxOTRiZTEwNzExNDRkZjA4NWPly9CM: 00:23:19.230 02:42:52 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:23:19.230 02:42:52 -- host/auth.sh@48 -- # echo ffdhe3072 00:23:19.494 02:42:52 -- host/auth.sh@49 -- # echo DHHC-1:01:Nzc2MWE1MjViOTA5OTUxOTRiZTEwNzExNDRkZjA4NWPly9CM: 00:23:19.494 02:42:52 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 2 00:23:19.494 02:42:52 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:19.494 02:42:52 -- host/auth.sh@68 -- # digest=sha256 00:23:19.494 02:42:52 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:23:19.494 02:42:52 -- host/auth.sh@68 -- # keyid=2 00:23:19.494 02:42:52 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:23:19.494 02:42:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:19.494 02:42:52 -- common/autotest_common.sh@10 -- # set +x 00:23:19.494 02:42:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:19.494 02:42:52 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:19.494 02:42:52 -- nvmf/common.sh@717 -- # local ip 00:23:19.494 02:42:52 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:19.494 02:42:52 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:19.494 02:42:52 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:19.494 02:42:52 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:19.494 02:42:52 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:19.494 02:42:52 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:19.494 02:42:52 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:19.494 02:42:52 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:19.494 02:42:52 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:19.494 02:42:52 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:23:19.494 02:42:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:19.494 02:42:52 -- common/autotest_common.sh@10 -- # set +x 00:23:19.494 nvme0n1 00:23:19.494 02:42:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:19.494 02:42:53 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:19.494 02:42:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:19.494 02:42:53 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:19.494 02:42:53 -- common/autotest_common.sh@10 -- # set +x 00:23:19.494 02:42:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:19.494 02:42:53 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:19.494 02:42:53 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:19.494 02:42:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:19.494 02:42:53 -- common/autotest_common.sh@10 -- # set +x 00:23:19.751 02:42:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:19.751 02:42:53 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:19.751 02:42:53 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 3 00:23:19.751 02:42:53 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:19.751 02:42:53 -- host/auth.sh@44 -- # digest=sha256 00:23:19.751 02:42:53 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:23:19.751 02:42:53 -- host/auth.sh@44 -- # keyid=3 00:23:19.751 02:42:53 -- host/auth.sh@45 -- # key=DHHC-1:02:MzVhNzA3ZGQ0OWE0ZmYyZWI0ZjljYzljNTEyNGI3NjhkNGQ5MDM3YzVlZTFkZjY01CDZag==: 00:23:19.751 02:42:53 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:23:19.751 02:42:53 -- host/auth.sh@48 -- # echo ffdhe3072 00:23:19.751 02:42:53 -- host/auth.sh@49 -- # echo DHHC-1:02:MzVhNzA3ZGQ0OWE0ZmYyZWI0ZjljYzljNTEyNGI3NjhkNGQ5MDM3YzVlZTFkZjY01CDZag==: 00:23:19.751 02:42:53 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 3 00:23:19.751 02:42:53 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:19.751 02:42:53 -- host/auth.sh@68 -- # digest=sha256 00:23:19.751 02:42:53 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:23:19.751 02:42:53 -- host/auth.sh@68 -- # keyid=3 00:23:19.751 02:42:53 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:23:19.751 02:42:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:19.751 02:42:53 -- common/autotest_common.sh@10 -- # set +x 00:23:19.751 02:42:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:19.752 02:42:53 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:19.752 02:42:53 -- nvmf/common.sh@717 -- # local ip 00:23:19.752 02:42:53 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:19.752 02:42:53 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:19.752 02:42:53 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:19.752 02:42:53 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:19.752 02:42:53 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:19.752 02:42:53 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:19.752 02:42:53 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:19.752 02:42:53 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:19.752 02:42:53 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:19.752 02:42:53 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:23:19.752 02:42:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:19.752 02:42:53 -- common/autotest_common.sh@10 -- # set +x 00:23:19.752 nvme0n1 00:23:19.752 02:42:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:19.752 02:42:53 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:19.752 02:42:53 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:19.752 02:42:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:19.752 02:42:53 -- common/autotest_common.sh@10 -- # set +x 00:23:19.752 02:42:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:20.009 02:42:53 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:20.009 02:42:53 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:20.009 02:42:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:20.009 02:42:53 -- common/autotest_common.sh@10 -- # set +x 00:23:20.009 02:42:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:20.009 02:42:53 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:20.009 02:42:53 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 4 00:23:20.009 02:42:53 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:20.009 02:42:53 -- host/auth.sh@44 -- # digest=sha256 00:23:20.009 02:42:53 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:23:20.009 02:42:53 -- host/auth.sh@44 -- # keyid=4 00:23:20.009 02:42:53 -- host/auth.sh@45 -- # key=DHHC-1:03:OTk1NGRkYTBiMjBhMTc1MDg4MTViNDFhYTQ4ZjhjM2M5MDM0NzcyM2RkYTU0NWYxNTMwZWI0M2NiZjQ0NTBmNAr9IOk=: 00:23:20.009 02:42:53 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:23:20.009 02:42:53 -- host/auth.sh@48 -- # echo ffdhe3072 00:23:20.009 02:42:53 -- host/auth.sh@49 -- # echo DHHC-1:03:OTk1NGRkYTBiMjBhMTc1MDg4MTViNDFhYTQ4ZjhjM2M5MDM0NzcyM2RkYTU0NWYxNTMwZWI0M2NiZjQ0NTBmNAr9IOk=: 00:23:20.009 02:42:53 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 4 00:23:20.009 02:42:53 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:20.009 02:42:53 -- host/auth.sh@68 -- # digest=sha256 00:23:20.009 02:42:53 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:23:20.009 02:42:53 -- host/auth.sh@68 -- # keyid=4 00:23:20.009 02:42:53 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:23:20.009 02:42:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:20.009 02:42:53 -- common/autotest_common.sh@10 -- # set +x 00:23:20.009 02:42:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:20.009 02:42:53 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:20.009 02:42:53 -- nvmf/common.sh@717 -- # local ip 00:23:20.009 02:42:53 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:20.009 02:42:53 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:20.009 02:42:53 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:20.009 02:42:53 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:20.009 02:42:53 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:20.009 02:42:53 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:20.009 02:42:53 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:20.010 02:42:53 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:20.010 02:42:53 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:20.010 02:42:53 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:23:20.010 02:42:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:20.010 02:42:53 -- common/autotest_common.sh@10 -- # set +x 00:23:20.268 nvme0n1 00:23:20.268 02:42:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:20.268 02:42:53 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:20.268 02:42:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:20.268 02:42:53 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:20.268 02:42:53 -- common/autotest_common.sh@10 -- # set +x 00:23:20.268 02:42:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:20.268 02:42:53 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:20.268 02:42:53 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:20.268 02:42:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:20.268 02:42:53 -- common/autotest_common.sh@10 -- # set +x 00:23:20.268 02:42:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:20.268 02:42:53 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:23:20.268 02:42:53 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:20.268 02:42:53 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 0 00:23:20.268 02:42:53 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:20.268 02:42:53 -- host/auth.sh@44 -- # digest=sha256 00:23:20.268 02:42:53 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:23:20.268 02:42:53 -- host/auth.sh@44 -- # keyid=0 00:23:20.268 02:42:53 -- host/auth.sh@45 -- # key=DHHC-1:00:YTVhYTdhYjViMDJmMjYzMzBjOTQ4NDg5NzM3YTI2Zjb26OQB: 00:23:20.268 02:42:53 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:23:20.268 02:42:53 -- host/auth.sh@48 -- # echo ffdhe4096 00:23:20.268 02:42:53 -- host/auth.sh@49 -- # echo DHHC-1:00:YTVhYTdhYjViMDJmMjYzMzBjOTQ4NDg5NzM3YTI2Zjb26OQB: 00:23:20.268 02:42:53 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 0 00:23:20.268 02:42:53 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:20.268 02:42:53 -- host/auth.sh@68 -- # digest=sha256 00:23:20.268 02:42:53 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:23:20.268 02:42:53 -- host/auth.sh@68 -- # keyid=0 00:23:20.268 02:42:53 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:23:20.268 02:42:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:20.268 02:42:53 -- common/autotest_common.sh@10 -- # set +x 00:23:20.268 02:42:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:20.268 02:42:53 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:20.268 02:42:53 -- nvmf/common.sh@717 -- # local ip 00:23:20.268 02:42:53 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:20.268 02:42:53 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:20.268 02:42:53 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:20.268 02:42:53 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:20.268 02:42:53 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:20.268 02:42:53 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:20.268 02:42:53 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:20.268 02:42:53 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:20.268 02:42:53 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:20.268 02:42:53 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:23:20.268 02:42:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:20.268 02:42:53 -- common/autotest_common.sh@10 -- # set +x 00:23:20.527 nvme0n1 00:23:20.527 02:42:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:20.527 02:42:53 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:20.527 02:42:53 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:20.527 02:42:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:20.527 02:42:53 -- common/autotest_common.sh@10 -- # set +x 00:23:20.527 02:42:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:20.527 02:42:54 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:20.527 02:42:54 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:20.527 02:42:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:20.527 02:42:54 -- common/autotest_common.sh@10 -- # set +x 00:23:20.527 02:42:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:20.527 02:42:54 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:20.527 02:42:54 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 1 00:23:20.527 02:42:54 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:20.527 02:42:54 -- host/auth.sh@44 -- # digest=sha256 00:23:20.527 02:42:54 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:23:20.527 02:42:54 -- host/auth.sh@44 -- # keyid=1 00:23:20.527 02:42:54 -- host/auth.sh@45 -- # key=DHHC-1:00:ODhjNjQ1NGFlZDFlNTJhNThiZTc2ZWY4NmI5NzRmNTI2M2U1Y2VhOWEwNjI5NjJiyej8LQ==: 00:23:20.527 02:42:54 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:23:20.527 02:42:54 -- host/auth.sh@48 -- # echo ffdhe4096 00:23:20.527 02:42:54 -- host/auth.sh@49 -- # echo DHHC-1:00:ODhjNjQ1NGFlZDFlNTJhNThiZTc2ZWY4NmI5NzRmNTI2M2U1Y2VhOWEwNjI5NjJiyej8LQ==: 00:23:20.527 02:42:54 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 1 00:23:20.527 02:42:54 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:20.527 02:42:54 -- host/auth.sh@68 -- # digest=sha256 00:23:20.527 02:42:54 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:23:20.527 02:42:54 -- host/auth.sh@68 -- # keyid=1 00:23:20.527 02:42:54 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:23:20.527 02:42:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:20.527 02:42:54 -- common/autotest_common.sh@10 -- # set +x 00:23:20.527 02:42:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:20.527 02:42:54 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:20.527 02:42:54 -- nvmf/common.sh@717 -- # local ip 00:23:20.527 02:42:54 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:20.527 02:42:54 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:20.527 02:42:54 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:20.527 02:42:54 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:20.527 02:42:54 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:20.527 02:42:54 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:20.527 02:42:54 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:20.527 02:42:54 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:20.527 02:42:54 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:20.527 02:42:54 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:23:20.527 02:42:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:20.527 02:42:54 -- common/autotest_common.sh@10 -- # set +x 00:23:20.790 nvme0n1 00:23:20.790 02:42:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:20.790 02:42:54 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:20.790 02:42:54 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:20.790 02:42:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:20.790 02:42:54 -- common/autotest_common.sh@10 -- # set +x 00:23:20.790 02:42:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:20.790 02:42:54 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:20.790 02:42:54 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:20.790 02:42:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:20.790 02:42:54 -- common/autotest_common.sh@10 -- # set +x 00:23:20.790 02:42:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:20.790 02:42:54 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:20.790 02:42:54 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 2 00:23:20.790 02:42:54 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:20.790 02:42:54 -- host/auth.sh@44 -- # digest=sha256 00:23:20.790 02:42:54 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:23:20.790 02:42:54 -- host/auth.sh@44 -- # keyid=2 00:23:20.790 02:42:54 -- host/auth.sh@45 -- # key=DHHC-1:01:Nzc2MWE1MjViOTA5OTUxOTRiZTEwNzExNDRkZjA4NWPly9CM: 00:23:20.790 02:42:54 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:23:20.790 02:42:54 -- host/auth.sh@48 -- # echo ffdhe4096 00:23:20.790 02:42:54 -- host/auth.sh@49 -- # echo DHHC-1:01:Nzc2MWE1MjViOTA5OTUxOTRiZTEwNzExNDRkZjA4NWPly9CM: 00:23:20.790 02:42:54 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 2 00:23:20.790 02:42:54 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:20.790 02:42:54 -- host/auth.sh@68 -- # digest=sha256 00:23:20.790 02:42:54 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:23:20.790 02:42:54 -- host/auth.sh@68 -- # keyid=2 00:23:20.790 02:42:54 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:23:20.790 02:42:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:20.790 02:42:54 -- common/autotest_common.sh@10 -- # set +x 00:23:20.790 02:42:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:20.790 02:42:54 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:20.790 02:42:54 -- nvmf/common.sh@717 -- # local ip 00:23:20.790 02:42:54 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:20.790 02:42:54 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:20.790 02:42:54 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:20.790 02:42:54 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:20.790 02:42:54 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:20.790 02:42:54 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:20.790 02:42:54 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:20.790 02:42:54 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:20.790 02:42:54 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:20.790 02:42:54 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:23:20.790 02:42:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:20.790 02:42:54 -- common/autotest_common.sh@10 -- # set +x 00:23:21.086 nvme0n1 00:23:21.086 02:42:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:21.086 02:42:54 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:21.086 02:42:54 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:21.086 02:42:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:21.086 02:42:54 -- common/autotest_common.sh@10 -- # set +x 00:23:21.086 02:42:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:21.355 02:42:54 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:21.355 02:42:54 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:21.355 02:42:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:21.355 02:42:54 -- common/autotest_common.sh@10 -- # set +x 00:23:21.355 02:42:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:21.355 02:42:54 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:21.355 02:42:54 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 3 00:23:21.355 02:42:54 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:21.355 02:42:54 -- host/auth.sh@44 -- # digest=sha256 00:23:21.355 02:42:54 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:23:21.355 02:42:54 -- host/auth.sh@44 -- # keyid=3 00:23:21.355 02:42:54 -- host/auth.sh@45 -- # key=DHHC-1:02:MzVhNzA3ZGQ0OWE0ZmYyZWI0ZjljYzljNTEyNGI3NjhkNGQ5MDM3YzVlZTFkZjY01CDZag==: 00:23:21.355 02:42:54 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:23:21.355 02:42:54 -- host/auth.sh@48 -- # echo ffdhe4096 00:23:21.355 02:42:54 -- host/auth.sh@49 -- # echo DHHC-1:02:MzVhNzA3ZGQ0OWE0ZmYyZWI0ZjljYzljNTEyNGI3NjhkNGQ5MDM3YzVlZTFkZjY01CDZag==: 00:23:21.355 02:42:54 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 3 00:23:21.355 02:42:54 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:21.355 02:42:54 -- host/auth.sh@68 -- # digest=sha256 00:23:21.355 02:42:54 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:23:21.355 02:42:54 -- host/auth.sh@68 -- # keyid=3 00:23:21.355 02:42:54 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:23:21.355 02:42:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:21.355 02:42:54 -- common/autotest_common.sh@10 -- # set +x 00:23:21.355 02:42:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:21.355 02:42:54 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:21.355 02:42:54 -- nvmf/common.sh@717 -- # local ip 00:23:21.355 02:42:54 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:21.355 02:42:54 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:21.355 02:42:54 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:21.355 02:42:54 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:21.355 02:42:54 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:21.355 02:42:54 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:21.355 02:42:54 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:21.355 02:42:54 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:21.355 02:42:54 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:21.355 02:42:54 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:23:21.355 02:42:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:21.355 02:42:54 -- common/autotest_common.sh@10 -- # set +x 00:23:21.613 nvme0n1 00:23:21.613 02:42:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:21.613 02:42:54 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:21.613 02:42:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:21.613 02:42:54 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:21.613 02:42:54 -- common/autotest_common.sh@10 -- # set +x 00:23:21.614 02:42:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:21.614 02:42:55 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:21.614 02:42:55 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:21.614 02:42:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:21.614 02:42:55 -- common/autotest_common.sh@10 -- # set +x 00:23:21.614 02:42:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:21.614 02:42:55 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:21.614 02:42:55 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 4 00:23:21.614 02:42:55 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:21.614 02:42:55 -- host/auth.sh@44 -- # digest=sha256 00:23:21.614 02:42:55 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:23:21.614 02:42:55 -- host/auth.sh@44 -- # keyid=4 00:23:21.614 02:42:55 -- host/auth.sh@45 -- # key=DHHC-1:03:OTk1NGRkYTBiMjBhMTc1MDg4MTViNDFhYTQ4ZjhjM2M5MDM0NzcyM2RkYTU0NWYxNTMwZWI0M2NiZjQ0NTBmNAr9IOk=: 00:23:21.614 02:42:55 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:23:21.614 02:42:55 -- host/auth.sh@48 -- # echo ffdhe4096 00:23:21.614 02:42:55 -- host/auth.sh@49 -- # echo DHHC-1:03:OTk1NGRkYTBiMjBhMTc1MDg4MTViNDFhYTQ4ZjhjM2M5MDM0NzcyM2RkYTU0NWYxNTMwZWI0M2NiZjQ0NTBmNAr9IOk=: 00:23:21.614 02:42:55 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 4 00:23:21.614 02:42:55 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:21.614 02:42:55 -- host/auth.sh@68 -- # digest=sha256 00:23:21.614 02:42:55 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:23:21.614 02:42:55 -- host/auth.sh@68 -- # keyid=4 00:23:21.614 02:42:55 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:23:21.614 02:42:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:21.614 02:42:55 -- common/autotest_common.sh@10 -- # set +x 00:23:21.614 02:42:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:21.614 02:42:55 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:21.614 02:42:55 -- nvmf/common.sh@717 -- # local ip 00:23:21.614 02:42:55 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:21.614 02:42:55 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:21.614 02:42:55 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:21.614 02:42:55 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:21.614 02:42:55 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:21.614 02:42:55 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:21.614 02:42:55 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:21.614 02:42:55 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:21.614 02:42:55 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:21.614 02:42:55 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:23:21.614 02:42:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:21.614 02:42:55 -- common/autotest_common.sh@10 -- # set +x 00:23:21.872 nvme0n1 00:23:21.872 02:42:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:21.872 02:42:55 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:21.872 02:42:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:21.872 02:42:55 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:21.872 02:42:55 -- common/autotest_common.sh@10 -- # set +x 00:23:21.872 02:42:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:21.872 02:42:55 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:21.872 02:42:55 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:21.872 02:42:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:21.872 02:42:55 -- common/autotest_common.sh@10 -- # set +x 00:23:21.872 02:42:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:21.872 02:42:55 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:23:21.872 02:42:55 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:21.872 02:42:55 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 0 00:23:21.872 02:42:55 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:21.872 02:42:55 -- host/auth.sh@44 -- # digest=sha256 00:23:21.872 02:42:55 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:23:21.872 02:42:55 -- host/auth.sh@44 -- # keyid=0 00:23:21.872 02:42:55 -- host/auth.sh@45 -- # key=DHHC-1:00:YTVhYTdhYjViMDJmMjYzMzBjOTQ4NDg5NzM3YTI2Zjb26OQB: 00:23:21.872 02:42:55 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:23:21.872 02:42:55 -- host/auth.sh@48 -- # echo ffdhe6144 00:23:21.872 02:42:55 -- host/auth.sh@49 -- # echo DHHC-1:00:YTVhYTdhYjViMDJmMjYzMzBjOTQ4NDg5NzM3YTI2Zjb26OQB: 00:23:21.872 02:42:55 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 0 00:23:21.872 02:42:55 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:21.872 02:42:55 -- host/auth.sh@68 -- # digest=sha256 00:23:21.872 02:42:55 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:23:21.872 02:42:55 -- host/auth.sh@68 -- # keyid=0 00:23:21.872 02:42:55 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:23:21.872 02:42:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:21.872 02:42:55 -- common/autotest_common.sh@10 -- # set +x 00:23:21.872 02:42:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:21.872 02:42:55 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:21.872 02:42:55 -- nvmf/common.sh@717 -- # local ip 00:23:21.872 02:42:55 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:21.872 02:42:55 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:21.872 02:42:55 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:21.872 02:42:55 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:21.872 02:42:55 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:21.872 02:42:55 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:21.872 02:42:55 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:21.872 02:42:55 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:21.872 02:42:55 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:21.872 02:42:55 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:23:21.872 02:42:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:21.872 02:42:55 -- common/autotest_common.sh@10 -- # set +x 00:23:22.437 nvme0n1 00:23:22.437 02:42:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:22.437 02:42:55 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:22.437 02:42:55 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:22.437 02:42:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:22.437 02:42:55 -- common/autotest_common.sh@10 -- # set +x 00:23:22.437 02:42:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:22.437 02:42:55 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:22.437 02:42:55 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:22.437 02:42:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:22.437 02:42:55 -- common/autotest_common.sh@10 -- # set +x 00:23:22.437 02:42:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:22.437 02:42:55 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:22.437 02:42:55 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 1 00:23:22.437 02:42:55 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:22.437 02:42:55 -- host/auth.sh@44 -- # digest=sha256 00:23:22.437 02:42:55 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:23:22.437 02:42:55 -- host/auth.sh@44 -- # keyid=1 00:23:22.437 02:42:55 -- host/auth.sh@45 -- # key=DHHC-1:00:ODhjNjQ1NGFlZDFlNTJhNThiZTc2ZWY4NmI5NzRmNTI2M2U1Y2VhOWEwNjI5NjJiyej8LQ==: 00:23:22.437 02:42:55 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:23:22.437 02:42:55 -- host/auth.sh@48 -- # echo ffdhe6144 00:23:22.437 02:42:55 -- host/auth.sh@49 -- # echo DHHC-1:00:ODhjNjQ1NGFlZDFlNTJhNThiZTc2ZWY4NmI5NzRmNTI2M2U1Y2VhOWEwNjI5NjJiyej8LQ==: 00:23:22.437 02:42:55 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 1 00:23:22.437 02:42:55 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:22.437 02:42:55 -- host/auth.sh@68 -- # digest=sha256 00:23:22.437 02:42:55 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:23:22.437 02:42:55 -- host/auth.sh@68 -- # keyid=1 00:23:22.437 02:42:55 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:23:22.437 02:42:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:22.437 02:42:55 -- common/autotest_common.sh@10 -- # set +x 00:23:22.437 02:42:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:22.437 02:42:55 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:22.437 02:42:55 -- nvmf/common.sh@717 -- # local ip 00:23:22.437 02:42:55 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:22.437 02:42:55 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:22.437 02:42:55 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:22.437 02:42:55 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:22.437 02:42:55 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:22.437 02:42:55 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:22.437 02:42:55 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:22.437 02:42:55 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:22.437 02:42:55 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:22.437 02:42:55 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:23:22.437 02:42:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:22.437 02:42:55 -- common/autotest_common.sh@10 -- # set +x 00:23:22.694 nvme0n1 00:23:22.694 02:42:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:22.694 02:42:56 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:22.694 02:42:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:22.694 02:42:56 -- common/autotest_common.sh@10 -- # set +x 00:23:22.694 02:42:56 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:22.694 02:42:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:22.694 02:42:56 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:22.694 02:42:56 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:22.694 02:42:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:22.694 02:42:56 -- common/autotest_common.sh@10 -- # set +x 00:23:22.694 02:42:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:22.694 02:42:56 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:22.694 02:42:56 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 2 00:23:22.694 02:42:56 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:22.694 02:42:56 -- host/auth.sh@44 -- # digest=sha256 00:23:22.951 02:42:56 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:23:22.951 02:42:56 -- host/auth.sh@44 -- # keyid=2 00:23:22.951 02:42:56 -- host/auth.sh@45 -- # key=DHHC-1:01:Nzc2MWE1MjViOTA5OTUxOTRiZTEwNzExNDRkZjA4NWPly9CM: 00:23:22.951 02:42:56 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:23:22.951 02:42:56 -- host/auth.sh@48 -- # echo ffdhe6144 00:23:22.951 02:42:56 -- host/auth.sh@49 -- # echo DHHC-1:01:Nzc2MWE1MjViOTA5OTUxOTRiZTEwNzExNDRkZjA4NWPly9CM: 00:23:22.951 02:42:56 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 2 00:23:22.951 02:42:56 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:22.951 02:42:56 -- host/auth.sh@68 -- # digest=sha256 00:23:22.951 02:42:56 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:23:22.951 02:42:56 -- host/auth.sh@68 -- # keyid=2 00:23:22.951 02:42:56 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:23:22.951 02:42:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:22.951 02:42:56 -- common/autotest_common.sh@10 -- # set +x 00:23:22.951 02:42:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:22.951 02:42:56 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:22.951 02:42:56 -- nvmf/common.sh@717 -- # local ip 00:23:22.951 02:42:56 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:22.951 02:42:56 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:22.951 02:42:56 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:22.951 02:42:56 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:22.951 02:42:56 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:22.951 02:42:56 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:22.951 02:42:56 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:22.951 02:42:56 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:22.951 02:42:56 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:22.951 02:42:56 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:23:22.951 02:42:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:22.951 02:42:56 -- common/autotest_common.sh@10 -- # set +x 00:23:23.208 nvme0n1 00:23:23.208 02:42:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:23.208 02:42:56 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:23.208 02:42:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:23.208 02:42:56 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:23.208 02:42:56 -- common/autotest_common.sh@10 -- # set +x 00:23:23.208 02:42:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:23.208 02:42:56 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:23.208 02:42:56 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:23.208 02:42:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:23.208 02:42:56 -- common/autotest_common.sh@10 -- # set +x 00:23:23.208 02:42:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:23.208 02:42:56 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:23.208 02:42:56 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 3 00:23:23.208 02:42:56 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:23.208 02:42:56 -- host/auth.sh@44 -- # digest=sha256 00:23:23.208 02:42:56 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:23:23.208 02:42:56 -- host/auth.sh@44 -- # keyid=3 00:23:23.208 02:42:56 -- host/auth.sh@45 -- # key=DHHC-1:02:MzVhNzA3ZGQ0OWE0ZmYyZWI0ZjljYzljNTEyNGI3NjhkNGQ5MDM3YzVlZTFkZjY01CDZag==: 00:23:23.208 02:42:56 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:23:23.208 02:42:56 -- host/auth.sh@48 -- # echo ffdhe6144 00:23:23.208 02:42:56 -- host/auth.sh@49 -- # echo DHHC-1:02:MzVhNzA3ZGQ0OWE0ZmYyZWI0ZjljYzljNTEyNGI3NjhkNGQ5MDM3YzVlZTFkZjY01CDZag==: 00:23:23.208 02:42:56 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 3 00:23:23.208 02:42:56 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:23.208 02:42:56 -- host/auth.sh@68 -- # digest=sha256 00:23:23.208 02:42:56 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:23:23.208 02:42:56 -- host/auth.sh@68 -- # keyid=3 00:23:23.208 02:42:56 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:23:23.208 02:42:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:23.208 02:42:56 -- common/autotest_common.sh@10 -- # set +x 00:23:23.208 02:42:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:23.208 02:42:56 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:23.208 02:42:56 -- nvmf/common.sh@717 -- # local ip 00:23:23.208 02:42:56 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:23.208 02:42:56 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:23.208 02:42:56 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:23.208 02:42:56 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:23.208 02:42:56 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:23.208 02:42:56 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:23.208 02:42:56 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:23.208 02:42:56 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:23.208 02:42:56 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:23.209 02:42:56 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:23:23.209 02:42:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:23.209 02:42:56 -- common/autotest_common.sh@10 -- # set +x 00:23:23.773 nvme0n1 00:23:23.773 02:42:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:23.773 02:42:57 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:23.773 02:42:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:23.773 02:42:57 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:23.773 02:42:57 -- common/autotest_common.sh@10 -- # set +x 00:23:23.773 02:42:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:23.773 02:42:57 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:23.773 02:42:57 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:23.773 02:42:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:23.773 02:42:57 -- common/autotest_common.sh@10 -- # set +x 00:23:23.773 02:42:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:23.773 02:42:57 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:23.773 02:42:57 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 4 00:23:23.773 02:42:57 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:23.773 02:42:57 -- host/auth.sh@44 -- # digest=sha256 00:23:23.773 02:42:57 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:23:23.773 02:42:57 -- host/auth.sh@44 -- # keyid=4 00:23:23.773 02:42:57 -- host/auth.sh@45 -- # key=DHHC-1:03:OTk1NGRkYTBiMjBhMTc1MDg4MTViNDFhYTQ4ZjhjM2M5MDM0NzcyM2RkYTU0NWYxNTMwZWI0M2NiZjQ0NTBmNAr9IOk=: 00:23:23.773 02:42:57 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:23:23.773 02:42:57 -- host/auth.sh@48 -- # echo ffdhe6144 00:23:23.773 02:42:57 -- host/auth.sh@49 -- # echo DHHC-1:03:OTk1NGRkYTBiMjBhMTc1MDg4MTViNDFhYTQ4ZjhjM2M5MDM0NzcyM2RkYTU0NWYxNTMwZWI0M2NiZjQ0NTBmNAr9IOk=: 00:23:23.773 02:42:57 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 4 00:23:23.773 02:42:57 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:23.773 02:42:57 -- host/auth.sh@68 -- # digest=sha256 00:23:23.773 02:42:57 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:23:23.773 02:42:57 -- host/auth.sh@68 -- # keyid=4 00:23:23.773 02:42:57 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:23:23.773 02:42:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:23.773 02:42:57 -- common/autotest_common.sh@10 -- # set +x 00:23:23.773 02:42:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:23.773 02:42:57 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:23.773 02:42:57 -- nvmf/common.sh@717 -- # local ip 00:23:23.773 02:42:57 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:23.773 02:42:57 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:23.773 02:42:57 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:23.773 02:42:57 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:23.773 02:42:57 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:23.773 02:42:57 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:23.773 02:42:57 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:23.773 02:42:57 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:23.773 02:42:57 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:23.773 02:42:57 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:23:23.773 02:42:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:23.773 02:42:57 -- common/autotest_common.sh@10 -- # set +x 00:23:24.031 nvme0n1 00:23:24.031 02:42:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:24.031 02:42:57 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:24.031 02:42:57 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:24.031 02:42:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:24.031 02:42:57 -- common/autotest_common.sh@10 -- # set +x 00:23:24.031 02:42:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:24.290 02:42:57 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:24.290 02:42:57 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:24.290 02:42:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:24.290 02:42:57 -- common/autotest_common.sh@10 -- # set +x 00:23:24.290 02:42:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:24.290 02:42:57 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:23:24.290 02:42:57 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:24.290 02:42:57 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 0 00:23:24.290 02:42:57 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:24.290 02:42:57 -- host/auth.sh@44 -- # digest=sha256 00:23:24.290 02:42:57 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:23:24.290 02:42:57 -- host/auth.sh@44 -- # keyid=0 00:23:24.290 02:42:57 -- host/auth.sh@45 -- # key=DHHC-1:00:YTVhYTdhYjViMDJmMjYzMzBjOTQ4NDg5NzM3YTI2Zjb26OQB: 00:23:24.290 02:42:57 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:23:24.290 02:42:57 -- host/auth.sh@48 -- # echo ffdhe8192 00:23:24.290 02:42:57 -- host/auth.sh@49 -- # echo DHHC-1:00:YTVhYTdhYjViMDJmMjYzMzBjOTQ4NDg5NzM3YTI2Zjb26OQB: 00:23:24.290 02:42:57 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 0 00:23:24.290 02:42:57 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:24.290 02:42:57 -- host/auth.sh@68 -- # digest=sha256 00:23:24.290 02:42:57 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:23:24.290 02:42:57 -- host/auth.sh@68 -- # keyid=0 00:23:24.290 02:42:57 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:23:24.290 02:42:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:24.290 02:42:57 -- common/autotest_common.sh@10 -- # set +x 00:23:24.290 02:42:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:24.290 02:42:57 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:24.290 02:42:57 -- nvmf/common.sh@717 -- # local ip 00:23:24.290 02:42:57 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:24.290 02:42:57 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:24.290 02:42:57 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:24.290 02:42:57 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:24.290 02:42:57 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:24.290 02:42:57 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:24.290 02:42:57 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:24.290 02:42:57 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:24.290 02:42:57 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:24.290 02:42:57 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:23:24.290 02:42:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:24.290 02:42:57 -- common/autotest_common.sh@10 -- # set +x 00:23:24.857 nvme0n1 00:23:24.857 02:42:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:24.857 02:42:58 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:24.857 02:42:58 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:24.857 02:42:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:24.857 02:42:58 -- common/autotest_common.sh@10 -- # set +x 00:23:24.857 02:42:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:24.857 02:42:58 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:24.857 02:42:58 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:24.857 02:42:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:24.857 02:42:58 -- common/autotest_common.sh@10 -- # set +x 00:23:24.857 02:42:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:24.857 02:42:58 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:24.857 02:42:58 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 1 00:23:24.857 02:42:58 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:24.857 02:42:58 -- host/auth.sh@44 -- # digest=sha256 00:23:24.857 02:42:58 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:23:24.857 02:42:58 -- host/auth.sh@44 -- # keyid=1 00:23:24.857 02:42:58 -- host/auth.sh@45 -- # key=DHHC-1:00:ODhjNjQ1NGFlZDFlNTJhNThiZTc2ZWY4NmI5NzRmNTI2M2U1Y2VhOWEwNjI5NjJiyej8LQ==: 00:23:24.857 02:42:58 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:23:24.857 02:42:58 -- host/auth.sh@48 -- # echo ffdhe8192 00:23:24.857 02:42:58 -- host/auth.sh@49 -- # echo DHHC-1:00:ODhjNjQ1NGFlZDFlNTJhNThiZTc2ZWY4NmI5NzRmNTI2M2U1Y2VhOWEwNjI5NjJiyej8LQ==: 00:23:24.857 02:42:58 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 1 00:23:24.857 02:42:58 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:24.857 02:42:58 -- host/auth.sh@68 -- # digest=sha256 00:23:24.857 02:42:58 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:23:24.857 02:42:58 -- host/auth.sh@68 -- # keyid=1 00:23:24.857 02:42:58 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:23:24.857 02:42:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:24.857 02:42:58 -- common/autotest_common.sh@10 -- # set +x 00:23:24.857 02:42:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:24.857 02:42:58 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:24.857 02:42:58 -- nvmf/common.sh@717 -- # local ip 00:23:24.857 02:42:58 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:24.857 02:42:58 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:24.857 02:42:58 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:24.857 02:42:58 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:24.857 02:42:58 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:24.857 02:42:58 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:24.857 02:42:58 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:24.857 02:42:58 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:24.857 02:42:58 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:24.857 02:42:58 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:23:24.857 02:42:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:24.857 02:42:58 -- common/autotest_common.sh@10 -- # set +x 00:23:25.423 nvme0n1 00:23:25.423 02:42:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:25.423 02:42:58 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:25.423 02:42:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:25.423 02:42:58 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:25.423 02:42:58 -- common/autotest_common.sh@10 -- # set +x 00:23:25.423 02:42:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:25.423 02:42:58 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:25.423 02:42:58 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:25.423 02:42:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:25.423 02:42:58 -- common/autotest_common.sh@10 -- # set +x 00:23:25.423 02:42:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:25.423 02:42:58 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:25.423 02:42:58 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 2 00:23:25.423 02:42:58 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:25.423 02:42:58 -- host/auth.sh@44 -- # digest=sha256 00:23:25.423 02:42:58 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:23:25.423 02:42:58 -- host/auth.sh@44 -- # keyid=2 00:23:25.423 02:42:58 -- host/auth.sh@45 -- # key=DHHC-1:01:Nzc2MWE1MjViOTA5OTUxOTRiZTEwNzExNDRkZjA4NWPly9CM: 00:23:25.423 02:42:58 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:23:25.423 02:42:58 -- host/auth.sh@48 -- # echo ffdhe8192 00:23:25.423 02:42:59 -- host/auth.sh@49 -- # echo DHHC-1:01:Nzc2MWE1MjViOTA5OTUxOTRiZTEwNzExNDRkZjA4NWPly9CM: 00:23:25.423 02:42:59 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 2 00:23:25.423 02:42:59 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:25.423 02:42:59 -- host/auth.sh@68 -- # digest=sha256 00:23:25.423 02:42:59 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:23:25.423 02:42:59 -- host/auth.sh@68 -- # keyid=2 00:23:25.423 02:42:59 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:23:25.423 02:42:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:25.423 02:42:59 -- common/autotest_common.sh@10 -- # set +x 00:23:25.423 02:42:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:25.423 02:42:59 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:25.423 02:42:59 -- nvmf/common.sh@717 -- # local ip 00:23:25.423 02:42:59 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:25.423 02:42:59 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:25.423 02:42:59 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:25.423 02:42:59 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:25.423 02:42:59 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:25.423 02:42:59 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:25.423 02:42:59 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:25.423 02:42:59 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:25.423 02:42:59 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:25.423 02:42:59 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:23:25.423 02:42:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:25.423 02:42:59 -- common/autotest_common.sh@10 -- # set +x 00:23:25.989 nvme0n1 00:23:25.989 02:42:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:25.989 02:42:59 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:25.989 02:42:59 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:25.989 02:42:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:25.989 02:42:59 -- common/autotest_common.sh@10 -- # set +x 00:23:25.989 02:42:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:26.247 02:42:59 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:26.247 02:42:59 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:26.247 02:42:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:26.247 02:42:59 -- common/autotest_common.sh@10 -- # set +x 00:23:26.247 02:42:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:26.247 02:42:59 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:26.247 02:42:59 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 3 00:23:26.247 02:42:59 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:26.247 02:42:59 -- host/auth.sh@44 -- # digest=sha256 00:23:26.247 02:42:59 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:23:26.247 02:42:59 -- host/auth.sh@44 -- # keyid=3 00:23:26.247 02:42:59 -- host/auth.sh@45 -- # key=DHHC-1:02:MzVhNzA3ZGQ0OWE0ZmYyZWI0ZjljYzljNTEyNGI3NjhkNGQ5MDM3YzVlZTFkZjY01CDZag==: 00:23:26.247 02:42:59 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:23:26.247 02:42:59 -- host/auth.sh@48 -- # echo ffdhe8192 00:23:26.247 02:42:59 -- host/auth.sh@49 -- # echo DHHC-1:02:MzVhNzA3ZGQ0OWE0ZmYyZWI0ZjljYzljNTEyNGI3NjhkNGQ5MDM3YzVlZTFkZjY01CDZag==: 00:23:26.247 02:42:59 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 3 00:23:26.247 02:42:59 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:26.247 02:42:59 -- host/auth.sh@68 -- # digest=sha256 00:23:26.247 02:42:59 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:23:26.247 02:42:59 -- host/auth.sh@68 -- # keyid=3 00:23:26.247 02:42:59 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:23:26.247 02:42:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:26.247 02:42:59 -- common/autotest_common.sh@10 -- # set +x 00:23:26.247 02:42:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:26.247 02:42:59 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:26.247 02:42:59 -- nvmf/common.sh@717 -- # local ip 00:23:26.247 02:42:59 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:26.247 02:42:59 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:26.247 02:42:59 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:26.247 02:42:59 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:26.247 02:42:59 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:26.247 02:42:59 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:26.247 02:42:59 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:26.247 02:42:59 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:26.247 02:42:59 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:26.247 02:42:59 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:23:26.247 02:42:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:26.247 02:42:59 -- common/autotest_common.sh@10 -- # set +x 00:23:26.813 nvme0n1 00:23:26.813 02:43:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:26.813 02:43:00 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:26.813 02:43:00 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:26.813 02:43:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:26.813 02:43:00 -- common/autotest_common.sh@10 -- # set +x 00:23:26.813 02:43:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:26.813 02:43:00 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:26.813 02:43:00 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:26.813 02:43:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:26.813 02:43:00 -- common/autotest_common.sh@10 -- # set +x 00:23:26.813 02:43:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:26.813 02:43:00 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:26.813 02:43:00 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 4 00:23:26.813 02:43:00 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:26.813 02:43:00 -- host/auth.sh@44 -- # digest=sha256 00:23:26.813 02:43:00 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:23:26.813 02:43:00 -- host/auth.sh@44 -- # keyid=4 00:23:26.813 02:43:00 -- host/auth.sh@45 -- # key=DHHC-1:03:OTk1NGRkYTBiMjBhMTc1MDg4MTViNDFhYTQ4ZjhjM2M5MDM0NzcyM2RkYTU0NWYxNTMwZWI0M2NiZjQ0NTBmNAr9IOk=: 00:23:26.813 02:43:00 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:23:26.813 02:43:00 -- host/auth.sh@48 -- # echo ffdhe8192 00:23:26.813 02:43:00 -- host/auth.sh@49 -- # echo DHHC-1:03:OTk1NGRkYTBiMjBhMTc1MDg4MTViNDFhYTQ4ZjhjM2M5MDM0NzcyM2RkYTU0NWYxNTMwZWI0M2NiZjQ0NTBmNAr9IOk=: 00:23:26.813 02:43:00 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 4 00:23:26.813 02:43:00 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:26.813 02:43:00 -- host/auth.sh@68 -- # digest=sha256 00:23:26.813 02:43:00 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:23:26.813 02:43:00 -- host/auth.sh@68 -- # keyid=4 00:23:26.813 02:43:00 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:23:26.813 02:43:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:26.813 02:43:00 -- common/autotest_common.sh@10 -- # set +x 00:23:26.813 02:43:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:26.813 02:43:00 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:26.813 02:43:00 -- nvmf/common.sh@717 -- # local ip 00:23:26.813 02:43:00 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:26.813 02:43:00 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:26.814 02:43:00 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:26.814 02:43:00 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:26.814 02:43:00 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:26.814 02:43:00 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:26.814 02:43:00 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:26.814 02:43:00 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:26.814 02:43:00 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:26.814 02:43:00 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:23:26.814 02:43:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:26.814 02:43:00 -- common/autotest_common.sh@10 -- # set +x 00:23:27.379 nvme0n1 00:23:27.379 02:43:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:27.379 02:43:00 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:27.379 02:43:00 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:27.379 02:43:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:27.379 02:43:00 -- common/autotest_common.sh@10 -- # set +x 00:23:27.379 02:43:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:27.379 02:43:00 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:27.379 02:43:00 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:27.379 02:43:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:27.379 02:43:00 -- common/autotest_common.sh@10 -- # set +x 00:23:27.379 02:43:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:27.379 02:43:00 -- host/auth.sh@107 -- # for digest in "${digests[@]}" 00:23:27.379 02:43:00 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:23:27.379 02:43:00 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:27.379 02:43:00 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 0 00:23:27.379 02:43:00 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:27.379 02:43:00 -- host/auth.sh@44 -- # digest=sha384 00:23:27.379 02:43:00 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:23:27.379 02:43:00 -- host/auth.sh@44 -- # keyid=0 00:23:27.379 02:43:00 -- host/auth.sh@45 -- # key=DHHC-1:00:YTVhYTdhYjViMDJmMjYzMzBjOTQ4NDg5NzM3YTI2Zjb26OQB: 00:23:27.379 02:43:00 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:23:27.379 02:43:00 -- host/auth.sh@48 -- # echo ffdhe2048 00:23:27.379 02:43:00 -- host/auth.sh@49 -- # echo DHHC-1:00:YTVhYTdhYjViMDJmMjYzMzBjOTQ4NDg5NzM3YTI2Zjb26OQB: 00:23:27.379 02:43:00 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 0 00:23:27.379 02:43:00 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:27.379 02:43:00 -- host/auth.sh@68 -- # digest=sha384 00:23:27.379 02:43:00 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:23:27.379 02:43:00 -- host/auth.sh@68 -- # keyid=0 00:23:27.379 02:43:00 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:23:27.379 02:43:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:27.379 02:43:00 -- common/autotest_common.sh@10 -- # set +x 00:23:27.379 02:43:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:27.379 02:43:00 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:27.379 02:43:00 -- nvmf/common.sh@717 -- # local ip 00:23:27.379 02:43:00 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:27.379 02:43:00 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:27.379 02:43:00 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:27.379 02:43:00 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:27.379 02:43:00 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:27.379 02:43:00 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:27.379 02:43:00 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:27.379 02:43:00 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:27.379 02:43:00 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:27.379 02:43:00 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:23:27.379 02:43:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:27.379 02:43:00 -- common/autotest_common.sh@10 -- # set +x 00:23:27.636 nvme0n1 00:23:27.636 02:43:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:27.636 02:43:01 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:27.636 02:43:01 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:27.636 02:43:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:27.636 02:43:01 -- common/autotest_common.sh@10 -- # set +x 00:23:27.636 02:43:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:27.636 02:43:01 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:27.636 02:43:01 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:27.636 02:43:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:27.636 02:43:01 -- common/autotest_common.sh@10 -- # set +x 00:23:27.636 02:43:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:27.636 02:43:01 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:27.636 02:43:01 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 1 00:23:27.636 02:43:01 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:27.636 02:43:01 -- host/auth.sh@44 -- # digest=sha384 00:23:27.636 02:43:01 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:23:27.636 02:43:01 -- host/auth.sh@44 -- # keyid=1 00:23:27.636 02:43:01 -- host/auth.sh@45 -- # key=DHHC-1:00:ODhjNjQ1NGFlZDFlNTJhNThiZTc2ZWY4NmI5NzRmNTI2M2U1Y2VhOWEwNjI5NjJiyej8LQ==: 00:23:27.636 02:43:01 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:23:27.636 02:43:01 -- host/auth.sh@48 -- # echo ffdhe2048 00:23:27.636 02:43:01 -- host/auth.sh@49 -- # echo DHHC-1:00:ODhjNjQ1NGFlZDFlNTJhNThiZTc2ZWY4NmI5NzRmNTI2M2U1Y2VhOWEwNjI5NjJiyej8LQ==: 00:23:27.636 02:43:01 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 1 00:23:27.636 02:43:01 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:27.636 02:43:01 -- host/auth.sh@68 -- # digest=sha384 00:23:27.636 02:43:01 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:23:27.636 02:43:01 -- host/auth.sh@68 -- # keyid=1 00:23:27.636 02:43:01 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:23:27.636 02:43:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:27.636 02:43:01 -- common/autotest_common.sh@10 -- # set +x 00:23:27.636 02:43:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:27.636 02:43:01 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:27.636 02:43:01 -- nvmf/common.sh@717 -- # local ip 00:23:27.636 02:43:01 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:27.636 02:43:01 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:27.636 02:43:01 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:27.636 02:43:01 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:27.636 02:43:01 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:27.636 02:43:01 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:27.636 02:43:01 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:27.636 02:43:01 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:27.636 02:43:01 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:27.636 02:43:01 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:23:27.636 02:43:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:27.636 02:43:01 -- common/autotest_common.sh@10 -- # set +x 00:23:27.894 nvme0n1 00:23:27.894 02:43:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:27.894 02:43:01 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:27.894 02:43:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:27.894 02:43:01 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:27.894 02:43:01 -- common/autotest_common.sh@10 -- # set +x 00:23:27.894 02:43:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:27.894 02:43:01 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:27.894 02:43:01 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:27.894 02:43:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:27.894 02:43:01 -- common/autotest_common.sh@10 -- # set +x 00:23:27.894 02:43:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:27.894 02:43:01 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:27.894 02:43:01 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 2 00:23:27.894 02:43:01 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:27.894 02:43:01 -- host/auth.sh@44 -- # digest=sha384 00:23:27.894 02:43:01 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:23:27.894 02:43:01 -- host/auth.sh@44 -- # keyid=2 00:23:27.894 02:43:01 -- host/auth.sh@45 -- # key=DHHC-1:01:Nzc2MWE1MjViOTA5OTUxOTRiZTEwNzExNDRkZjA4NWPly9CM: 00:23:27.894 02:43:01 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:23:27.894 02:43:01 -- host/auth.sh@48 -- # echo ffdhe2048 00:23:27.894 02:43:01 -- host/auth.sh@49 -- # echo DHHC-1:01:Nzc2MWE1MjViOTA5OTUxOTRiZTEwNzExNDRkZjA4NWPly9CM: 00:23:27.894 02:43:01 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 2 00:23:27.894 02:43:01 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:27.894 02:43:01 -- host/auth.sh@68 -- # digest=sha384 00:23:27.894 02:43:01 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:23:27.894 02:43:01 -- host/auth.sh@68 -- # keyid=2 00:23:27.894 02:43:01 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:23:27.894 02:43:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:27.894 02:43:01 -- common/autotest_common.sh@10 -- # set +x 00:23:27.894 02:43:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:27.894 02:43:01 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:27.894 02:43:01 -- nvmf/common.sh@717 -- # local ip 00:23:27.894 02:43:01 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:27.894 02:43:01 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:27.894 02:43:01 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:27.894 02:43:01 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:27.894 02:43:01 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:27.894 02:43:01 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:27.894 02:43:01 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:27.894 02:43:01 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:27.894 02:43:01 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:27.894 02:43:01 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:23:27.894 02:43:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:27.894 02:43:01 -- common/autotest_common.sh@10 -- # set +x 00:23:28.151 nvme0n1 00:23:28.151 02:43:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:28.151 02:43:01 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:28.151 02:43:01 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:28.151 02:43:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:28.151 02:43:01 -- common/autotest_common.sh@10 -- # set +x 00:23:28.151 02:43:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:28.151 02:43:01 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:28.151 02:43:01 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:28.151 02:43:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:28.151 02:43:01 -- common/autotest_common.sh@10 -- # set +x 00:23:28.151 02:43:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:28.151 02:43:01 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:28.151 02:43:01 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 3 00:23:28.151 02:43:01 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:28.151 02:43:01 -- host/auth.sh@44 -- # digest=sha384 00:23:28.151 02:43:01 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:23:28.151 02:43:01 -- host/auth.sh@44 -- # keyid=3 00:23:28.151 02:43:01 -- host/auth.sh@45 -- # key=DHHC-1:02:MzVhNzA3ZGQ0OWE0ZmYyZWI0ZjljYzljNTEyNGI3NjhkNGQ5MDM3YzVlZTFkZjY01CDZag==: 00:23:28.151 02:43:01 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:23:28.151 02:43:01 -- host/auth.sh@48 -- # echo ffdhe2048 00:23:28.151 02:43:01 -- host/auth.sh@49 -- # echo DHHC-1:02:MzVhNzA3ZGQ0OWE0ZmYyZWI0ZjljYzljNTEyNGI3NjhkNGQ5MDM3YzVlZTFkZjY01CDZag==: 00:23:28.151 02:43:01 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 3 00:23:28.151 02:43:01 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:28.151 02:43:01 -- host/auth.sh@68 -- # digest=sha384 00:23:28.151 02:43:01 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:23:28.151 02:43:01 -- host/auth.sh@68 -- # keyid=3 00:23:28.151 02:43:01 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:23:28.151 02:43:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:28.151 02:43:01 -- common/autotest_common.sh@10 -- # set +x 00:23:28.408 02:43:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:28.408 02:43:01 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:28.408 02:43:01 -- nvmf/common.sh@717 -- # local ip 00:23:28.408 02:43:01 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:28.408 02:43:01 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:28.408 02:43:01 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:28.408 02:43:01 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:28.408 02:43:01 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:28.408 02:43:01 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:28.408 02:43:01 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:28.408 02:43:01 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:28.408 02:43:01 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:28.408 02:43:01 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:23:28.408 02:43:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:28.408 02:43:01 -- common/autotest_common.sh@10 -- # set +x 00:23:28.408 nvme0n1 00:23:28.408 02:43:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:28.408 02:43:01 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:28.408 02:43:01 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:28.408 02:43:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:28.408 02:43:01 -- common/autotest_common.sh@10 -- # set +x 00:23:28.408 02:43:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:28.408 02:43:02 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:28.409 02:43:02 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:28.409 02:43:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:28.409 02:43:02 -- common/autotest_common.sh@10 -- # set +x 00:23:28.666 02:43:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:28.666 02:43:02 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:28.666 02:43:02 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 4 00:23:28.666 02:43:02 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:28.666 02:43:02 -- host/auth.sh@44 -- # digest=sha384 00:23:28.666 02:43:02 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:23:28.666 02:43:02 -- host/auth.sh@44 -- # keyid=4 00:23:28.666 02:43:02 -- host/auth.sh@45 -- # key=DHHC-1:03:OTk1NGRkYTBiMjBhMTc1MDg4MTViNDFhYTQ4ZjhjM2M5MDM0NzcyM2RkYTU0NWYxNTMwZWI0M2NiZjQ0NTBmNAr9IOk=: 00:23:28.666 02:43:02 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:23:28.666 02:43:02 -- host/auth.sh@48 -- # echo ffdhe2048 00:23:28.666 02:43:02 -- host/auth.sh@49 -- # echo DHHC-1:03:OTk1NGRkYTBiMjBhMTc1MDg4MTViNDFhYTQ4ZjhjM2M5MDM0NzcyM2RkYTU0NWYxNTMwZWI0M2NiZjQ0NTBmNAr9IOk=: 00:23:28.666 02:43:02 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 4 00:23:28.666 02:43:02 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:28.666 02:43:02 -- host/auth.sh@68 -- # digest=sha384 00:23:28.666 02:43:02 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:23:28.666 02:43:02 -- host/auth.sh@68 -- # keyid=4 00:23:28.666 02:43:02 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:23:28.666 02:43:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:28.666 02:43:02 -- common/autotest_common.sh@10 -- # set +x 00:23:28.666 02:43:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:28.666 02:43:02 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:28.666 02:43:02 -- nvmf/common.sh@717 -- # local ip 00:23:28.666 02:43:02 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:28.666 02:43:02 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:28.666 02:43:02 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:28.666 02:43:02 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:28.666 02:43:02 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:28.666 02:43:02 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:28.666 02:43:02 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:28.666 02:43:02 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:28.666 02:43:02 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:28.666 02:43:02 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:23:28.666 02:43:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:28.666 02:43:02 -- common/autotest_common.sh@10 -- # set +x 00:23:28.666 nvme0n1 00:23:28.666 02:43:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:28.666 02:43:02 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:28.666 02:43:02 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:28.666 02:43:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:28.666 02:43:02 -- common/autotest_common.sh@10 -- # set +x 00:23:28.666 02:43:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:28.666 02:43:02 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:28.667 02:43:02 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:28.667 02:43:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:28.667 02:43:02 -- common/autotest_common.sh@10 -- # set +x 00:23:28.924 02:43:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:28.924 02:43:02 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:23:28.924 02:43:02 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:28.924 02:43:02 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 0 00:23:28.924 02:43:02 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:28.924 02:43:02 -- host/auth.sh@44 -- # digest=sha384 00:23:28.924 02:43:02 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:23:28.924 02:43:02 -- host/auth.sh@44 -- # keyid=0 00:23:28.924 02:43:02 -- host/auth.sh@45 -- # key=DHHC-1:00:YTVhYTdhYjViMDJmMjYzMzBjOTQ4NDg5NzM3YTI2Zjb26OQB: 00:23:28.924 02:43:02 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:23:28.924 02:43:02 -- host/auth.sh@48 -- # echo ffdhe3072 00:23:28.924 02:43:02 -- host/auth.sh@49 -- # echo DHHC-1:00:YTVhYTdhYjViMDJmMjYzMzBjOTQ4NDg5NzM3YTI2Zjb26OQB: 00:23:28.924 02:43:02 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 0 00:23:28.924 02:43:02 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:28.924 02:43:02 -- host/auth.sh@68 -- # digest=sha384 00:23:28.924 02:43:02 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:23:28.924 02:43:02 -- host/auth.sh@68 -- # keyid=0 00:23:28.924 02:43:02 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:23:28.924 02:43:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:28.924 02:43:02 -- common/autotest_common.sh@10 -- # set +x 00:23:28.924 02:43:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:28.924 02:43:02 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:28.924 02:43:02 -- nvmf/common.sh@717 -- # local ip 00:23:28.924 02:43:02 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:28.924 02:43:02 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:28.924 02:43:02 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:28.924 02:43:02 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:28.924 02:43:02 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:28.924 02:43:02 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:28.924 02:43:02 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:28.924 02:43:02 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:28.924 02:43:02 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:28.924 02:43:02 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:23:28.925 02:43:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:28.925 02:43:02 -- common/autotest_common.sh@10 -- # set +x 00:23:28.925 nvme0n1 00:23:28.925 02:43:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:28.925 02:43:02 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:28.925 02:43:02 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:28.925 02:43:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:28.925 02:43:02 -- common/autotest_common.sh@10 -- # set +x 00:23:29.182 02:43:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:29.182 02:43:02 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:29.182 02:43:02 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:29.182 02:43:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:29.182 02:43:02 -- common/autotest_common.sh@10 -- # set +x 00:23:29.182 02:43:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:29.182 02:43:02 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:29.182 02:43:02 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 1 00:23:29.182 02:43:02 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:29.182 02:43:02 -- host/auth.sh@44 -- # digest=sha384 00:23:29.182 02:43:02 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:23:29.182 02:43:02 -- host/auth.sh@44 -- # keyid=1 00:23:29.182 02:43:02 -- host/auth.sh@45 -- # key=DHHC-1:00:ODhjNjQ1NGFlZDFlNTJhNThiZTc2ZWY4NmI5NzRmNTI2M2U1Y2VhOWEwNjI5NjJiyej8LQ==: 00:23:29.182 02:43:02 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:23:29.182 02:43:02 -- host/auth.sh@48 -- # echo ffdhe3072 00:23:29.182 02:43:02 -- host/auth.sh@49 -- # echo DHHC-1:00:ODhjNjQ1NGFlZDFlNTJhNThiZTc2ZWY4NmI5NzRmNTI2M2U1Y2VhOWEwNjI5NjJiyej8LQ==: 00:23:29.182 02:43:02 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 1 00:23:29.182 02:43:02 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:29.182 02:43:02 -- host/auth.sh@68 -- # digest=sha384 00:23:29.182 02:43:02 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:23:29.182 02:43:02 -- host/auth.sh@68 -- # keyid=1 00:23:29.182 02:43:02 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:23:29.182 02:43:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:29.182 02:43:02 -- common/autotest_common.sh@10 -- # set +x 00:23:29.182 02:43:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:29.182 02:43:02 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:29.182 02:43:02 -- nvmf/common.sh@717 -- # local ip 00:23:29.182 02:43:02 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:29.182 02:43:02 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:29.182 02:43:02 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:29.182 02:43:02 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:29.182 02:43:02 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:29.182 02:43:02 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:29.182 02:43:02 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:29.182 02:43:02 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:29.182 02:43:02 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:29.182 02:43:02 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:23:29.182 02:43:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:29.182 02:43:02 -- common/autotest_common.sh@10 -- # set +x 00:23:29.440 nvme0n1 00:23:29.440 02:43:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:29.440 02:43:02 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:29.440 02:43:02 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:29.440 02:43:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:29.440 02:43:02 -- common/autotest_common.sh@10 -- # set +x 00:23:29.440 02:43:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:29.440 02:43:02 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:29.440 02:43:02 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:29.440 02:43:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:29.440 02:43:02 -- common/autotest_common.sh@10 -- # set +x 00:23:29.440 02:43:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:29.440 02:43:02 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:29.440 02:43:02 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 2 00:23:29.440 02:43:02 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:29.440 02:43:02 -- host/auth.sh@44 -- # digest=sha384 00:23:29.440 02:43:02 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:23:29.440 02:43:02 -- host/auth.sh@44 -- # keyid=2 00:23:29.440 02:43:02 -- host/auth.sh@45 -- # key=DHHC-1:01:Nzc2MWE1MjViOTA5OTUxOTRiZTEwNzExNDRkZjA4NWPly9CM: 00:23:29.440 02:43:02 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:23:29.440 02:43:02 -- host/auth.sh@48 -- # echo ffdhe3072 00:23:29.440 02:43:02 -- host/auth.sh@49 -- # echo DHHC-1:01:Nzc2MWE1MjViOTA5OTUxOTRiZTEwNzExNDRkZjA4NWPly9CM: 00:23:29.440 02:43:02 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 2 00:23:29.440 02:43:02 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:29.440 02:43:02 -- host/auth.sh@68 -- # digest=sha384 00:23:29.440 02:43:02 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:23:29.440 02:43:02 -- host/auth.sh@68 -- # keyid=2 00:23:29.440 02:43:02 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:23:29.440 02:43:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:29.440 02:43:02 -- common/autotest_common.sh@10 -- # set +x 00:23:29.440 02:43:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:29.440 02:43:02 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:29.440 02:43:02 -- nvmf/common.sh@717 -- # local ip 00:23:29.440 02:43:02 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:29.440 02:43:02 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:29.440 02:43:02 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:29.440 02:43:02 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:29.440 02:43:02 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:29.440 02:43:02 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:29.440 02:43:02 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:29.440 02:43:02 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:29.440 02:43:02 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:29.440 02:43:02 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:23:29.440 02:43:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:29.440 02:43:02 -- common/autotest_common.sh@10 -- # set +x 00:23:29.698 nvme0n1 00:23:29.698 02:43:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:29.698 02:43:03 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:29.698 02:43:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:29.698 02:43:03 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:29.698 02:43:03 -- common/autotest_common.sh@10 -- # set +x 00:23:29.698 02:43:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:29.698 02:43:03 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:29.698 02:43:03 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:29.698 02:43:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:29.698 02:43:03 -- common/autotest_common.sh@10 -- # set +x 00:23:29.698 02:43:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:29.698 02:43:03 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:29.698 02:43:03 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 3 00:23:29.698 02:43:03 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:29.698 02:43:03 -- host/auth.sh@44 -- # digest=sha384 00:23:29.698 02:43:03 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:23:29.698 02:43:03 -- host/auth.sh@44 -- # keyid=3 00:23:29.698 02:43:03 -- host/auth.sh@45 -- # key=DHHC-1:02:MzVhNzA3ZGQ0OWE0ZmYyZWI0ZjljYzljNTEyNGI3NjhkNGQ5MDM3YzVlZTFkZjY01CDZag==: 00:23:29.698 02:43:03 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:23:29.698 02:43:03 -- host/auth.sh@48 -- # echo ffdhe3072 00:23:29.698 02:43:03 -- host/auth.sh@49 -- # echo DHHC-1:02:MzVhNzA3ZGQ0OWE0ZmYyZWI0ZjljYzljNTEyNGI3NjhkNGQ5MDM3YzVlZTFkZjY01CDZag==: 00:23:29.698 02:43:03 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 3 00:23:29.698 02:43:03 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:29.698 02:43:03 -- host/auth.sh@68 -- # digest=sha384 00:23:29.698 02:43:03 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:23:29.698 02:43:03 -- host/auth.sh@68 -- # keyid=3 00:23:29.698 02:43:03 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:23:29.698 02:43:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:29.698 02:43:03 -- common/autotest_common.sh@10 -- # set +x 00:23:29.698 02:43:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:29.698 02:43:03 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:29.698 02:43:03 -- nvmf/common.sh@717 -- # local ip 00:23:29.698 02:43:03 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:29.698 02:43:03 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:29.698 02:43:03 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:29.698 02:43:03 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:29.698 02:43:03 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:29.698 02:43:03 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:29.698 02:43:03 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:29.698 02:43:03 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:29.698 02:43:03 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:29.698 02:43:03 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:23:29.698 02:43:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:29.698 02:43:03 -- common/autotest_common.sh@10 -- # set +x 00:23:29.956 nvme0n1 00:23:29.956 02:43:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:29.956 02:43:03 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:29.956 02:43:03 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:29.956 02:43:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:29.956 02:43:03 -- common/autotest_common.sh@10 -- # set +x 00:23:29.956 02:43:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:29.956 02:43:03 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:29.956 02:43:03 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:29.956 02:43:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:29.956 02:43:03 -- common/autotest_common.sh@10 -- # set +x 00:23:29.956 02:43:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:29.956 02:43:03 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:29.956 02:43:03 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 4 00:23:29.956 02:43:03 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:29.956 02:43:03 -- host/auth.sh@44 -- # digest=sha384 00:23:29.956 02:43:03 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:23:29.956 02:43:03 -- host/auth.sh@44 -- # keyid=4 00:23:29.956 02:43:03 -- host/auth.sh@45 -- # key=DHHC-1:03:OTk1NGRkYTBiMjBhMTc1MDg4MTViNDFhYTQ4ZjhjM2M5MDM0NzcyM2RkYTU0NWYxNTMwZWI0M2NiZjQ0NTBmNAr9IOk=: 00:23:29.956 02:43:03 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:23:29.956 02:43:03 -- host/auth.sh@48 -- # echo ffdhe3072 00:23:29.956 02:43:03 -- host/auth.sh@49 -- # echo DHHC-1:03:OTk1NGRkYTBiMjBhMTc1MDg4MTViNDFhYTQ4ZjhjM2M5MDM0NzcyM2RkYTU0NWYxNTMwZWI0M2NiZjQ0NTBmNAr9IOk=: 00:23:29.956 02:43:03 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 4 00:23:29.956 02:43:03 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:29.956 02:43:03 -- host/auth.sh@68 -- # digest=sha384 00:23:29.956 02:43:03 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:23:29.956 02:43:03 -- host/auth.sh@68 -- # keyid=4 00:23:29.956 02:43:03 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:23:29.956 02:43:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:29.956 02:43:03 -- common/autotest_common.sh@10 -- # set +x 00:23:29.956 02:43:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:29.956 02:43:03 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:29.956 02:43:03 -- nvmf/common.sh@717 -- # local ip 00:23:29.956 02:43:03 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:29.956 02:43:03 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:29.956 02:43:03 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:29.956 02:43:03 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:29.956 02:43:03 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:29.956 02:43:03 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:29.956 02:43:03 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:29.956 02:43:03 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:29.956 02:43:03 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:29.956 02:43:03 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:23:29.956 02:43:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:29.956 02:43:03 -- common/autotest_common.sh@10 -- # set +x 00:23:30.214 nvme0n1 00:23:30.214 02:43:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:30.214 02:43:03 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:30.214 02:43:03 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:30.214 02:43:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:30.214 02:43:03 -- common/autotest_common.sh@10 -- # set +x 00:23:30.214 02:43:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:30.214 02:43:03 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:30.214 02:43:03 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:30.214 02:43:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:30.214 02:43:03 -- common/autotest_common.sh@10 -- # set +x 00:23:30.214 02:43:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:30.214 02:43:03 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:23:30.214 02:43:03 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:30.214 02:43:03 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 0 00:23:30.214 02:43:03 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:30.214 02:43:03 -- host/auth.sh@44 -- # digest=sha384 00:23:30.214 02:43:03 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:23:30.214 02:43:03 -- host/auth.sh@44 -- # keyid=0 00:23:30.214 02:43:03 -- host/auth.sh@45 -- # key=DHHC-1:00:YTVhYTdhYjViMDJmMjYzMzBjOTQ4NDg5NzM3YTI2Zjb26OQB: 00:23:30.214 02:43:03 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:23:30.214 02:43:03 -- host/auth.sh@48 -- # echo ffdhe4096 00:23:30.214 02:43:03 -- host/auth.sh@49 -- # echo DHHC-1:00:YTVhYTdhYjViMDJmMjYzMzBjOTQ4NDg5NzM3YTI2Zjb26OQB: 00:23:30.214 02:43:03 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 0 00:23:30.214 02:43:03 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:30.214 02:43:03 -- host/auth.sh@68 -- # digest=sha384 00:23:30.214 02:43:03 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:23:30.214 02:43:03 -- host/auth.sh@68 -- # keyid=0 00:23:30.214 02:43:03 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:23:30.214 02:43:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:30.214 02:43:03 -- common/autotest_common.sh@10 -- # set +x 00:23:30.214 02:43:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:30.214 02:43:03 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:30.214 02:43:03 -- nvmf/common.sh@717 -- # local ip 00:23:30.214 02:43:03 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:30.214 02:43:03 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:30.214 02:43:03 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:30.214 02:43:03 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:30.214 02:43:03 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:30.214 02:43:03 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:30.214 02:43:03 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:30.214 02:43:03 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:30.214 02:43:03 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:30.214 02:43:03 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:23:30.214 02:43:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:30.214 02:43:03 -- common/autotest_common.sh@10 -- # set +x 00:23:30.472 nvme0n1 00:23:30.472 02:43:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:30.472 02:43:04 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:30.472 02:43:04 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:30.472 02:43:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:30.472 02:43:04 -- common/autotest_common.sh@10 -- # set +x 00:23:30.472 02:43:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:30.472 02:43:04 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:30.472 02:43:04 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:30.472 02:43:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:30.472 02:43:04 -- common/autotest_common.sh@10 -- # set +x 00:23:30.472 02:43:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:30.472 02:43:04 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:30.472 02:43:04 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 1 00:23:30.472 02:43:04 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:30.472 02:43:04 -- host/auth.sh@44 -- # digest=sha384 00:23:30.472 02:43:04 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:23:30.472 02:43:04 -- host/auth.sh@44 -- # keyid=1 00:23:30.472 02:43:04 -- host/auth.sh@45 -- # key=DHHC-1:00:ODhjNjQ1NGFlZDFlNTJhNThiZTc2ZWY4NmI5NzRmNTI2M2U1Y2VhOWEwNjI5NjJiyej8LQ==: 00:23:30.472 02:43:04 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:23:30.472 02:43:04 -- host/auth.sh@48 -- # echo ffdhe4096 00:23:30.472 02:43:04 -- host/auth.sh@49 -- # echo DHHC-1:00:ODhjNjQ1NGFlZDFlNTJhNThiZTc2ZWY4NmI5NzRmNTI2M2U1Y2VhOWEwNjI5NjJiyej8LQ==: 00:23:30.472 02:43:04 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 1 00:23:30.472 02:43:04 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:30.472 02:43:04 -- host/auth.sh@68 -- # digest=sha384 00:23:30.472 02:43:04 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:23:30.472 02:43:04 -- host/auth.sh@68 -- # keyid=1 00:23:30.472 02:43:04 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:23:30.472 02:43:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:30.472 02:43:04 -- common/autotest_common.sh@10 -- # set +x 00:23:30.729 02:43:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:30.729 02:43:04 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:30.730 02:43:04 -- nvmf/common.sh@717 -- # local ip 00:23:30.730 02:43:04 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:30.730 02:43:04 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:30.730 02:43:04 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:30.730 02:43:04 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:30.730 02:43:04 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:30.730 02:43:04 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:30.730 02:43:04 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:30.730 02:43:04 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:30.730 02:43:04 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:30.730 02:43:04 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:23:30.730 02:43:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:30.730 02:43:04 -- common/autotest_common.sh@10 -- # set +x 00:23:30.730 nvme0n1 00:23:30.730 02:43:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:30.987 02:43:04 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:30.987 02:43:04 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:30.987 02:43:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:30.987 02:43:04 -- common/autotest_common.sh@10 -- # set +x 00:23:30.987 02:43:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:30.987 02:43:04 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:30.987 02:43:04 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:30.987 02:43:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:30.987 02:43:04 -- common/autotest_common.sh@10 -- # set +x 00:23:30.987 02:43:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:30.987 02:43:04 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:30.987 02:43:04 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 2 00:23:30.987 02:43:04 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:30.987 02:43:04 -- host/auth.sh@44 -- # digest=sha384 00:23:30.987 02:43:04 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:23:30.987 02:43:04 -- host/auth.sh@44 -- # keyid=2 00:23:30.987 02:43:04 -- host/auth.sh@45 -- # key=DHHC-1:01:Nzc2MWE1MjViOTA5OTUxOTRiZTEwNzExNDRkZjA4NWPly9CM: 00:23:30.988 02:43:04 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:23:30.988 02:43:04 -- host/auth.sh@48 -- # echo ffdhe4096 00:23:30.988 02:43:04 -- host/auth.sh@49 -- # echo DHHC-1:01:Nzc2MWE1MjViOTA5OTUxOTRiZTEwNzExNDRkZjA4NWPly9CM: 00:23:30.988 02:43:04 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 2 00:23:30.988 02:43:04 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:30.988 02:43:04 -- host/auth.sh@68 -- # digest=sha384 00:23:30.988 02:43:04 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:23:30.988 02:43:04 -- host/auth.sh@68 -- # keyid=2 00:23:30.988 02:43:04 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:23:30.988 02:43:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:30.988 02:43:04 -- common/autotest_common.sh@10 -- # set +x 00:23:30.988 02:43:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:30.988 02:43:04 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:30.988 02:43:04 -- nvmf/common.sh@717 -- # local ip 00:23:30.988 02:43:04 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:30.988 02:43:04 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:30.988 02:43:04 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:30.988 02:43:04 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:30.988 02:43:04 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:30.988 02:43:04 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:30.988 02:43:04 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:30.988 02:43:04 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:30.988 02:43:04 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:30.988 02:43:04 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:23:30.988 02:43:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:30.988 02:43:04 -- common/autotest_common.sh@10 -- # set +x 00:23:31.245 nvme0n1 00:23:31.245 02:43:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:31.245 02:43:04 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:31.245 02:43:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:31.245 02:43:04 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:31.245 02:43:04 -- common/autotest_common.sh@10 -- # set +x 00:23:31.245 02:43:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:31.245 02:43:04 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:31.245 02:43:04 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:31.245 02:43:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:31.245 02:43:04 -- common/autotest_common.sh@10 -- # set +x 00:23:31.245 02:43:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:31.245 02:43:04 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:31.245 02:43:04 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 3 00:23:31.245 02:43:04 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:31.245 02:43:04 -- host/auth.sh@44 -- # digest=sha384 00:23:31.245 02:43:04 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:23:31.245 02:43:04 -- host/auth.sh@44 -- # keyid=3 00:23:31.245 02:43:04 -- host/auth.sh@45 -- # key=DHHC-1:02:MzVhNzA3ZGQ0OWE0ZmYyZWI0ZjljYzljNTEyNGI3NjhkNGQ5MDM3YzVlZTFkZjY01CDZag==: 00:23:31.245 02:43:04 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:23:31.245 02:43:04 -- host/auth.sh@48 -- # echo ffdhe4096 00:23:31.245 02:43:04 -- host/auth.sh@49 -- # echo DHHC-1:02:MzVhNzA3ZGQ0OWE0ZmYyZWI0ZjljYzljNTEyNGI3NjhkNGQ5MDM3YzVlZTFkZjY01CDZag==: 00:23:31.245 02:43:04 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 3 00:23:31.245 02:43:04 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:31.245 02:43:04 -- host/auth.sh@68 -- # digest=sha384 00:23:31.245 02:43:04 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:23:31.245 02:43:04 -- host/auth.sh@68 -- # keyid=3 00:23:31.245 02:43:04 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:23:31.245 02:43:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:31.245 02:43:04 -- common/autotest_common.sh@10 -- # set +x 00:23:31.245 02:43:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:31.245 02:43:04 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:31.245 02:43:04 -- nvmf/common.sh@717 -- # local ip 00:23:31.245 02:43:04 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:31.245 02:43:04 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:31.245 02:43:04 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:31.245 02:43:04 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:31.245 02:43:04 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:31.245 02:43:04 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:31.245 02:43:04 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:31.245 02:43:04 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:31.245 02:43:04 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:31.245 02:43:04 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:23:31.245 02:43:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:31.245 02:43:04 -- common/autotest_common.sh@10 -- # set +x 00:23:31.503 nvme0n1 00:23:31.503 02:43:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:31.503 02:43:05 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:31.503 02:43:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:31.503 02:43:05 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:31.503 02:43:05 -- common/autotest_common.sh@10 -- # set +x 00:23:31.503 02:43:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:31.503 02:43:05 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:31.503 02:43:05 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:31.503 02:43:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:31.503 02:43:05 -- common/autotest_common.sh@10 -- # set +x 00:23:31.503 02:43:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:31.503 02:43:05 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:31.503 02:43:05 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 4 00:23:31.503 02:43:05 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:31.503 02:43:05 -- host/auth.sh@44 -- # digest=sha384 00:23:31.503 02:43:05 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:23:31.503 02:43:05 -- host/auth.sh@44 -- # keyid=4 00:23:31.503 02:43:05 -- host/auth.sh@45 -- # key=DHHC-1:03:OTk1NGRkYTBiMjBhMTc1MDg4MTViNDFhYTQ4ZjhjM2M5MDM0NzcyM2RkYTU0NWYxNTMwZWI0M2NiZjQ0NTBmNAr9IOk=: 00:23:31.503 02:43:05 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:23:31.503 02:43:05 -- host/auth.sh@48 -- # echo ffdhe4096 00:23:31.503 02:43:05 -- host/auth.sh@49 -- # echo DHHC-1:03:OTk1NGRkYTBiMjBhMTc1MDg4MTViNDFhYTQ4ZjhjM2M5MDM0NzcyM2RkYTU0NWYxNTMwZWI0M2NiZjQ0NTBmNAr9IOk=: 00:23:31.503 02:43:05 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 4 00:23:31.503 02:43:05 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:31.503 02:43:05 -- host/auth.sh@68 -- # digest=sha384 00:23:31.503 02:43:05 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:23:31.503 02:43:05 -- host/auth.sh@68 -- # keyid=4 00:23:31.503 02:43:05 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:23:31.503 02:43:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:31.503 02:43:05 -- common/autotest_common.sh@10 -- # set +x 00:23:31.503 02:43:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:31.503 02:43:05 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:31.503 02:43:05 -- nvmf/common.sh@717 -- # local ip 00:23:31.503 02:43:05 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:31.503 02:43:05 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:31.503 02:43:05 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:31.503 02:43:05 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:31.503 02:43:05 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:31.503 02:43:05 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:31.503 02:43:05 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:31.503 02:43:05 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:31.504 02:43:05 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:31.504 02:43:05 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:23:31.504 02:43:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:31.504 02:43:05 -- common/autotest_common.sh@10 -- # set +x 00:23:31.761 nvme0n1 00:23:31.761 02:43:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:31.761 02:43:05 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:31.761 02:43:05 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:31.761 02:43:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:31.761 02:43:05 -- common/autotest_common.sh@10 -- # set +x 00:23:31.761 02:43:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:32.019 02:43:05 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:32.019 02:43:05 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:32.019 02:43:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:32.019 02:43:05 -- common/autotest_common.sh@10 -- # set +x 00:23:32.019 02:43:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:32.019 02:43:05 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:23:32.019 02:43:05 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:32.019 02:43:05 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 0 00:23:32.019 02:43:05 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:32.019 02:43:05 -- host/auth.sh@44 -- # digest=sha384 00:23:32.019 02:43:05 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:23:32.019 02:43:05 -- host/auth.sh@44 -- # keyid=0 00:23:32.019 02:43:05 -- host/auth.sh@45 -- # key=DHHC-1:00:YTVhYTdhYjViMDJmMjYzMzBjOTQ4NDg5NzM3YTI2Zjb26OQB: 00:23:32.019 02:43:05 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:23:32.019 02:43:05 -- host/auth.sh@48 -- # echo ffdhe6144 00:23:32.019 02:43:05 -- host/auth.sh@49 -- # echo DHHC-1:00:YTVhYTdhYjViMDJmMjYzMzBjOTQ4NDg5NzM3YTI2Zjb26OQB: 00:23:32.019 02:43:05 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 0 00:23:32.019 02:43:05 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:32.019 02:43:05 -- host/auth.sh@68 -- # digest=sha384 00:23:32.019 02:43:05 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:23:32.019 02:43:05 -- host/auth.sh@68 -- # keyid=0 00:23:32.019 02:43:05 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:23:32.019 02:43:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:32.019 02:43:05 -- common/autotest_common.sh@10 -- # set +x 00:23:32.019 02:43:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:32.019 02:43:05 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:32.019 02:43:05 -- nvmf/common.sh@717 -- # local ip 00:23:32.019 02:43:05 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:32.019 02:43:05 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:32.019 02:43:05 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:32.019 02:43:05 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:32.019 02:43:05 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:32.019 02:43:05 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:32.019 02:43:05 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:32.019 02:43:05 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:32.019 02:43:05 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:32.019 02:43:05 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:23:32.019 02:43:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:32.019 02:43:05 -- common/autotest_common.sh@10 -- # set +x 00:23:32.276 nvme0n1 00:23:32.276 02:43:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:32.276 02:43:05 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:32.276 02:43:05 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:32.276 02:43:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:32.276 02:43:05 -- common/autotest_common.sh@10 -- # set +x 00:23:32.276 02:43:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:32.276 02:43:05 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:32.277 02:43:05 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:32.277 02:43:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:32.277 02:43:05 -- common/autotest_common.sh@10 -- # set +x 00:23:32.277 02:43:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:32.277 02:43:05 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:32.277 02:43:05 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 1 00:23:32.277 02:43:05 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:32.277 02:43:05 -- host/auth.sh@44 -- # digest=sha384 00:23:32.277 02:43:05 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:23:32.277 02:43:05 -- host/auth.sh@44 -- # keyid=1 00:23:32.277 02:43:05 -- host/auth.sh@45 -- # key=DHHC-1:00:ODhjNjQ1NGFlZDFlNTJhNThiZTc2ZWY4NmI5NzRmNTI2M2U1Y2VhOWEwNjI5NjJiyej8LQ==: 00:23:32.277 02:43:05 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:23:32.277 02:43:05 -- host/auth.sh@48 -- # echo ffdhe6144 00:23:32.277 02:43:05 -- host/auth.sh@49 -- # echo DHHC-1:00:ODhjNjQ1NGFlZDFlNTJhNThiZTc2ZWY4NmI5NzRmNTI2M2U1Y2VhOWEwNjI5NjJiyej8LQ==: 00:23:32.277 02:43:05 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 1 00:23:32.277 02:43:05 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:32.277 02:43:05 -- host/auth.sh@68 -- # digest=sha384 00:23:32.277 02:43:05 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:23:32.277 02:43:05 -- host/auth.sh@68 -- # keyid=1 00:23:32.277 02:43:05 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:23:32.277 02:43:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:32.277 02:43:05 -- common/autotest_common.sh@10 -- # set +x 00:23:32.277 02:43:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:32.277 02:43:05 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:32.277 02:43:05 -- nvmf/common.sh@717 -- # local ip 00:23:32.277 02:43:05 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:32.277 02:43:05 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:32.277 02:43:05 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:32.277 02:43:05 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:32.277 02:43:05 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:32.277 02:43:05 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:32.277 02:43:05 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:32.277 02:43:05 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:32.277 02:43:05 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:32.277 02:43:05 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:23:32.277 02:43:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:32.277 02:43:05 -- common/autotest_common.sh@10 -- # set +x 00:23:32.843 nvme0n1 00:23:32.843 02:43:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:32.843 02:43:06 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:32.843 02:43:06 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:32.843 02:43:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:32.843 02:43:06 -- common/autotest_common.sh@10 -- # set +x 00:23:32.843 02:43:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:32.843 02:43:06 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:32.843 02:43:06 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:32.843 02:43:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:32.843 02:43:06 -- common/autotest_common.sh@10 -- # set +x 00:23:32.843 02:43:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:32.843 02:43:06 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:32.843 02:43:06 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 2 00:23:32.843 02:43:06 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:32.843 02:43:06 -- host/auth.sh@44 -- # digest=sha384 00:23:32.843 02:43:06 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:23:32.843 02:43:06 -- host/auth.sh@44 -- # keyid=2 00:23:32.843 02:43:06 -- host/auth.sh@45 -- # key=DHHC-1:01:Nzc2MWE1MjViOTA5OTUxOTRiZTEwNzExNDRkZjA4NWPly9CM: 00:23:32.843 02:43:06 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:23:32.843 02:43:06 -- host/auth.sh@48 -- # echo ffdhe6144 00:23:32.843 02:43:06 -- host/auth.sh@49 -- # echo DHHC-1:01:Nzc2MWE1MjViOTA5OTUxOTRiZTEwNzExNDRkZjA4NWPly9CM: 00:23:32.843 02:43:06 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 2 00:23:32.843 02:43:06 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:32.843 02:43:06 -- host/auth.sh@68 -- # digest=sha384 00:23:32.843 02:43:06 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:23:32.843 02:43:06 -- host/auth.sh@68 -- # keyid=2 00:23:32.843 02:43:06 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:23:32.843 02:43:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:32.843 02:43:06 -- common/autotest_common.sh@10 -- # set +x 00:23:32.843 02:43:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:32.843 02:43:06 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:32.843 02:43:06 -- nvmf/common.sh@717 -- # local ip 00:23:32.843 02:43:06 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:32.843 02:43:06 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:32.843 02:43:06 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:32.843 02:43:06 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:32.843 02:43:06 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:32.843 02:43:06 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:32.843 02:43:06 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:32.843 02:43:06 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:32.843 02:43:06 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:32.843 02:43:06 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:23:32.843 02:43:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:32.843 02:43:06 -- common/autotest_common.sh@10 -- # set +x 00:23:33.100 nvme0n1 00:23:33.100 02:43:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:33.100 02:43:06 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:33.100 02:43:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:33.100 02:43:06 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:33.100 02:43:06 -- common/autotest_common.sh@10 -- # set +x 00:23:33.358 02:43:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:33.358 02:43:06 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:33.358 02:43:06 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:33.358 02:43:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:33.358 02:43:06 -- common/autotest_common.sh@10 -- # set +x 00:23:33.358 02:43:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:33.358 02:43:06 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:33.358 02:43:06 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 3 00:23:33.358 02:43:06 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:33.358 02:43:06 -- host/auth.sh@44 -- # digest=sha384 00:23:33.358 02:43:06 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:23:33.358 02:43:06 -- host/auth.sh@44 -- # keyid=3 00:23:33.358 02:43:06 -- host/auth.sh@45 -- # key=DHHC-1:02:MzVhNzA3ZGQ0OWE0ZmYyZWI0ZjljYzljNTEyNGI3NjhkNGQ5MDM3YzVlZTFkZjY01CDZag==: 00:23:33.358 02:43:06 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:23:33.358 02:43:06 -- host/auth.sh@48 -- # echo ffdhe6144 00:23:33.358 02:43:06 -- host/auth.sh@49 -- # echo DHHC-1:02:MzVhNzA3ZGQ0OWE0ZmYyZWI0ZjljYzljNTEyNGI3NjhkNGQ5MDM3YzVlZTFkZjY01CDZag==: 00:23:33.358 02:43:06 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 3 00:23:33.358 02:43:06 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:33.358 02:43:06 -- host/auth.sh@68 -- # digest=sha384 00:23:33.358 02:43:06 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:23:33.358 02:43:06 -- host/auth.sh@68 -- # keyid=3 00:23:33.358 02:43:06 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:23:33.358 02:43:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:33.358 02:43:06 -- common/autotest_common.sh@10 -- # set +x 00:23:33.358 02:43:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:33.358 02:43:06 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:33.358 02:43:06 -- nvmf/common.sh@717 -- # local ip 00:23:33.358 02:43:06 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:33.358 02:43:06 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:33.358 02:43:06 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:33.358 02:43:06 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:33.358 02:43:06 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:33.358 02:43:06 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:33.358 02:43:06 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:33.358 02:43:06 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:33.358 02:43:06 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:33.358 02:43:06 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:23:33.358 02:43:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:33.358 02:43:06 -- common/autotest_common.sh@10 -- # set +x 00:23:33.616 nvme0n1 00:23:33.616 02:43:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:33.616 02:43:07 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:33.616 02:43:07 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:33.616 02:43:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:33.616 02:43:07 -- common/autotest_common.sh@10 -- # set +x 00:23:33.616 02:43:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:33.616 02:43:07 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:33.616 02:43:07 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:33.616 02:43:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:33.616 02:43:07 -- common/autotest_common.sh@10 -- # set +x 00:23:33.616 02:43:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:33.616 02:43:07 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:33.616 02:43:07 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 4 00:23:33.616 02:43:07 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:33.616 02:43:07 -- host/auth.sh@44 -- # digest=sha384 00:23:33.616 02:43:07 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:23:33.616 02:43:07 -- host/auth.sh@44 -- # keyid=4 00:23:33.616 02:43:07 -- host/auth.sh@45 -- # key=DHHC-1:03:OTk1NGRkYTBiMjBhMTc1MDg4MTViNDFhYTQ4ZjhjM2M5MDM0NzcyM2RkYTU0NWYxNTMwZWI0M2NiZjQ0NTBmNAr9IOk=: 00:23:33.616 02:43:07 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:23:33.616 02:43:07 -- host/auth.sh@48 -- # echo ffdhe6144 00:23:33.874 02:43:07 -- host/auth.sh@49 -- # echo DHHC-1:03:OTk1NGRkYTBiMjBhMTc1MDg4MTViNDFhYTQ4ZjhjM2M5MDM0NzcyM2RkYTU0NWYxNTMwZWI0M2NiZjQ0NTBmNAr9IOk=: 00:23:33.874 02:43:07 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 4 00:23:33.874 02:43:07 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:33.874 02:43:07 -- host/auth.sh@68 -- # digest=sha384 00:23:33.874 02:43:07 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:23:33.874 02:43:07 -- host/auth.sh@68 -- # keyid=4 00:23:33.874 02:43:07 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:23:33.874 02:43:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:33.874 02:43:07 -- common/autotest_common.sh@10 -- # set +x 00:23:33.874 02:43:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:33.874 02:43:07 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:33.874 02:43:07 -- nvmf/common.sh@717 -- # local ip 00:23:33.874 02:43:07 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:33.874 02:43:07 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:33.874 02:43:07 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:33.874 02:43:07 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:33.874 02:43:07 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:33.874 02:43:07 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:33.874 02:43:07 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:33.874 02:43:07 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:33.874 02:43:07 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:33.874 02:43:07 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:23:33.874 02:43:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:33.874 02:43:07 -- common/autotest_common.sh@10 -- # set +x 00:23:34.132 nvme0n1 00:23:34.132 02:43:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:34.132 02:43:07 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:34.132 02:43:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:34.132 02:43:07 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:34.132 02:43:07 -- common/autotest_common.sh@10 -- # set +x 00:23:34.132 02:43:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:34.132 02:43:07 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:34.132 02:43:07 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:34.132 02:43:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:34.132 02:43:07 -- common/autotest_common.sh@10 -- # set +x 00:23:34.132 02:43:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:34.132 02:43:07 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:23:34.132 02:43:07 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:34.132 02:43:07 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 0 00:23:34.132 02:43:07 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:34.132 02:43:07 -- host/auth.sh@44 -- # digest=sha384 00:23:34.132 02:43:07 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:23:34.132 02:43:07 -- host/auth.sh@44 -- # keyid=0 00:23:34.132 02:43:07 -- host/auth.sh@45 -- # key=DHHC-1:00:YTVhYTdhYjViMDJmMjYzMzBjOTQ4NDg5NzM3YTI2Zjb26OQB: 00:23:34.132 02:43:07 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:23:34.132 02:43:07 -- host/auth.sh@48 -- # echo ffdhe8192 00:23:34.132 02:43:07 -- host/auth.sh@49 -- # echo DHHC-1:00:YTVhYTdhYjViMDJmMjYzMzBjOTQ4NDg5NzM3YTI2Zjb26OQB: 00:23:34.132 02:43:07 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 0 00:23:34.132 02:43:07 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:34.132 02:43:07 -- host/auth.sh@68 -- # digest=sha384 00:23:34.132 02:43:07 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:23:34.132 02:43:07 -- host/auth.sh@68 -- # keyid=0 00:23:34.132 02:43:07 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:23:34.132 02:43:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:34.132 02:43:07 -- common/autotest_common.sh@10 -- # set +x 00:23:34.132 02:43:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:34.132 02:43:07 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:34.132 02:43:07 -- nvmf/common.sh@717 -- # local ip 00:23:34.132 02:43:07 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:34.132 02:43:07 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:34.132 02:43:07 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:34.132 02:43:07 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:34.132 02:43:07 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:34.132 02:43:07 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:34.132 02:43:07 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:34.132 02:43:07 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:34.132 02:43:07 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:34.132 02:43:07 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:23:34.132 02:43:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:34.132 02:43:07 -- common/autotest_common.sh@10 -- # set +x 00:23:34.697 nvme0n1 00:23:34.697 02:43:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:34.697 02:43:08 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:34.697 02:43:08 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:34.697 02:43:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:34.697 02:43:08 -- common/autotest_common.sh@10 -- # set +x 00:23:34.697 02:43:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:34.697 02:43:08 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:34.697 02:43:08 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:34.698 02:43:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:34.698 02:43:08 -- common/autotest_common.sh@10 -- # set +x 00:23:34.955 02:43:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:34.955 02:43:08 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:34.955 02:43:08 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 1 00:23:34.955 02:43:08 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:34.955 02:43:08 -- host/auth.sh@44 -- # digest=sha384 00:23:34.955 02:43:08 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:23:34.955 02:43:08 -- host/auth.sh@44 -- # keyid=1 00:23:34.955 02:43:08 -- host/auth.sh@45 -- # key=DHHC-1:00:ODhjNjQ1NGFlZDFlNTJhNThiZTc2ZWY4NmI5NzRmNTI2M2U1Y2VhOWEwNjI5NjJiyej8LQ==: 00:23:34.955 02:43:08 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:23:34.955 02:43:08 -- host/auth.sh@48 -- # echo ffdhe8192 00:23:34.955 02:43:08 -- host/auth.sh@49 -- # echo DHHC-1:00:ODhjNjQ1NGFlZDFlNTJhNThiZTc2ZWY4NmI5NzRmNTI2M2U1Y2VhOWEwNjI5NjJiyej8LQ==: 00:23:34.955 02:43:08 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 1 00:23:34.955 02:43:08 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:34.955 02:43:08 -- host/auth.sh@68 -- # digest=sha384 00:23:34.955 02:43:08 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:23:34.955 02:43:08 -- host/auth.sh@68 -- # keyid=1 00:23:34.956 02:43:08 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:23:34.956 02:43:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:34.956 02:43:08 -- common/autotest_common.sh@10 -- # set +x 00:23:34.956 02:43:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:34.956 02:43:08 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:34.956 02:43:08 -- nvmf/common.sh@717 -- # local ip 00:23:34.956 02:43:08 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:34.956 02:43:08 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:34.956 02:43:08 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:34.956 02:43:08 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:34.956 02:43:08 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:34.956 02:43:08 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:34.956 02:43:08 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:34.956 02:43:08 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:34.956 02:43:08 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:34.956 02:43:08 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:23:34.956 02:43:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:34.956 02:43:08 -- common/autotest_common.sh@10 -- # set +x 00:23:35.522 nvme0n1 00:23:35.522 02:43:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:35.522 02:43:08 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:35.522 02:43:08 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:35.522 02:43:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:35.522 02:43:08 -- common/autotest_common.sh@10 -- # set +x 00:23:35.522 02:43:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:35.522 02:43:08 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:35.522 02:43:08 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:35.522 02:43:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:35.522 02:43:08 -- common/autotest_common.sh@10 -- # set +x 00:23:35.522 02:43:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:35.522 02:43:08 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:35.522 02:43:08 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 2 00:23:35.522 02:43:08 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:35.522 02:43:08 -- host/auth.sh@44 -- # digest=sha384 00:23:35.522 02:43:08 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:23:35.522 02:43:08 -- host/auth.sh@44 -- # keyid=2 00:23:35.522 02:43:08 -- host/auth.sh@45 -- # key=DHHC-1:01:Nzc2MWE1MjViOTA5OTUxOTRiZTEwNzExNDRkZjA4NWPly9CM: 00:23:35.522 02:43:08 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:23:35.522 02:43:08 -- host/auth.sh@48 -- # echo ffdhe8192 00:23:35.522 02:43:08 -- host/auth.sh@49 -- # echo DHHC-1:01:Nzc2MWE1MjViOTA5OTUxOTRiZTEwNzExNDRkZjA4NWPly9CM: 00:23:35.522 02:43:08 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 2 00:23:35.522 02:43:08 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:35.522 02:43:08 -- host/auth.sh@68 -- # digest=sha384 00:23:35.522 02:43:08 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:23:35.522 02:43:08 -- host/auth.sh@68 -- # keyid=2 00:23:35.522 02:43:08 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:23:35.522 02:43:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:35.522 02:43:08 -- common/autotest_common.sh@10 -- # set +x 00:23:35.522 02:43:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:35.522 02:43:08 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:35.522 02:43:08 -- nvmf/common.sh@717 -- # local ip 00:23:35.522 02:43:08 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:35.522 02:43:08 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:35.522 02:43:08 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:35.522 02:43:08 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:35.522 02:43:08 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:35.522 02:43:08 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:35.522 02:43:08 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:35.522 02:43:08 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:35.522 02:43:08 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:35.522 02:43:08 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:23:35.522 02:43:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:35.522 02:43:08 -- common/autotest_common.sh@10 -- # set +x 00:23:36.088 nvme0n1 00:23:36.088 02:43:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:36.088 02:43:09 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:36.088 02:43:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:36.088 02:43:09 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:36.088 02:43:09 -- common/autotest_common.sh@10 -- # set +x 00:23:36.088 02:43:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:36.088 02:43:09 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:36.088 02:43:09 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:36.088 02:43:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:36.088 02:43:09 -- common/autotest_common.sh@10 -- # set +x 00:23:36.088 02:43:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:36.088 02:43:09 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:36.088 02:43:09 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 3 00:23:36.088 02:43:09 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:36.088 02:43:09 -- host/auth.sh@44 -- # digest=sha384 00:23:36.088 02:43:09 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:23:36.088 02:43:09 -- host/auth.sh@44 -- # keyid=3 00:23:36.088 02:43:09 -- host/auth.sh@45 -- # key=DHHC-1:02:MzVhNzA3ZGQ0OWE0ZmYyZWI0ZjljYzljNTEyNGI3NjhkNGQ5MDM3YzVlZTFkZjY01CDZag==: 00:23:36.088 02:43:09 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:23:36.088 02:43:09 -- host/auth.sh@48 -- # echo ffdhe8192 00:23:36.088 02:43:09 -- host/auth.sh@49 -- # echo DHHC-1:02:MzVhNzA3ZGQ0OWE0ZmYyZWI0ZjljYzljNTEyNGI3NjhkNGQ5MDM3YzVlZTFkZjY01CDZag==: 00:23:36.088 02:43:09 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 3 00:23:36.088 02:43:09 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:36.088 02:43:09 -- host/auth.sh@68 -- # digest=sha384 00:23:36.088 02:43:09 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:23:36.088 02:43:09 -- host/auth.sh@68 -- # keyid=3 00:23:36.088 02:43:09 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:23:36.088 02:43:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:36.088 02:43:09 -- common/autotest_common.sh@10 -- # set +x 00:23:36.088 02:43:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:36.088 02:43:09 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:36.088 02:43:09 -- nvmf/common.sh@717 -- # local ip 00:23:36.088 02:43:09 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:36.088 02:43:09 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:36.088 02:43:09 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:36.088 02:43:09 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:36.088 02:43:09 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:36.088 02:43:09 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:36.088 02:43:09 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:36.088 02:43:09 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:36.088 02:43:09 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:36.088 02:43:09 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:23:36.088 02:43:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:36.088 02:43:09 -- common/autotest_common.sh@10 -- # set +x 00:23:36.653 nvme0n1 00:23:36.654 02:43:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:36.654 02:43:10 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:36.654 02:43:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:36.654 02:43:10 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:36.654 02:43:10 -- common/autotest_common.sh@10 -- # set +x 00:23:36.654 02:43:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:36.654 02:43:10 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:36.654 02:43:10 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:36.654 02:43:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:36.654 02:43:10 -- common/autotest_common.sh@10 -- # set +x 00:23:36.654 02:43:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:36.654 02:43:10 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:36.654 02:43:10 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 4 00:23:36.654 02:43:10 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:36.654 02:43:10 -- host/auth.sh@44 -- # digest=sha384 00:23:36.654 02:43:10 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:23:36.911 02:43:10 -- host/auth.sh@44 -- # keyid=4 00:23:36.911 02:43:10 -- host/auth.sh@45 -- # key=DHHC-1:03:OTk1NGRkYTBiMjBhMTc1MDg4MTViNDFhYTQ4ZjhjM2M5MDM0NzcyM2RkYTU0NWYxNTMwZWI0M2NiZjQ0NTBmNAr9IOk=: 00:23:36.911 02:43:10 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:23:36.911 02:43:10 -- host/auth.sh@48 -- # echo ffdhe8192 00:23:36.911 02:43:10 -- host/auth.sh@49 -- # echo DHHC-1:03:OTk1NGRkYTBiMjBhMTc1MDg4MTViNDFhYTQ4ZjhjM2M5MDM0NzcyM2RkYTU0NWYxNTMwZWI0M2NiZjQ0NTBmNAr9IOk=: 00:23:36.911 02:43:10 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 4 00:23:36.911 02:43:10 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:36.911 02:43:10 -- host/auth.sh@68 -- # digest=sha384 00:23:36.911 02:43:10 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:23:36.911 02:43:10 -- host/auth.sh@68 -- # keyid=4 00:23:36.912 02:43:10 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:23:36.912 02:43:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:36.912 02:43:10 -- common/autotest_common.sh@10 -- # set +x 00:23:36.912 02:43:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:36.912 02:43:10 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:36.912 02:43:10 -- nvmf/common.sh@717 -- # local ip 00:23:36.912 02:43:10 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:36.912 02:43:10 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:36.912 02:43:10 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:36.912 02:43:10 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:36.912 02:43:10 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:36.912 02:43:10 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:36.912 02:43:10 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:36.912 02:43:10 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:36.912 02:43:10 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:36.912 02:43:10 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:23:36.912 02:43:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:36.912 02:43:10 -- common/autotest_common.sh@10 -- # set +x 00:23:37.517 nvme0n1 00:23:37.517 02:43:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:37.517 02:43:10 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:37.517 02:43:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:37.517 02:43:10 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:37.517 02:43:10 -- common/autotest_common.sh@10 -- # set +x 00:23:37.517 02:43:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:37.517 02:43:10 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:37.517 02:43:10 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:37.517 02:43:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:37.517 02:43:10 -- common/autotest_common.sh@10 -- # set +x 00:23:37.517 02:43:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:37.517 02:43:10 -- host/auth.sh@107 -- # for digest in "${digests[@]}" 00:23:37.517 02:43:10 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:23:37.517 02:43:10 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:37.517 02:43:10 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 0 00:23:37.517 02:43:10 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:37.517 02:43:10 -- host/auth.sh@44 -- # digest=sha512 00:23:37.517 02:43:10 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:23:37.517 02:43:10 -- host/auth.sh@44 -- # keyid=0 00:23:37.517 02:43:10 -- host/auth.sh@45 -- # key=DHHC-1:00:YTVhYTdhYjViMDJmMjYzMzBjOTQ4NDg5NzM3YTI2Zjb26OQB: 00:23:37.517 02:43:10 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:23:37.517 02:43:10 -- host/auth.sh@48 -- # echo ffdhe2048 00:23:37.517 02:43:10 -- host/auth.sh@49 -- # echo DHHC-1:00:YTVhYTdhYjViMDJmMjYzMzBjOTQ4NDg5NzM3YTI2Zjb26OQB: 00:23:37.517 02:43:10 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 0 00:23:37.517 02:43:10 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:37.517 02:43:10 -- host/auth.sh@68 -- # digest=sha512 00:23:37.517 02:43:10 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:23:37.517 02:43:10 -- host/auth.sh@68 -- # keyid=0 00:23:37.517 02:43:10 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:23:37.517 02:43:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:37.517 02:43:10 -- common/autotest_common.sh@10 -- # set +x 00:23:37.517 02:43:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:37.517 02:43:10 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:37.517 02:43:10 -- nvmf/common.sh@717 -- # local ip 00:23:37.517 02:43:10 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:37.517 02:43:10 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:37.517 02:43:10 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:37.517 02:43:10 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:37.517 02:43:10 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:37.517 02:43:10 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:37.517 02:43:10 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:37.517 02:43:10 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:37.517 02:43:10 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:37.517 02:43:10 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:23:37.517 02:43:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:37.517 02:43:10 -- common/autotest_common.sh@10 -- # set +x 00:23:37.517 nvme0n1 00:23:37.517 02:43:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:37.517 02:43:11 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:37.776 02:43:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:37.776 02:43:11 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:37.776 02:43:11 -- common/autotest_common.sh@10 -- # set +x 00:23:37.776 02:43:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:37.776 02:43:11 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:37.776 02:43:11 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:37.776 02:43:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:37.776 02:43:11 -- common/autotest_common.sh@10 -- # set +x 00:23:37.776 02:43:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:37.776 02:43:11 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:37.776 02:43:11 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 1 00:23:37.776 02:43:11 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:37.776 02:43:11 -- host/auth.sh@44 -- # digest=sha512 00:23:37.776 02:43:11 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:23:37.776 02:43:11 -- host/auth.sh@44 -- # keyid=1 00:23:37.776 02:43:11 -- host/auth.sh@45 -- # key=DHHC-1:00:ODhjNjQ1NGFlZDFlNTJhNThiZTc2ZWY4NmI5NzRmNTI2M2U1Y2VhOWEwNjI5NjJiyej8LQ==: 00:23:37.776 02:43:11 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:23:37.776 02:43:11 -- host/auth.sh@48 -- # echo ffdhe2048 00:23:37.776 02:43:11 -- host/auth.sh@49 -- # echo DHHC-1:00:ODhjNjQ1NGFlZDFlNTJhNThiZTc2ZWY4NmI5NzRmNTI2M2U1Y2VhOWEwNjI5NjJiyej8LQ==: 00:23:37.776 02:43:11 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 1 00:23:37.776 02:43:11 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:37.776 02:43:11 -- host/auth.sh@68 -- # digest=sha512 00:23:37.776 02:43:11 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:23:37.776 02:43:11 -- host/auth.sh@68 -- # keyid=1 00:23:37.776 02:43:11 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:23:37.776 02:43:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:37.776 02:43:11 -- common/autotest_common.sh@10 -- # set +x 00:23:37.776 02:43:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:37.776 02:43:11 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:37.776 02:43:11 -- nvmf/common.sh@717 -- # local ip 00:23:37.776 02:43:11 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:37.776 02:43:11 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:37.776 02:43:11 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:37.776 02:43:11 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:37.776 02:43:11 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:37.776 02:43:11 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:37.776 02:43:11 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:37.776 02:43:11 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:37.776 02:43:11 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:37.776 02:43:11 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:23:37.776 02:43:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:37.776 02:43:11 -- common/autotest_common.sh@10 -- # set +x 00:23:38.034 nvme0n1 00:23:38.034 02:43:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:38.034 02:43:11 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:38.034 02:43:11 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:38.034 02:43:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:38.034 02:43:11 -- common/autotest_common.sh@10 -- # set +x 00:23:38.034 02:43:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:38.034 02:43:11 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:38.034 02:43:11 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:38.034 02:43:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:38.034 02:43:11 -- common/autotest_common.sh@10 -- # set +x 00:23:38.034 02:43:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:38.034 02:43:11 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:38.034 02:43:11 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 2 00:23:38.034 02:43:11 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:38.034 02:43:11 -- host/auth.sh@44 -- # digest=sha512 00:23:38.034 02:43:11 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:23:38.034 02:43:11 -- host/auth.sh@44 -- # keyid=2 00:23:38.034 02:43:11 -- host/auth.sh@45 -- # key=DHHC-1:01:Nzc2MWE1MjViOTA5OTUxOTRiZTEwNzExNDRkZjA4NWPly9CM: 00:23:38.034 02:43:11 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:23:38.034 02:43:11 -- host/auth.sh@48 -- # echo ffdhe2048 00:23:38.034 02:43:11 -- host/auth.sh@49 -- # echo DHHC-1:01:Nzc2MWE1MjViOTA5OTUxOTRiZTEwNzExNDRkZjA4NWPly9CM: 00:23:38.034 02:43:11 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 2 00:23:38.034 02:43:11 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:38.034 02:43:11 -- host/auth.sh@68 -- # digest=sha512 00:23:38.034 02:43:11 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:23:38.034 02:43:11 -- host/auth.sh@68 -- # keyid=2 00:23:38.034 02:43:11 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:23:38.034 02:43:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:38.034 02:43:11 -- common/autotest_common.sh@10 -- # set +x 00:23:38.034 02:43:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:38.034 02:43:11 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:38.034 02:43:11 -- nvmf/common.sh@717 -- # local ip 00:23:38.034 02:43:11 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:38.034 02:43:11 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:38.034 02:43:11 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:38.034 02:43:11 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:38.034 02:43:11 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:38.034 02:43:11 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:38.034 02:43:11 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:38.034 02:43:11 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:38.034 02:43:11 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:38.034 02:43:11 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:23:38.034 02:43:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:38.034 02:43:11 -- common/autotest_common.sh@10 -- # set +x 00:23:38.292 nvme0n1 00:23:38.292 02:43:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:38.292 02:43:11 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:38.292 02:43:11 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:38.292 02:43:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:38.292 02:43:11 -- common/autotest_common.sh@10 -- # set +x 00:23:38.292 02:43:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:38.292 02:43:11 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:38.292 02:43:11 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:38.292 02:43:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:38.292 02:43:11 -- common/autotest_common.sh@10 -- # set +x 00:23:38.292 02:43:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:38.292 02:43:11 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:38.292 02:43:11 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 3 00:23:38.292 02:43:11 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:38.292 02:43:11 -- host/auth.sh@44 -- # digest=sha512 00:23:38.292 02:43:11 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:23:38.292 02:43:11 -- host/auth.sh@44 -- # keyid=3 00:23:38.292 02:43:11 -- host/auth.sh@45 -- # key=DHHC-1:02:MzVhNzA3ZGQ0OWE0ZmYyZWI0ZjljYzljNTEyNGI3NjhkNGQ5MDM3YzVlZTFkZjY01CDZag==: 00:23:38.292 02:43:11 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:23:38.292 02:43:11 -- host/auth.sh@48 -- # echo ffdhe2048 00:23:38.292 02:43:11 -- host/auth.sh@49 -- # echo DHHC-1:02:MzVhNzA3ZGQ0OWE0ZmYyZWI0ZjljYzljNTEyNGI3NjhkNGQ5MDM3YzVlZTFkZjY01CDZag==: 00:23:38.292 02:43:11 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 3 00:23:38.292 02:43:11 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:38.292 02:43:11 -- host/auth.sh@68 -- # digest=sha512 00:23:38.293 02:43:11 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:23:38.293 02:43:11 -- host/auth.sh@68 -- # keyid=3 00:23:38.293 02:43:11 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:23:38.293 02:43:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:38.293 02:43:11 -- common/autotest_common.sh@10 -- # set +x 00:23:38.293 02:43:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:38.293 02:43:11 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:38.293 02:43:11 -- nvmf/common.sh@717 -- # local ip 00:23:38.293 02:43:11 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:38.293 02:43:11 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:38.293 02:43:11 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:38.293 02:43:11 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:38.293 02:43:11 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:38.293 02:43:11 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:38.293 02:43:11 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:38.293 02:43:11 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:38.293 02:43:11 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:38.293 02:43:11 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:23:38.293 02:43:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:38.293 02:43:11 -- common/autotest_common.sh@10 -- # set +x 00:23:38.552 nvme0n1 00:23:38.552 02:43:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:38.552 02:43:11 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:38.552 02:43:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:38.552 02:43:11 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:38.552 02:43:11 -- common/autotest_common.sh@10 -- # set +x 00:23:38.552 02:43:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:38.552 02:43:11 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:38.552 02:43:11 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:38.552 02:43:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:38.552 02:43:11 -- common/autotest_common.sh@10 -- # set +x 00:23:38.552 02:43:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:38.552 02:43:11 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:38.552 02:43:11 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 4 00:23:38.552 02:43:12 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:38.552 02:43:12 -- host/auth.sh@44 -- # digest=sha512 00:23:38.552 02:43:12 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:23:38.552 02:43:12 -- host/auth.sh@44 -- # keyid=4 00:23:38.552 02:43:12 -- host/auth.sh@45 -- # key=DHHC-1:03:OTk1NGRkYTBiMjBhMTc1MDg4MTViNDFhYTQ4ZjhjM2M5MDM0NzcyM2RkYTU0NWYxNTMwZWI0M2NiZjQ0NTBmNAr9IOk=: 00:23:38.552 02:43:12 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:23:38.552 02:43:12 -- host/auth.sh@48 -- # echo ffdhe2048 00:23:38.552 02:43:12 -- host/auth.sh@49 -- # echo DHHC-1:03:OTk1NGRkYTBiMjBhMTc1MDg4MTViNDFhYTQ4ZjhjM2M5MDM0NzcyM2RkYTU0NWYxNTMwZWI0M2NiZjQ0NTBmNAr9IOk=: 00:23:38.552 02:43:12 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 4 00:23:38.552 02:43:12 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:38.552 02:43:12 -- host/auth.sh@68 -- # digest=sha512 00:23:38.552 02:43:12 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:23:38.552 02:43:12 -- host/auth.sh@68 -- # keyid=4 00:23:38.552 02:43:12 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:23:38.552 02:43:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:38.552 02:43:12 -- common/autotest_common.sh@10 -- # set +x 00:23:38.552 02:43:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:38.552 02:43:12 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:38.552 02:43:12 -- nvmf/common.sh@717 -- # local ip 00:23:38.552 02:43:12 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:38.552 02:43:12 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:38.552 02:43:12 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:38.552 02:43:12 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:38.552 02:43:12 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:38.552 02:43:12 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:38.552 02:43:12 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:38.552 02:43:12 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:38.552 02:43:12 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:38.552 02:43:12 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:23:38.552 02:43:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:38.552 02:43:12 -- common/autotest_common.sh@10 -- # set +x 00:23:38.814 nvme0n1 00:23:38.814 02:43:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:38.814 02:43:12 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:38.814 02:43:12 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:38.814 02:43:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:38.814 02:43:12 -- common/autotest_common.sh@10 -- # set +x 00:23:38.814 02:43:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:38.814 02:43:12 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:38.814 02:43:12 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:38.814 02:43:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:38.814 02:43:12 -- common/autotest_common.sh@10 -- # set +x 00:23:38.814 02:43:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:38.814 02:43:12 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:23:38.814 02:43:12 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:38.814 02:43:12 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 0 00:23:38.814 02:43:12 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:38.814 02:43:12 -- host/auth.sh@44 -- # digest=sha512 00:23:38.814 02:43:12 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:23:38.814 02:43:12 -- host/auth.sh@44 -- # keyid=0 00:23:38.814 02:43:12 -- host/auth.sh@45 -- # key=DHHC-1:00:YTVhYTdhYjViMDJmMjYzMzBjOTQ4NDg5NzM3YTI2Zjb26OQB: 00:23:38.814 02:43:12 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:23:38.814 02:43:12 -- host/auth.sh@48 -- # echo ffdhe3072 00:23:38.814 02:43:12 -- host/auth.sh@49 -- # echo DHHC-1:00:YTVhYTdhYjViMDJmMjYzMzBjOTQ4NDg5NzM3YTI2Zjb26OQB: 00:23:38.814 02:43:12 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 0 00:23:38.814 02:43:12 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:38.814 02:43:12 -- host/auth.sh@68 -- # digest=sha512 00:23:38.814 02:43:12 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:23:38.814 02:43:12 -- host/auth.sh@68 -- # keyid=0 00:23:38.814 02:43:12 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:23:38.814 02:43:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:38.814 02:43:12 -- common/autotest_common.sh@10 -- # set +x 00:23:38.814 02:43:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:38.814 02:43:12 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:38.814 02:43:12 -- nvmf/common.sh@717 -- # local ip 00:23:38.814 02:43:12 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:38.814 02:43:12 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:38.814 02:43:12 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:38.814 02:43:12 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:38.814 02:43:12 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:38.814 02:43:12 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:38.814 02:43:12 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:38.814 02:43:12 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:38.814 02:43:12 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:38.814 02:43:12 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:23:38.814 02:43:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:38.814 02:43:12 -- common/autotest_common.sh@10 -- # set +x 00:23:39.073 nvme0n1 00:23:39.073 02:43:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:39.073 02:43:12 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:39.073 02:43:12 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:39.073 02:43:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:39.073 02:43:12 -- common/autotest_common.sh@10 -- # set +x 00:23:39.073 02:43:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:39.073 02:43:12 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:39.073 02:43:12 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:39.073 02:43:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:39.073 02:43:12 -- common/autotest_common.sh@10 -- # set +x 00:23:39.073 02:43:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:39.073 02:43:12 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:39.073 02:43:12 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 1 00:23:39.073 02:43:12 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:39.073 02:43:12 -- host/auth.sh@44 -- # digest=sha512 00:23:39.073 02:43:12 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:23:39.073 02:43:12 -- host/auth.sh@44 -- # keyid=1 00:23:39.073 02:43:12 -- host/auth.sh@45 -- # key=DHHC-1:00:ODhjNjQ1NGFlZDFlNTJhNThiZTc2ZWY4NmI5NzRmNTI2M2U1Y2VhOWEwNjI5NjJiyej8LQ==: 00:23:39.073 02:43:12 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:23:39.073 02:43:12 -- host/auth.sh@48 -- # echo ffdhe3072 00:23:39.073 02:43:12 -- host/auth.sh@49 -- # echo DHHC-1:00:ODhjNjQ1NGFlZDFlNTJhNThiZTc2ZWY4NmI5NzRmNTI2M2U1Y2VhOWEwNjI5NjJiyej8LQ==: 00:23:39.073 02:43:12 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 1 00:23:39.073 02:43:12 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:39.073 02:43:12 -- host/auth.sh@68 -- # digest=sha512 00:23:39.073 02:43:12 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:23:39.073 02:43:12 -- host/auth.sh@68 -- # keyid=1 00:23:39.073 02:43:12 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:23:39.073 02:43:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:39.073 02:43:12 -- common/autotest_common.sh@10 -- # set +x 00:23:39.073 02:43:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:39.073 02:43:12 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:39.073 02:43:12 -- nvmf/common.sh@717 -- # local ip 00:23:39.073 02:43:12 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:39.073 02:43:12 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:39.073 02:43:12 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:39.073 02:43:12 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:39.073 02:43:12 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:39.073 02:43:12 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:39.073 02:43:12 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:39.073 02:43:12 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:39.073 02:43:12 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:39.073 02:43:12 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:23:39.073 02:43:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:39.073 02:43:12 -- common/autotest_common.sh@10 -- # set +x 00:23:39.331 nvme0n1 00:23:39.331 02:43:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:39.331 02:43:12 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:39.331 02:43:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:39.331 02:43:12 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:39.331 02:43:12 -- common/autotest_common.sh@10 -- # set +x 00:23:39.331 02:43:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:39.331 02:43:12 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:39.331 02:43:12 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:39.331 02:43:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:39.331 02:43:12 -- common/autotest_common.sh@10 -- # set +x 00:23:39.331 02:43:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:39.331 02:43:12 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:39.331 02:43:12 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 2 00:23:39.331 02:43:12 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:39.331 02:43:12 -- host/auth.sh@44 -- # digest=sha512 00:23:39.331 02:43:12 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:23:39.331 02:43:12 -- host/auth.sh@44 -- # keyid=2 00:23:39.331 02:43:12 -- host/auth.sh@45 -- # key=DHHC-1:01:Nzc2MWE1MjViOTA5OTUxOTRiZTEwNzExNDRkZjA4NWPly9CM: 00:23:39.331 02:43:12 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:23:39.331 02:43:12 -- host/auth.sh@48 -- # echo ffdhe3072 00:23:39.331 02:43:12 -- host/auth.sh@49 -- # echo DHHC-1:01:Nzc2MWE1MjViOTA5OTUxOTRiZTEwNzExNDRkZjA4NWPly9CM: 00:23:39.331 02:43:12 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 2 00:23:39.331 02:43:12 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:39.331 02:43:12 -- host/auth.sh@68 -- # digest=sha512 00:23:39.331 02:43:12 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:23:39.331 02:43:12 -- host/auth.sh@68 -- # keyid=2 00:23:39.331 02:43:12 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:23:39.331 02:43:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:39.331 02:43:12 -- common/autotest_common.sh@10 -- # set +x 00:23:39.331 02:43:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:39.331 02:43:12 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:39.331 02:43:12 -- nvmf/common.sh@717 -- # local ip 00:23:39.331 02:43:12 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:39.331 02:43:12 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:39.331 02:43:12 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:39.331 02:43:12 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:39.331 02:43:12 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:39.331 02:43:12 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:39.331 02:43:12 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:39.331 02:43:12 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:39.331 02:43:12 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:39.331 02:43:12 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:23:39.331 02:43:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:39.331 02:43:12 -- common/autotest_common.sh@10 -- # set +x 00:23:39.588 nvme0n1 00:23:39.588 02:43:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:39.588 02:43:13 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:39.588 02:43:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:39.588 02:43:13 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:39.588 02:43:13 -- common/autotest_common.sh@10 -- # set +x 00:23:39.588 02:43:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:39.588 02:43:13 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:39.588 02:43:13 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:39.588 02:43:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:39.588 02:43:13 -- common/autotest_common.sh@10 -- # set +x 00:23:39.588 02:43:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:39.588 02:43:13 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:39.588 02:43:13 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 3 00:23:39.588 02:43:13 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:39.588 02:43:13 -- host/auth.sh@44 -- # digest=sha512 00:23:39.588 02:43:13 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:23:39.588 02:43:13 -- host/auth.sh@44 -- # keyid=3 00:23:39.588 02:43:13 -- host/auth.sh@45 -- # key=DHHC-1:02:MzVhNzA3ZGQ0OWE0ZmYyZWI0ZjljYzljNTEyNGI3NjhkNGQ5MDM3YzVlZTFkZjY01CDZag==: 00:23:39.588 02:43:13 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:23:39.588 02:43:13 -- host/auth.sh@48 -- # echo ffdhe3072 00:23:39.588 02:43:13 -- host/auth.sh@49 -- # echo DHHC-1:02:MzVhNzA3ZGQ0OWE0ZmYyZWI0ZjljYzljNTEyNGI3NjhkNGQ5MDM3YzVlZTFkZjY01CDZag==: 00:23:39.588 02:43:13 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 3 00:23:39.588 02:43:13 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:39.588 02:43:13 -- host/auth.sh@68 -- # digest=sha512 00:23:39.588 02:43:13 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:23:39.588 02:43:13 -- host/auth.sh@68 -- # keyid=3 00:23:39.588 02:43:13 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:23:39.588 02:43:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:39.588 02:43:13 -- common/autotest_common.sh@10 -- # set +x 00:23:39.588 02:43:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:39.588 02:43:13 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:39.588 02:43:13 -- nvmf/common.sh@717 -- # local ip 00:23:39.588 02:43:13 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:39.588 02:43:13 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:39.588 02:43:13 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:39.588 02:43:13 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:39.588 02:43:13 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:39.588 02:43:13 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:39.589 02:43:13 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:39.589 02:43:13 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:39.589 02:43:13 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:39.589 02:43:13 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:23:39.589 02:43:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:39.589 02:43:13 -- common/autotest_common.sh@10 -- # set +x 00:23:39.846 nvme0n1 00:23:39.846 02:43:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:39.846 02:43:13 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:39.846 02:43:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:39.846 02:43:13 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:39.846 02:43:13 -- common/autotest_common.sh@10 -- # set +x 00:23:39.846 02:43:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:39.846 02:43:13 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:39.846 02:43:13 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:39.846 02:43:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:39.846 02:43:13 -- common/autotest_common.sh@10 -- # set +x 00:23:39.846 02:43:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:39.846 02:43:13 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:39.846 02:43:13 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 4 00:23:39.846 02:43:13 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:39.846 02:43:13 -- host/auth.sh@44 -- # digest=sha512 00:23:39.846 02:43:13 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:23:39.846 02:43:13 -- host/auth.sh@44 -- # keyid=4 00:23:39.846 02:43:13 -- host/auth.sh@45 -- # key=DHHC-1:03:OTk1NGRkYTBiMjBhMTc1MDg4MTViNDFhYTQ4ZjhjM2M5MDM0NzcyM2RkYTU0NWYxNTMwZWI0M2NiZjQ0NTBmNAr9IOk=: 00:23:39.846 02:43:13 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:23:39.846 02:43:13 -- host/auth.sh@48 -- # echo ffdhe3072 00:23:39.846 02:43:13 -- host/auth.sh@49 -- # echo DHHC-1:03:OTk1NGRkYTBiMjBhMTc1MDg4MTViNDFhYTQ4ZjhjM2M5MDM0NzcyM2RkYTU0NWYxNTMwZWI0M2NiZjQ0NTBmNAr9IOk=: 00:23:39.846 02:43:13 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 4 00:23:39.846 02:43:13 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:39.846 02:43:13 -- host/auth.sh@68 -- # digest=sha512 00:23:39.846 02:43:13 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:23:39.846 02:43:13 -- host/auth.sh@68 -- # keyid=4 00:23:39.846 02:43:13 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:23:39.846 02:43:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:39.846 02:43:13 -- common/autotest_common.sh@10 -- # set +x 00:23:39.846 02:43:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:39.846 02:43:13 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:39.846 02:43:13 -- nvmf/common.sh@717 -- # local ip 00:23:39.846 02:43:13 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:39.846 02:43:13 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:39.847 02:43:13 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:39.847 02:43:13 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:39.847 02:43:13 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:39.847 02:43:13 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:39.847 02:43:13 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:39.847 02:43:13 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:39.847 02:43:13 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:39.847 02:43:13 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:23:39.847 02:43:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:39.847 02:43:13 -- common/autotest_common.sh@10 -- # set +x 00:23:40.104 nvme0n1 00:23:40.104 02:43:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:40.104 02:43:13 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:40.104 02:43:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:40.104 02:43:13 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:40.104 02:43:13 -- common/autotest_common.sh@10 -- # set +x 00:23:40.104 02:43:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:40.104 02:43:13 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:40.104 02:43:13 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:40.104 02:43:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:40.104 02:43:13 -- common/autotest_common.sh@10 -- # set +x 00:23:40.104 02:43:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:40.104 02:43:13 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:23:40.104 02:43:13 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:40.104 02:43:13 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 0 00:23:40.104 02:43:13 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:40.104 02:43:13 -- host/auth.sh@44 -- # digest=sha512 00:23:40.104 02:43:13 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:23:40.104 02:43:13 -- host/auth.sh@44 -- # keyid=0 00:23:40.104 02:43:13 -- host/auth.sh@45 -- # key=DHHC-1:00:YTVhYTdhYjViMDJmMjYzMzBjOTQ4NDg5NzM3YTI2Zjb26OQB: 00:23:40.105 02:43:13 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:23:40.105 02:43:13 -- host/auth.sh@48 -- # echo ffdhe4096 00:23:40.105 02:43:13 -- host/auth.sh@49 -- # echo DHHC-1:00:YTVhYTdhYjViMDJmMjYzMzBjOTQ4NDg5NzM3YTI2Zjb26OQB: 00:23:40.105 02:43:13 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 0 00:23:40.105 02:43:13 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:40.105 02:43:13 -- host/auth.sh@68 -- # digest=sha512 00:23:40.105 02:43:13 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:23:40.105 02:43:13 -- host/auth.sh@68 -- # keyid=0 00:23:40.105 02:43:13 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:23:40.105 02:43:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:40.105 02:43:13 -- common/autotest_common.sh@10 -- # set +x 00:23:40.105 02:43:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:40.105 02:43:13 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:40.105 02:43:13 -- nvmf/common.sh@717 -- # local ip 00:23:40.105 02:43:13 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:40.105 02:43:13 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:40.105 02:43:13 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:40.105 02:43:13 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:40.105 02:43:13 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:40.105 02:43:13 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:40.105 02:43:13 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:40.105 02:43:13 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:40.105 02:43:13 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:40.105 02:43:13 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:23:40.105 02:43:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:40.105 02:43:13 -- common/autotest_common.sh@10 -- # set +x 00:23:40.363 nvme0n1 00:23:40.363 02:43:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:40.363 02:43:13 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:40.363 02:43:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:40.363 02:43:13 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:40.363 02:43:13 -- common/autotest_common.sh@10 -- # set +x 00:23:40.363 02:43:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:40.620 02:43:13 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:40.621 02:43:13 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:40.621 02:43:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:40.621 02:43:14 -- common/autotest_common.sh@10 -- # set +x 00:23:40.621 02:43:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:40.621 02:43:14 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:40.621 02:43:14 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 1 00:23:40.621 02:43:14 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:40.621 02:43:14 -- host/auth.sh@44 -- # digest=sha512 00:23:40.621 02:43:14 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:23:40.621 02:43:14 -- host/auth.sh@44 -- # keyid=1 00:23:40.621 02:43:14 -- host/auth.sh@45 -- # key=DHHC-1:00:ODhjNjQ1NGFlZDFlNTJhNThiZTc2ZWY4NmI5NzRmNTI2M2U1Y2VhOWEwNjI5NjJiyej8LQ==: 00:23:40.621 02:43:14 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:23:40.621 02:43:14 -- host/auth.sh@48 -- # echo ffdhe4096 00:23:40.621 02:43:14 -- host/auth.sh@49 -- # echo DHHC-1:00:ODhjNjQ1NGFlZDFlNTJhNThiZTc2ZWY4NmI5NzRmNTI2M2U1Y2VhOWEwNjI5NjJiyej8LQ==: 00:23:40.621 02:43:14 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 1 00:23:40.621 02:43:14 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:40.621 02:43:14 -- host/auth.sh@68 -- # digest=sha512 00:23:40.621 02:43:14 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:23:40.621 02:43:14 -- host/auth.sh@68 -- # keyid=1 00:23:40.621 02:43:14 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:23:40.621 02:43:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:40.621 02:43:14 -- common/autotest_common.sh@10 -- # set +x 00:23:40.621 02:43:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:40.621 02:43:14 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:40.621 02:43:14 -- nvmf/common.sh@717 -- # local ip 00:23:40.621 02:43:14 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:40.621 02:43:14 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:40.621 02:43:14 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:40.621 02:43:14 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:40.621 02:43:14 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:40.621 02:43:14 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:40.621 02:43:14 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:40.621 02:43:14 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:40.621 02:43:14 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:40.621 02:43:14 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:23:40.621 02:43:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:40.621 02:43:14 -- common/autotest_common.sh@10 -- # set +x 00:23:40.879 nvme0n1 00:23:40.879 02:43:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:40.879 02:43:14 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:40.879 02:43:14 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:40.879 02:43:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:40.879 02:43:14 -- common/autotest_common.sh@10 -- # set +x 00:23:40.879 02:43:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:40.879 02:43:14 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:40.879 02:43:14 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:40.879 02:43:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:40.879 02:43:14 -- common/autotest_common.sh@10 -- # set +x 00:23:40.879 02:43:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:40.879 02:43:14 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:40.879 02:43:14 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 2 00:23:40.879 02:43:14 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:40.879 02:43:14 -- host/auth.sh@44 -- # digest=sha512 00:23:40.879 02:43:14 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:23:40.879 02:43:14 -- host/auth.sh@44 -- # keyid=2 00:23:40.879 02:43:14 -- host/auth.sh@45 -- # key=DHHC-1:01:Nzc2MWE1MjViOTA5OTUxOTRiZTEwNzExNDRkZjA4NWPly9CM: 00:23:40.879 02:43:14 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:23:40.879 02:43:14 -- host/auth.sh@48 -- # echo ffdhe4096 00:23:40.879 02:43:14 -- host/auth.sh@49 -- # echo DHHC-1:01:Nzc2MWE1MjViOTA5OTUxOTRiZTEwNzExNDRkZjA4NWPly9CM: 00:23:40.879 02:43:14 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 2 00:23:40.879 02:43:14 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:40.879 02:43:14 -- host/auth.sh@68 -- # digest=sha512 00:23:40.879 02:43:14 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:23:40.879 02:43:14 -- host/auth.sh@68 -- # keyid=2 00:23:40.879 02:43:14 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:23:40.879 02:43:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:40.879 02:43:14 -- common/autotest_common.sh@10 -- # set +x 00:23:40.879 02:43:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:40.879 02:43:14 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:40.879 02:43:14 -- nvmf/common.sh@717 -- # local ip 00:23:40.879 02:43:14 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:40.879 02:43:14 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:40.879 02:43:14 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:40.879 02:43:14 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:40.879 02:43:14 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:40.879 02:43:14 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:40.879 02:43:14 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:40.879 02:43:14 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:40.879 02:43:14 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:40.879 02:43:14 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:23:40.879 02:43:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:40.879 02:43:14 -- common/autotest_common.sh@10 -- # set +x 00:23:41.138 nvme0n1 00:23:41.138 02:43:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:41.138 02:43:14 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:41.138 02:43:14 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:41.138 02:43:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:41.138 02:43:14 -- common/autotest_common.sh@10 -- # set +x 00:23:41.138 02:43:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:41.138 02:43:14 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:41.138 02:43:14 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:41.138 02:43:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:41.138 02:43:14 -- common/autotest_common.sh@10 -- # set +x 00:23:41.138 02:43:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:41.138 02:43:14 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:41.138 02:43:14 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 3 00:23:41.138 02:43:14 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:41.138 02:43:14 -- host/auth.sh@44 -- # digest=sha512 00:23:41.138 02:43:14 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:23:41.138 02:43:14 -- host/auth.sh@44 -- # keyid=3 00:23:41.138 02:43:14 -- host/auth.sh@45 -- # key=DHHC-1:02:MzVhNzA3ZGQ0OWE0ZmYyZWI0ZjljYzljNTEyNGI3NjhkNGQ5MDM3YzVlZTFkZjY01CDZag==: 00:23:41.138 02:43:14 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:23:41.138 02:43:14 -- host/auth.sh@48 -- # echo ffdhe4096 00:23:41.138 02:43:14 -- host/auth.sh@49 -- # echo DHHC-1:02:MzVhNzA3ZGQ0OWE0ZmYyZWI0ZjljYzljNTEyNGI3NjhkNGQ5MDM3YzVlZTFkZjY01CDZag==: 00:23:41.138 02:43:14 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 3 00:23:41.138 02:43:14 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:41.138 02:43:14 -- host/auth.sh@68 -- # digest=sha512 00:23:41.138 02:43:14 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:23:41.138 02:43:14 -- host/auth.sh@68 -- # keyid=3 00:23:41.138 02:43:14 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:23:41.138 02:43:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:41.138 02:43:14 -- common/autotest_common.sh@10 -- # set +x 00:23:41.138 02:43:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:41.138 02:43:14 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:41.138 02:43:14 -- nvmf/common.sh@717 -- # local ip 00:23:41.138 02:43:14 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:41.138 02:43:14 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:41.138 02:43:14 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:41.138 02:43:14 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:41.138 02:43:14 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:41.138 02:43:14 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:41.138 02:43:14 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:41.138 02:43:14 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:41.138 02:43:14 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:41.138 02:43:14 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:23:41.138 02:43:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:41.138 02:43:14 -- common/autotest_common.sh@10 -- # set +x 00:23:41.395 nvme0n1 00:23:41.395 02:43:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:41.396 02:43:14 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:41.396 02:43:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:41.396 02:43:14 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:41.396 02:43:14 -- common/autotest_common.sh@10 -- # set +x 00:23:41.396 02:43:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:41.396 02:43:15 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:41.396 02:43:15 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:41.396 02:43:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:41.396 02:43:15 -- common/autotest_common.sh@10 -- # set +x 00:23:41.653 02:43:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:41.653 02:43:15 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:41.653 02:43:15 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 4 00:23:41.654 02:43:15 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:41.654 02:43:15 -- host/auth.sh@44 -- # digest=sha512 00:23:41.654 02:43:15 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:23:41.654 02:43:15 -- host/auth.sh@44 -- # keyid=4 00:23:41.654 02:43:15 -- host/auth.sh@45 -- # key=DHHC-1:03:OTk1NGRkYTBiMjBhMTc1MDg4MTViNDFhYTQ4ZjhjM2M5MDM0NzcyM2RkYTU0NWYxNTMwZWI0M2NiZjQ0NTBmNAr9IOk=: 00:23:41.654 02:43:15 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:23:41.654 02:43:15 -- host/auth.sh@48 -- # echo ffdhe4096 00:23:41.654 02:43:15 -- host/auth.sh@49 -- # echo DHHC-1:03:OTk1NGRkYTBiMjBhMTc1MDg4MTViNDFhYTQ4ZjhjM2M5MDM0NzcyM2RkYTU0NWYxNTMwZWI0M2NiZjQ0NTBmNAr9IOk=: 00:23:41.654 02:43:15 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 4 00:23:41.654 02:43:15 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:41.654 02:43:15 -- host/auth.sh@68 -- # digest=sha512 00:23:41.654 02:43:15 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:23:41.654 02:43:15 -- host/auth.sh@68 -- # keyid=4 00:23:41.654 02:43:15 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:23:41.654 02:43:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:41.654 02:43:15 -- common/autotest_common.sh@10 -- # set +x 00:23:41.654 02:43:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:41.654 02:43:15 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:41.654 02:43:15 -- nvmf/common.sh@717 -- # local ip 00:23:41.654 02:43:15 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:41.654 02:43:15 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:41.654 02:43:15 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:41.654 02:43:15 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:41.654 02:43:15 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:41.654 02:43:15 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:41.654 02:43:15 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:41.654 02:43:15 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:41.654 02:43:15 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:41.654 02:43:15 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:23:41.654 02:43:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:41.654 02:43:15 -- common/autotest_common.sh@10 -- # set +x 00:23:41.912 nvme0n1 00:23:41.912 02:43:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:41.912 02:43:15 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:41.912 02:43:15 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:41.912 02:43:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:41.912 02:43:15 -- common/autotest_common.sh@10 -- # set +x 00:23:41.912 02:43:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:41.912 02:43:15 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:41.912 02:43:15 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:41.912 02:43:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:41.912 02:43:15 -- common/autotest_common.sh@10 -- # set +x 00:23:41.912 02:43:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:41.912 02:43:15 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:23:41.912 02:43:15 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:41.912 02:43:15 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 0 00:23:41.912 02:43:15 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:41.912 02:43:15 -- host/auth.sh@44 -- # digest=sha512 00:23:41.912 02:43:15 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:23:41.912 02:43:15 -- host/auth.sh@44 -- # keyid=0 00:23:41.912 02:43:15 -- host/auth.sh@45 -- # key=DHHC-1:00:YTVhYTdhYjViMDJmMjYzMzBjOTQ4NDg5NzM3YTI2Zjb26OQB: 00:23:41.912 02:43:15 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:23:41.912 02:43:15 -- host/auth.sh@48 -- # echo ffdhe6144 00:23:41.912 02:43:15 -- host/auth.sh@49 -- # echo DHHC-1:00:YTVhYTdhYjViMDJmMjYzMzBjOTQ4NDg5NzM3YTI2Zjb26OQB: 00:23:41.912 02:43:15 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 0 00:23:41.912 02:43:15 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:41.912 02:43:15 -- host/auth.sh@68 -- # digest=sha512 00:23:41.912 02:43:15 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:23:41.912 02:43:15 -- host/auth.sh@68 -- # keyid=0 00:23:41.912 02:43:15 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:23:41.912 02:43:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:41.912 02:43:15 -- common/autotest_common.sh@10 -- # set +x 00:23:41.912 02:43:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:41.912 02:43:15 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:41.912 02:43:15 -- nvmf/common.sh@717 -- # local ip 00:23:41.912 02:43:15 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:41.912 02:43:15 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:41.912 02:43:15 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:41.912 02:43:15 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:41.912 02:43:15 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:41.912 02:43:15 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:41.912 02:43:15 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:41.912 02:43:15 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:41.912 02:43:15 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:41.912 02:43:15 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:23:41.912 02:43:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:41.912 02:43:15 -- common/autotest_common.sh@10 -- # set +x 00:23:42.170 nvme0n1 00:23:42.170 02:43:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:42.170 02:43:15 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:42.170 02:43:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:42.170 02:43:15 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:42.170 02:43:15 -- common/autotest_common.sh@10 -- # set +x 00:23:42.170 02:43:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:42.428 02:43:15 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:42.428 02:43:15 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:42.428 02:43:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:42.428 02:43:15 -- common/autotest_common.sh@10 -- # set +x 00:23:42.428 02:43:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:42.428 02:43:15 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:42.428 02:43:15 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 1 00:23:42.428 02:43:15 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:42.428 02:43:15 -- host/auth.sh@44 -- # digest=sha512 00:23:42.428 02:43:15 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:23:42.428 02:43:15 -- host/auth.sh@44 -- # keyid=1 00:23:42.428 02:43:15 -- host/auth.sh@45 -- # key=DHHC-1:00:ODhjNjQ1NGFlZDFlNTJhNThiZTc2ZWY4NmI5NzRmNTI2M2U1Y2VhOWEwNjI5NjJiyej8LQ==: 00:23:42.428 02:43:15 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:23:42.428 02:43:15 -- host/auth.sh@48 -- # echo ffdhe6144 00:23:42.428 02:43:15 -- host/auth.sh@49 -- # echo DHHC-1:00:ODhjNjQ1NGFlZDFlNTJhNThiZTc2ZWY4NmI5NzRmNTI2M2U1Y2VhOWEwNjI5NjJiyej8LQ==: 00:23:42.428 02:43:15 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 1 00:23:42.428 02:43:15 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:42.428 02:43:15 -- host/auth.sh@68 -- # digest=sha512 00:23:42.428 02:43:15 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:23:42.428 02:43:15 -- host/auth.sh@68 -- # keyid=1 00:23:42.428 02:43:15 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:23:42.428 02:43:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:42.428 02:43:15 -- common/autotest_common.sh@10 -- # set +x 00:23:42.428 02:43:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:42.428 02:43:15 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:42.428 02:43:15 -- nvmf/common.sh@717 -- # local ip 00:23:42.428 02:43:15 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:42.428 02:43:15 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:42.428 02:43:15 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:42.428 02:43:15 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:42.428 02:43:15 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:42.428 02:43:15 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:42.428 02:43:15 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:42.428 02:43:15 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:42.428 02:43:15 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:42.428 02:43:15 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:23:42.428 02:43:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:42.428 02:43:15 -- common/autotest_common.sh@10 -- # set +x 00:23:42.687 nvme0n1 00:23:42.687 02:43:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:42.687 02:43:16 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:42.687 02:43:16 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:42.687 02:43:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:42.687 02:43:16 -- common/autotest_common.sh@10 -- # set +x 00:23:42.687 02:43:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:42.687 02:43:16 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:42.687 02:43:16 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:42.687 02:43:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:42.687 02:43:16 -- common/autotest_common.sh@10 -- # set +x 00:23:42.687 02:43:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:42.687 02:43:16 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:42.687 02:43:16 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 2 00:23:42.687 02:43:16 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:42.687 02:43:16 -- host/auth.sh@44 -- # digest=sha512 00:23:42.687 02:43:16 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:23:42.687 02:43:16 -- host/auth.sh@44 -- # keyid=2 00:23:42.687 02:43:16 -- host/auth.sh@45 -- # key=DHHC-1:01:Nzc2MWE1MjViOTA5OTUxOTRiZTEwNzExNDRkZjA4NWPly9CM: 00:23:42.687 02:43:16 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:23:42.687 02:43:16 -- host/auth.sh@48 -- # echo ffdhe6144 00:23:42.687 02:43:16 -- host/auth.sh@49 -- # echo DHHC-1:01:Nzc2MWE1MjViOTA5OTUxOTRiZTEwNzExNDRkZjA4NWPly9CM: 00:23:42.687 02:43:16 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 2 00:23:42.687 02:43:16 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:42.687 02:43:16 -- host/auth.sh@68 -- # digest=sha512 00:23:42.687 02:43:16 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:23:42.687 02:43:16 -- host/auth.sh@68 -- # keyid=2 00:23:42.687 02:43:16 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:23:42.687 02:43:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:42.687 02:43:16 -- common/autotest_common.sh@10 -- # set +x 00:23:42.687 02:43:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:42.687 02:43:16 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:42.687 02:43:16 -- nvmf/common.sh@717 -- # local ip 00:23:42.687 02:43:16 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:42.687 02:43:16 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:42.687 02:43:16 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:42.687 02:43:16 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:42.687 02:43:16 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:42.687 02:43:16 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:42.687 02:43:16 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:42.687 02:43:16 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:42.687 02:43:16 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:42.687 02:43:16 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:23:42.687 02:43:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:42.687 02:43:16 -- common/autotest_common.sh@10 -- # set +x 00:23:43.253 nvme0n1 00:23:43.253 02:43:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:43.253 02:43:16 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:43.253 02:43:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:43.253 02:43:16 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:43.253 02:43:16 -- common/autotest_common.sh@10 -- # set +x 00:23:43.253 02:43:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:43.253 02:43:16 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:43.253 02:43:16 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:43.253 02:43:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:43.253 02:43:16 -- common/autotest_common.sh@10 -- # set +x 00:23:43.253 02:43:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:43.253 02:43:16 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:43.253 02:43:16 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 3 00:23:43.253 02:43:16 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:43.253 02:43:16 -- host/auth.sh@44 -- # digest=sha512 00:23:43.253 02:43:16 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:23:43.253 02:43:16 -- host/auth.sh@44 -- # keyid=3 00:23:43.253 02:43:16 -- host/auth.sh@45 -- # key=DHHC-1:02:MzVhNzA3ZGQ0OWE0ZmYyZWI0ZjljYzljNTEyNGI3NjhkNGQ5MDM3YzVlZTFkZjY01CDZag==: 00:23:43.253 02:43:16 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:23:43.253 02:43:16 -- host/auth.sh@48 -- # echo ffdhe6144 00:23:43.253 02:43:16 -- host/auth.sh@49 -- # echo DHHC-1:02:MzVhNzA3ZGQ0OWE0ZmYyZWI0ZjljYzljNTEyNGI3NjhkNGQ5MDM3YzVlZTFkZjY01CDZag==: 00:23:43.253 02:43:16 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 3 00:23:43.253 02:43:16 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:43.253 02:43:16 -- host/auth.sh@68 -- # digest=sha512 00:23:43.253 02:43:16 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:23:43.253 02:43:16 -- host/auth.sh@68 -- # keyid=3 00:23:43.253 02:43:16 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:23:43.253 02:43:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:43.253 02:43:16 -- common/autotest_common.sh@10 -- # set +x 00:23:43.253 02:43:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:43.253 02:43:16 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:43.253 02:43:16 -- nvmf/common.sh@717 -- # local ip 00:23:43.254 02:43:16 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:43.254 02:43:16 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:43.254 02:43:16 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:43.254 02:43:16 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:43.254 02:43:16 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:43.254 02:43:16 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:43.254 02:43:16 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:43.254 02:43:16 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:43.254 02:43:16 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:43.254 02:43:16 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:23:43.254 02:43:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:43.254 02:43:16 -- common/autotest_common.sh@10 -- # set +x 00:23:43.511 nvme0n1 00:23:43.511 02:43:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:43.511 02:43:17 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:43.511 02:43:17 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:43.511 02:43:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:43.511 02:43:17 -- common/autotest_common.sh@10 -- # set +x 00:23:43.511 02:43:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:43.769 02:43:17 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:43.769 02:43:17 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:43.769 02:43:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:43.769 02:43:17 -- common/autotest_common.sh@10 -- # set +x 00:23:43.769 02:43:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:43.769 02:43:17 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:43.769 02:43:17 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 4 00:23:43.769 02:43:17 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:43.769 02:43:17 -- host/auth.sh@44 -- # digest=sha512 00:23:43.769 02:43:17 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:23:43.769 02:43:17 -- host/auth.sh@44 -- # keyid=4 00:23:43.769 02:43:17 -- host/auth.sh@45 -- # key=DHHC-1:03:OTk1NGRkYTBiMjBhMTc1MDg4MTViNDFhYTQ4ZjhjM2M5MDM0NzcyM2RkYTU0NWYxNTMwZWI0M2NiZjQ0NTBmNAr9IOk=: 00:23:43.769 02:43:17 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:23:43.769 02:43:17 -- host/auth.sh@48 -- # echo ffdhe6144 00:23:43.769 02:43:17 -- host/auth.sh@49 -- # echo DHHC-1:03:OTk1NGRkYTBiMjBhMTc1MDg4MTViNDFhYTQ4ZjhjM2M5MDM0NzcyM2RkYTU0NWYxNTMwZWI0M2NiZjQ0NTBmNAr9IOk=: 00:23:43.769 02:43:17 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 4 00:23:43.769 02:43:17 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:43.769 02:43:17 -- host/auth.sh@68 -- # digest=sha512 00:23:43.769 02:43:17 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:23:43.769 02:43:17 -- host/auth.sh@68 -- # keyid=4 00:23:43.769 02:43:17 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:23:43.769 02:43:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:43.769 02:43:17 -- common/autotest_common.sh@10 -- # set +x 00:23:43.769 02:43:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:43.769 02:43:17 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:43.769 02:43:17 -- nvmf/common.sh@717 -- # local ip 00:23:43.769 02:43:17 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:43.769 02:43:17 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:43.769 02:43:17 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:43.769 02:43:17 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:43.769 02:43:17 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:43.769 02:43:17 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:43.769 02:43:17 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:43.769 02:43:17 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:43.769 02:43:17 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:43.769 02:43:17 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:23:43.769 02:43:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:43.769 02:43:17 -- common/autotest_common.sh@10 -- # set +x 00:23:44.028 nvme0n1 00:23:44.028 02:43:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:44.028 02:43:17 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:44.028 02:43:17 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:44.028 02:43:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:44.028 02:43:17 -- common/autotest_common.sh@10 -- # set +x 00:23:44.028 02:43:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:44.028 02:43:17 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:44.028 02:43:17 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:44.028 02:43:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:44.028 02:43:17 -- common/autotest_common.sh@10 -- # set +x 00:23:44.028 02:43:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:44.028 02:43:17 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:23:44.028 02:43:17 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:44.028 02:43:17 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 0 00:23:44.028 02:43:17 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:44.028 02:43:17 -- host/auth.sh@44 -- # digest=sha512 00:23:44.028 02:43:17 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:23:44.028 02:43:17 -- host/auth.sh@44 -- # keyid=0 00:23:44.028 02:43:17 -- host/auth.sh@45 -- # key=DHHC-1:00:YTVhYTdhYjViMDJmMjYzMzBjOTQ4NDg5NzM3YTI2Zjb26OQB: 00:23:44.028 02:43:17 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:23:44.028 02:43:17 -- host/auth.sh@48 -- # echo ffdhe8192 00:23:44.028 02:43:17 -- host/auth.sh@49 -- # echo DHHC-1:00:YTVhYTdhYjViMDJmMjYzMzBjOTQ4NDg5NzM3YTI2Zjb26OQB: 00:23:44.028 02:43:17 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 0 00:23:44.028 02:43:17 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:44.028 02:43:17 -- host/auth.sh@68 -- # digest=sha512 00:23:44.028 02:43:17 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:23:44.028 02:43:17 -- host/auth.sh@68 -- # keyid=0 00:23:44.028 02:43:17 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:23:44.028 02:43:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:44.028 02:43:17 -- common/autotest_common.sh@10 -- # set +x 00:23:44.028 02:43:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:44.028 02:43:17 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:44.028 02:43:17 -- nvmf/common.sh@717 -- # local ip 00:23:44.028 02:43:17 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:44.028 02:43:17 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:44.028 02:43:17 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:44.028 02:43:17 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:44.028 02:43:17 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:44.028 02:43:17 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:44.028 02:43:17 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:44.028 02:43:17 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:44.028 02:43:17 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:44.028 02:43:17 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:23:44.028 02:43:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:44.028 02:43:17 -- common/autotest_common.sh@10 -- # set +x 00:23:44.594 nvme0n1 00:23:44.595 02:43:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:44.595 02:43:18 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:44.595 02:43:18 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:44.595 02:43:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:44.595 02:43:18 -- common/autotest_common.sh@10 -- # set +x 00:23:44.595 02:43:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:44.853 02:43:18 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:44.853 02:43:18 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:44.853 02:43:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:44.853 02:43:18 -- common/autotest_common.sh@10 -- # set +x 00:23:44.853 02:43:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:44.853 02:43:18 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:44.853 02:43:18 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 1 00:23:44.853 02:43:18 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:44.853 02:43:18 -- host/auth.sh@44 -- # digest=sha512 00:23:44.853 02:43:18 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:23:44.853 02:43:18 -- host/auth.sh@44 -- # keyid=1 00:23:44.853 02:43:18 -- host/auth.sh@45 -- # key=DHHC-1:00:ODhjNjQ1NGFlZDFlNTJhNThiZTc2ZWY4NmI5NzRmNTI2M2U1Y2VhOWEwNjI5NjJiyej8LQ==: 00:23:44.853 02:43:18 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:23:44.853 02:43:18 -- host/auth.sh@48 -- # echo ffdhe8192 00:23:44.853 02:43:18 -- host/auth.sh@49 -- # echo DHHC-1:00:ODhjNjQ1NGFlZDFlNTJhNThiZTc2ZWY4NmI5NzRmNTI2M2U1Y2VhOWEwNjI5NjJiyej8LQ==: 00:23:44.853 02:43:18 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 1 00:23:44.853 02:43:18 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:44.853 02:43:18 -- host/auth.sh@68 -- # digest=sha512 00:23:44.853 02:43:18 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:23:44.853 02:43:18 -- host/auth.sh@68 -- # keyid=1 00:23:44.853 02:43:18 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:23:44.853 02:43:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:44.853 02:43:18 -- common/autotest_common.sh@10 -- # set +x 00:23:44.853 02:43:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:44.853 02:43:18 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:44.853 02:43:18 -- nvmf/common.sh@717 -- # local ip 00:23:44.853 02:43:18 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:44.853 02:43:18 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:44.853 02:43:18 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:44.853 02:43:18 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:44.853 02:43:18 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:44.853 02:43:18 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:44.853 02:43:18 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:44.853 02:43:18 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:44.853 02:43:18 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:44.853 02:43:18 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:23:44.853 02:43:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:44.853 02:43:18 -- common/autotest_common.sh@10 -- # set +x 00:23:45.419 nvme0n1 00:23:45.419 02:43:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:45.419 02:43:18 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:45.419 02:43:18 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:45.419 02:43:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:45.419 02:43:18 -- common/autotest_common.sh@10 -- # set +x 00:23:45.419 02:43:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:45.419 02:43:18 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:45.419 02:43:18 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:45.419 02:43:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:45.419 02:43:18 -- common/autotest_common.sh@10 -- # set +x 00:23:45.419 02:43:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:45.419 02:43:18 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:45.419 02:43:18 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 2 00:23:45.419 02:43:18 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:45.419 02:43:18 -- host/auth.sh@44 -- # digest=sha512 00:23:45.419 02:43:18 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:23:45.419 02:43:18 -- host/auth.sh@44 -- # keyid=2 00:23:45.419 02:43:18 -- host/auth.sh@45 -- # key=DHHC-1:01:Nzc2MWE1MjViOTA5OTUxOTRiZTEwNzExNDRkZjA4NWPly9CM: 00:23:45.419 02:43:18 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:23:45.419 02:43:18 -- host/auth.sh@48 -- # echo ffdhe8192 00:23:45.419 02:43:18 -- host/auth.sh@49 -- # echo DHHC-1:01:Nzc2MWE1MjViOTA5OTUxOTRiZTEwNzExNDRkZjA4NWPly9CM: 00:23:45.419 02:43:18 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 2 00:23:45.419 02:43:18 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:45.419 02:43:18 -- host/auth.sh@68 -- # digest=sha512 00:23:45.419 02:43:18 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:23:45.419 02:43:18 -- host/auth.sh@68 -- # keyid=2 00:23:45.419 02:43:18 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:23:45.419 02:43:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:45.419 02:43:18 -- common/autotest_common.sh@10 -- # set +x 00:23:45.419 02:43:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:45.419 02:43:18 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:45.419 02:43:18 -- nvmf/common.sh@717 -- # local ip 00:23:45.419 02:43:18 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:45.419 02:43:18 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:45.419 02:43:18 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:45.419 02:43:18 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:45.419 02:43:18 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:45.419 02:43:18 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:45.419 02:43:18 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:45.419 02:43:18 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:45.419 02:43:18 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:45.419 02:43:18 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:23:45.419 02:43:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:45.419 02:43:18 -- common/autotest_common.sh@10 -- # set +x 00:23:45.984 nvme0n1 00:23:45.984 02:43:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:45.984 02:43:19 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:45.984 02:43:19 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:45.984 02:43:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:45.984 02:43:19 -- common/autotest_common.sh@10 -- # set +x 00:23:45.984 02:43:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:45.984 02:43:19 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:45.984 02:43:19 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:45.984 02:43:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:45.984 02:43:19 -- common/autotest_common.sh@10 -- # set +x 00:23:45.984 02:43:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:45.984 02:43:19 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:45.984 02:43:19 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 3 00:23:45.984 02:43:19 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:45.984 02:43:19 -- host/auth.sh@44 -- # digest=sha512 00:23:45.984 02:43:19 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:23:45.984 02:43:19 -- host/auth.sh@44 -- # keyid=3 00:23:45.984 02:43:19 -- host/auth.sh@45 -- # key=DHHC-1:02:MzVhNzA3ZGQ0OWE0ZmYyZWI0ZjljYzljNTEyNGI3NjhkNGQ5MDM3YzVlZTFkZjY01CDZag==: 00:23:45.984 02:43:19 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:23:45.984 02:43:19 -- host/auth.sh@48 -- # echo ffdhe8192 00:23:45.984 02:43:19 -- host/auth.sh@49 -- # echo DHHC-1:02:MzVhNzA3ZGQ0OWE0ZmYyZWI0ZjljYzljNTEyNGI3NjhkNGQ5MDM3YzVlZTFkZjY01CDZag==: 00:23:45.984 02:43:19 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 3 00:23:45.984 02:43:19 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:45.984 02:43:19 -- host/auth.sh@68 -- # digest=sha512 00:23:45.984 02:43:19 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:23:45.984 02:43:19 -- host/auth.sh@68 -- # keyid=3 00:23:45.984 02:43:19 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:23:45.984 02:43:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:45.984 02:43:19 -- common/autotest_common.sh@10 -- # set +x 00:23:45.984 02:43:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:45.984 02:43:19 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:45.984 02:43:19 -- nvmf/common.sh@717 -- # local ip 00:23:45.984 02:43:19 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:45.984 02:43:19 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:45.984 02:43:19 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:45.984 02:43:19 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:45.984 02:43:19 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:45.984 02:43:19 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:45.984 02:43:19 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:45.984 02:43:19 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:45.984 02:43:19 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:45.984 02:43:19 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:23:45.984 02:43:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:45.984 02:43:19 -- common/autotest_common.sh@10 -- # set +x 00:23:46.550 nvme0n1 00:23:46.550 02:43:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:46.550 02:43:20 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:46.550 02:43:20 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:46.550 02:43:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:46.550 02:43:20 -- common/autotest_common.sh@10 -- # set +x 00:23:46.550 02:43:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:46.550 02:43:20 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:46.550 02:43:20 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:46.550 02:43:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:46.550 02:43:20 -- common/autotest_common.sh@10 -- # set +x 00:23:46.808 02:43:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:46.808 02:43:20 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:23:46.808 02:43:20 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 4 00:23:46.808 02:43:20 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:46.808 02:43:20 -- host/auth.sh@44 -- # digest=sha512 00:23:46.808 02:43:20 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:23:46.808 02:43:20 -- host/auth.sh@44 -- # keyid=4 00:23:46.808 02:43:20 -- host/auth.sh@45 -- # key=DHHC-1:03:OTk1NGRkYTBiMjBhMTc1MDg4MTViNDFhYTQ4ZjhjM2M5MDM0NzcyM2RkYTU0NWYxNTMwZWI0M2NiZjQ0NTBmNAr9IOk=: 00:23:46.808 02:43:20 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:23:46.808 02:43:20 -- host/auth.sh@48 -- # echo ffdhe8192 00:23:46.808 02:43:20 -- host/auth.sh@49 -- # echo DHHC-1:03:OTk1NGRkYTBiMjBhMTc1MDg4MTViNDFhYTQ4ZjhjM2M5MDM0NzcyM2RkYTU0NWYxNTMwZWI0M2NiZjQ0NTBmNAr9IOk=: 00:23:46.808 02:43:20 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 4 00:23:46.808 02:43:20 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:23:46.808 02:43:20 -- host/auth.sh@68 -- # digest=sha512 00:23:46.808 02:43:20 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:23:46.808 02:43:20 -- host/auth.sh@68 -- # keyid=4 00:23:46.808 02:43:20 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:23:46.808 02:43:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:46.808 02:43:20 -- common/autotest_common.sh@10 -- # set +x 00:23:46.808 02:43:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:46.808 02:43:20 -- host/auth.sh@70 -- # get_main_ns_ip 00:23:46.808 02:43:20 -- nvmf/common.sh@717 -- # local ip 00:23:46.808 02:43:20 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:46.808 02:43:20 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:46.808 02:43:20 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:46.808 02:43:20 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:46.808 02:43:20 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:46.808 02:43:20 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:46.808 02:43:20 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:46.808 02:43:20 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:46.808 02:43:20 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:46.808 02:43:20 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:23:46.808 02:43:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:46.808 02:43:20 -- common/autotest_common.sh@10 -- # set +x 00:23:47.378 nvme0n1 00:23:47.378 02:43:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:47.378 02:43:20 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:23:47.378 02:43:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:47.378 02:43:20 -- host/auth.sh@73 -- # jq -r '.[].name' 00:23:47.378 02:43:20 -- common/autotest_common.sh@10 -- # set +x 00:23:47.378 02:43:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:47.378 02:43:20 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:23:47.378 02:43:20 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:47.378 02:43:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:47.378 02:43:20 -- common/autotest_common.sh@10 -- # set +x 00:23:47.378 02:43:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:47.378 02:43:20 -- host/auth.sh@117 -- # nvmet_auth_set_key sha256 ffdhe2048 1 00:23:47.378 02:43:20 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:23:47.378 02:43:20 -- host/auth.sh@44 -- # digest=sha256 00:23:47.378 02:43:20 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:23:47.378 02:43:20 -- host/auth.sh@44 -- # keyid=1 00:23:47.378 02:43:20 -- host/auth.sh@45 -- # key=DHHC-1:00:ODhjNjQ1NGFlZDFlNTJhNThiZTc2ZWY4NmI5NzRmNTI2M2U1Y2VhOWEwNjI5NjJiyej8LQ==: 00:23:47.378 02:43:20 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:23:47.378 02:43:20 -- host/auth.sh@48 -- # echo ffdhe2048 00:23:47.378 02:43:20 -- host/auth.sh@49 -- # echo DHHC-1:00:ODhjNjQ1NGFlZDFlNTJhNThiZTc2ZWY4NmI5NzRmNTI2M2U1Y2VhOWEwNjI5NjJiyej8LQ==: 00:23:47.378 02:43:20 -- host/auth.sh@118 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:23:47.378 02:43:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:47.378 02:43:20 -- common/autotest_common.sh@10 -- # set +x 00:23:47.378 02:43:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:47.378 02:43:20 -- host/auth.sh@119 -- # get_main_ns_ip 00:23:47.378 02:43:20 -- nvmf/common.sh@717 -- # local ip 00:23:47.378 02:43:20 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:47.378 02:43:20 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:47.378 02:43:20 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:47.378 02:43:20 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:47.378 02:43:20 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:47.378 02:43:20 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:47.378 02:43:20 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:47.378 02:43:20 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:47.378 02:43:20 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:47.378 02:43:20 -- host/auth.sh@119 -- # NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 00:23:47.378 02:43:20 -- common/autotest_common.sh@638 -- # local es=0 00:23:47.378 02:43:20 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 00:23:47.378 02:43:20 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:23:47.378 02:43:20 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:23:47.378 02:43:20 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:23:47.378 02:43:20 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:23:47.378 02:43:20 -- common/autotest_common.sh@641 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 00:23:47.378 02:43:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:47.378 02:43:20 -- common/autotest_common.sh@10 -- # set +x 00:23:47.378 request: 00:23:47.378 { 00:23:47.378 "name": "nvme0", 00:23:47.378 "trtype": "rdma", 00:23:47.378 "traddr": "192.168.100.8", 00:23:47.378 "hostnqn": "nqn.2024-02.io.spdk:host0", 00:23:47.378 "adrfam": "ipv4", 00:23:47.378 "trsvcid": "4420", 00:23:47.378 "subnqn": "nqn.2024-02.io.spdk:cnode0", 00:23:47.378 "method": "bdev_nvme_attach_controller", 00:23:47.378 "req_id": 1 00:23:47.378 } 00:23:47.378 Got JSON-RPC error response 00:23:47.378 response: 00:23:47.378 { 00:23:47.378 "code": -32602, 00:23:47.378 "message": "Invalid parameters" 00:23:47.378 } 00:23:47.378 02:43:20 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:23:47.378 02:43:20 -- common/autotest_common.sh@641 -- # es=1 00:23:47.378 02:43:20 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:23:47.378 02:43:20 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:23:47.378 02:43:20 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:23:47.378 02:43:20 -- host/auth.sh@121 -- # rpc_cmd bdev_nvme_get_controllers 00:23:47.378 02:43:20 -- host/auth.sh@121 -- # jq length 00:23:47.378 02:43:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:47.378 02:43:20 -- common/autotest_common.sh@10 -- # set +x 00:23:47.378 02:43:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:47.378 02:43:20 -- host/auth.sh@121 -- # (( 0 == 0 )) 00:23:47.378 02:43:20 -- host/auth.sh@124 -- # get_main_ns_ip 00:23:47.378 02:43:20 -- nvmf/common.sh@717 -- # local ip 00:23:47.378 02:43:20 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:47.378 02:43:20 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:47.378 02:43:20 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:47.378 02:43:20 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:47.378 02:43:20 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:47.378 02:43:20 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:47.378 02:43:20 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:47.378 02:43:20 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:47.378 02:43:20 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:47.378 02:43:20 -- host/auth.sh@124 -- # NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:23:47.378 02:43:20 -- common/autotest_common.sh@638 -- # local es=0 00:23:47.378 02:43:20 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:23:47.378 02:43:20 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:23:47.378 02:43:20 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:23:47.378 02:43:20 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:23:47.378 02:43:20 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:23:47.378 02:43:20 -- common/autotest_common.sh@641 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:23:47.378 02:43:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:47.378 02:43:20 -- common/autotest_common.sh@10 -- # set +x 00:23:47.636 request: 00:23:47.636 { 00:23:47.636 "name": "nvme0", 00:23:47.636 "trtype": "rdma", 00:23:47.636 "traddr": "192.168.100.8", 00:23:47.636 "hostnqn": "nqn.2024-02.io.spdk:host0", 00:23:47.636 "adrfam": "ipv4", 00:23:47.636 "trsvcid": "4420", 00:23:47.636 "subnqn": "nqn.2024-02.io.spdk:cnode0", 00:23:47.636 "dhchap_key": "key2", 00:23:47.636 "method": "bdev_nvme_attach_controller", 00:23:47.636 "req_id": 1 00:23:47.636 } 00:23:47.636 Got JSON-RPC error response 00:23:47.636 response: 00:23:47.636 { 00:23:47.636 "code": -32602, 00:23:47.636 "message": "Invalid parameters" 00:23:47.636 } 00:23:47.636 02:43:21 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:23:47.636 02:43:21 -- common/autotest_common.sh@641 -- # es=1 00:23:47.636 02:43:21 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:23:47.636 02:43:21 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:23:47.636 02:43:21 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:23:47.636 02:43:21 -- host/auth.sh@127 -- # rpc_cmd bdev_nvme_get_controllers 00:23:47.636 02:43:21 -- host/auth.sh@127 -- # jq length 00:23:47.636 02:43:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:47.636 02:43:21 -- common/autotest_common.sh@10 -- # set +x 00:23:47.636 02:43:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:47.636 02:43:21 -- host/auth.sh@127 -- # (( 0 == 0 )) 00:23:47.636 02:43:21 -- host/auth.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:23:47.636 02:43:21 -- host/auth.sh@130 -- # cleanup 00:23:47.636 02:43:21 -- host/auth.sh@24 -- # nvmftestfini 00:23:47.636 02:43:21 -- nvmf/common.sh@477 -- # nvmfcleanup 00:23:47.636 02:43:21 -- nvmf/common.sh@117 -- # sync 00:23:47.636 02:43:21 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:23:47.636 02:43:21 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:23:47.636 02:43:21 -- nvmf/common.sh@120 -- # set +e 00:23:47.636 02:43:21 -- nvmf/common.sh@121 -- # for i in {1..20} 00:23:47.636 02:43:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:23:47.636 rmmod nvme_rdma 00:23:47.636 rmmod nvme_fabrics 00:23:47.636 02:43:21 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:23:47.636 02:43:21 -- nvmf/common.sh@124 -- # set -e 00:23:47.636 02:43:21 -- nvmf/common.sh@125 -- # return 0 00:23:47.636 02:43:21 -- nvmf/common.sh@478 -- # '[' -n 1638414 ']' 00:23:47.636 02:43:21 -- nvmf/common.sh@479 -- # killprocess 1638414 00:23:47.636 02:43:21 -- common/autotest_common.sh@936 -- # '[' -z 1638414 ']' 00:23:47.636 02:43:21 -- common/autotest_common.sh@940 -- # kill -0 1638414 00:23:47.636 02:43:21 -- common/autotest_common.sh@941 -- # uname 00:23:47.636 02:43:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:47.636 02:43:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1638414 00:23:47.636 02:43:21 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:47.636 02:43:21 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:47.636 02:43:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1638414' 00:23:47.636 killing process with pid 1638414 00:23:47.636 02:43:21 -- common/autotest_common.sh@955 -- # kill 1638414 00:23:47.636 02:43:21 -- common/autotest_common.sh@960 -- # wait 1638414 00:23:47.894 02:43:21 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:23:47.894 02:43:21 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:23:47.894 02:43:21 -- host/auth.sh@25 -- # rm /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/allowed_hosts/nqn.2024-02.io.spdk:host0 00:23:47.894 02:43:21 -- host/auth.sh@26 -- # rmdir /sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 00:23:47.894 02:43:21 -- host/auth.sh@27 -- # clean_kernel_target 00:23:47.894 02:43:21 -- nvmf/common.sh@673 -- # [[ -e /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 ]] 00:23:47.894 02:43:21 -- nvmf/common.sh@675 -- # echo 0 00:23:47.894 02:43:21 -- nvmf/common.sh@677 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/nqn.2024-02.io.spdk:cnode0 00:23:47.894 02:43:21 -- nvmf/common.sh@678 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/namespaces/1 00:23:47.894 02:43:21 -- nvmf/common.sh@679 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:23:47.894 02:43:21 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:23:47.894 02:43:21 -- nvmf/common.sh@682 -- # modules=(/sys/module/nvmet/holders/*) 00:23:47.894 02:43:21 -- nvmf/common.sh@684 -- # modprobe -r nvmet_rdma nvmet 00:23:48.151 02:43:21 -- nvmf/common.sh@687 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:23:51.436 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:23:51.436 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:23:51.436 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:23:51.436 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:23:51.436 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:23:51.436 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:23:51.436 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:23:51.436 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:23:51.436 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:23:51.436 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:23:51.436 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:23:51.436 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:23:51.436 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:23:51.436 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:23:51.436 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:23:51.436 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:23:54.721 0000:5f:00.0 (8086 0a54): nvme -> vfio-pci 00:23:54.721 02:43:28 -- host/auth.sh@28 -- # rm -f /tmp/spdk.key-null.bmm /tmp/spdk.key-null.mbq /tmp/spdk.key-sha256.ffU /tmp/spdk.key-sha384.II8 /tmp/spdk.key-sha512.fct /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/nvme-auth.log 00:23:54.721 02:43:28 -- host/auth.sh@31 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:23:58.030 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:23:58.030 0000:5f:00.0 (8086 0a54): Already using the vfio-pci driver 00:23:58.030 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:23:58.030 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:23:58.030 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:23:58.030 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:23:58.030 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:23:58.030 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:23:58.030 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:23:58.030 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:23:58.030 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:23:58.030 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:23:58.030 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:23:58.030 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:23:58.030 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:23:58.030 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:23:58.030 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:23:58.030 00:23:58.030 real 0m53.574s 00:23:58.030 user 0m41.512s 00:23:58.030 sys 0m14.538s 00:23:58.030 02:43:31 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:23:58.030 02:43:31 -- common/autotest_common.sh@10 -- # set +x 00:23:58.030 ************************************ 00:23:58.030 END TEST nvmf_auth 00:23:58.030 ************************************ 00:23:58.030 02:43:31 -- nvmf/nvmf.sh@104 -- # [[ rdma == \t\c\p ]] 00:23:58.030 02:43:31 -- nvmf/nvmf.sh@108 -- # [[ 0 -eq 1 ]] 00:23:58.030 02:43:31 -- nvmf/nvmf.sh@113 -- # [[ 0 -eq 1 ]] 00:23:58.030 02:43:31 -- nvmf/nvmf.sh@118 -- # [[ phy == phy ]] 00:23:58.030 02:43:31 -- nvmf/nvmf.sh@119 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=rdma 00:23:58.030 02:43:31 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:58.030 02:43:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:58.030 02:43:31 -- common/autotest_common.sh@10 -- # set +x 00:23:58.030 ************************************ 00:23:58.030 START TEST nvmf_bdevperf 00:23:58.030 ************************************ 00:23:58.030 02:43:31 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=rdma 00:23:58.288 * Looking for test storage... 00:23:58.289 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:23:58.289 02:43:31 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:23:58.289 02:43:31 -- nvmf/common.sh@7 -- # uname -s 00:23:58.289 02:43:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:58.289 02:43:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:58.289 02:43:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:58.289 02:43:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:58.289 02:43:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:58.289 02:43:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:58.289 02:43:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:58.289 02:43:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:58.289 02:43:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:58.289 02:43:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:58.289 02:43:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:23:58.289 02:43:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:23:58.289 02:43:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:58.289 02:43:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:58.289 02:43:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:58.289 02:43:31 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:23:58.289 02:43:31 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:23:58.289 02:43:31 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:58.289 02:43:31 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:58.289 02:43:31 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:58.289 02:43:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:58.289 02:43:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:58.289 02:43:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:58.289 02:43:31 -- paths/export.sh@5 -- # export PATH 00:23:58.289 02:43:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:58.289 02:43:31 -- nvmf/common.sh@47 -- # : 0 00:23:58.289 02:43:31 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:23:58.289 02:43:31 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:23:58.289 02:43:31 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:23:58.289 02:43:31 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:58.289 02:43:31 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:58.289 02:43:31 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:23:58.289 02:43:31 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:23:58.289 02:43:31 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:23:58.289 02:43:31 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:23:58.289 02:43:31 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:23:58.289 02:43:31 -- host/bdevperf.sh@24 -- # nvmftestinit 00:23:58.289 02:43:31 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:23:58.289 02:43:31 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:58.289 02:43:31 -- nvmf/common.sh@437 -- # prepare_net_devs 00:23:58.289 02:43:31 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:23:58.289 02:43:31 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:23:58.289 02:43:31 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:58.289 02:43:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:58.289 02:43:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:58.289 02:43:31 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:23:58.289 02:43:31 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:23:58.289 02:43:31 -- nvmf/common.sh@285 -- # xtrace_disable 00:23:58.289 02:43:31 -- common/autotest_common.sh@10 -- # set +x 00:24:03.551 02:43:37 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:03.551 02:43:37 -- nvmf/common.sh@291 -- # pci_devs=() 00:24:03.551 02:43:37 -- nvmf/common.sh@291 -- # local -a pci_devs 00:24:03.551 02:43:37 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:24:03.551 02:43:37 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:24:03.551 02:43:37 -- nvmf/common.sh@293 -- # pci_drivers=() 00:24:03.551 02:43:37 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:24:03.551 02:43:37 -- nvmf/common.sh@295 -- # net_devs=() 00:24:03.551 02:43:37 -- nvmf/common.sh@295 -- # local -ga net_devs 00:24:03.551 02:43:37 -- nvmf/common.sh@296 -- # e810=() 00:24:03.551 02:43:37 -- nvmf/common.sh@296 -- # local -ga e810 00:24:03.551 02:43:37 -- nvmf/common.sh@297 -- # x722=() 00:24:03.551 02:43:37 -- nvmf/common.sh@297 -- # local -ga x722 00:24:03.551 02:43:37 -- nvmf/common.sh@298 -- # mlx=() 00:24:03.551 02:43:37 -- nvmf/common.sh@298 -- # local -ga mlx 00:24:03.551 02:43:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:03.551 02:43:37 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:03.551 02:43:37 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:03.551 02:43:37 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:03.551 02:43:37 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:03.551 02:43:37 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:03.551 02:43:37 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:03.551 02:43:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:03.551 02:43:37 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:03.551 02:43:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:03.551 02:43:37 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:03.551 02:43:37 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:24:03.551 02:43:37 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:24:03.551 02:43:37 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:24:03.551 02:43:37 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:24:03.551 02:43:37 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:24:03.551 02:43:37 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:24:03.551 02:43:37 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:24:03.551 02:43:37 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:24:03.551 02:43:37 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:24:03.551 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:24:03.551 02:43:37 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:24:03.551 02:43:37 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:24:03.551 02:43:37 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:24:03.551 02:43:37 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:24:03.551 02:43:37 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:24:03.551 02:43:37 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:24:03.551 02:43:37 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:24:03.551 02:43:37 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:24:03.551 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:24:03.551 02:43:37 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:24:03.551 02:43:37 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:24:03.551 02:43:37 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:24:03.551 02:43:37 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:24:03.551 02:43:37 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:24:03.551 02:43:37 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:24:03.551 02:43:37 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:24:03.551 02:43:37 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:24:03.551 02:43:37 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:24:03.551 02:43:37 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:03.551 02:43:37 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:24:03.551 02:43:37 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:03.552 02:43:37 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:24:03.552 Found net devices under 0000:18:00.0: mlx_0_0 00:24:03.552 02:43:37 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:24:03.552 02:43:37 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:24:03.552 02:43:37 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:03.552 02:43:37 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:24:03.552 02:43:37 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:03.552 02:43:37 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:24:03.552 Found net devices under 0000:18:00.1: mlx_0_1 00:24:03.552 02:43:37 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:24:03.552 02:43:37 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:24:03.552 02:43:37 -- nvmf/common.sh@403 -- # is_hw=yes 00:24:03.552 02:43:37 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:24:03.552 02:43:37 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:24:03.552 02:43:37 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:24:03.552 02:43:37 -- nvmf/common.sh@409 -- # rdma_device_init 00:24:03.552 02:43:37 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:24:03.552 02:43:37 -- nvmf/common.sh@58 -- # uname 00:24:03.552 02:43:37 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:24:03.552 02:43:37 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:24:03.552 02:43:37 -- nvmf/common.sh@63 -- # modprobe ib_core 00:24:03.552 02:43:37 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:24:03.552 02:43:37 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:24:03.552 02:43:37 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:24:03.552 02:43:37 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:24:03.552 02:43:37 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:24:03.552 02:43:37 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:24:03.552 02:43:37 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:24:03.552 02:43:37 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:24:03.552 02:43:37 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:24:03.552 02:43:37 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:24:03.552 02:43:37 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:24:03.552 02:43:37 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:24:03.552 02:43:37 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:24:03.552 02:43:37 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:24:03.552 02:43:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:03.552 02:43:37 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:24:03.552 02:43:37 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:24:03.552 02:43:37 -- nvmf/common.sh@105 -- # continue 2 00:24:03.552 02:43:37 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:24:03.552 02:43:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:03.552 02:43:37 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:24:03.552 02:43:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:03.552 02:43:37 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:24:03.552 02:43:37 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:24:03.552 02:43:37 -- nvmf/common.sh@105 -- # continue 2 00:24:03.552 02:43:37 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:24:03.552 02:43:37 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:24:03.552 02:43:37 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:24:03.811 02:43:37 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:24:03.811 02:43:37 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:03.811 02:43:37 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:03.811 02:43:37 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:24:03.811 02:43:37 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:24:03.811 02:43:37 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:24:03.811 64: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:24:03.811 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:24:03.811 altname enp24s0f0np0 00:24:03.811 altname ens785f0np0 00:24:03.811 inet 192.168.100.8/24 scope global mlx_0_0 00:24:03.811 valid_lft forever preferred_lft forever 00:24:03.811 02:43:37 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:24:03.811 02:43:37 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:24:03.811 02:43:37 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:24:03.811 02:43:37 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:24:03.811 02:43:37 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:03.811 02:43:37 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:03.811 02:43:37 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:24:03.811 02:43:37 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:24:03.811 02:43:37 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:24:03.811 65: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:24:03.811 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:24:03.811 altname enp24s0f1np1 00:24:03.811 altname ens785f1np1 00:24:03.811 inet 192.168.100.9/24 scope global mlx_0_1 00:24:03.811 valid_lft forever preferred_lft forever 00:24:03.811 02:43:37 -- nvmf/common.sh@411 -- # return 0 00:24:03.811 02:43:37 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:24:03.811 02:43:37 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:24:03.811 02:43:37 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:24:03.811 02:43:37 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:24:03.811 02:43:37 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:24:03.811 02:43:37 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:24:03.811 02:43:37 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:24:03.811 02:43:37 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:24:03.811 02:43:37 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:24:03.811 02:43:37 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:24:03.811 02:43:37 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:24:03.811 02:43:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:03.812 02:43:37 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:24:03.812 02:43:37 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:24:03.812 02:43:37 -- nvmf/common.sh@105 -- # continue 2 00:24:03.812 02:43:37 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:24:03.812 02:43:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:03.812 02:43:37 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:24:03.812 02:43:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:03.812 02:43:37 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:24:03.812 02:43:37 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:24:03.812 02:43:37 -- nvmf/common.sh@105 -- # continue 2 00:24:03.812 02:43:37 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:24:03.812 02:43:37 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:24:03.812 02:43:37 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:24:03.812 02:43:37 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:24:03.812 02:43:37 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:03.812 02:43:37 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:03.812 02:43:37 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:24:03.812 02:43:37 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:24:03.812 02:43:37 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:24:03.812 02:43:37 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:24:03.812 02:43:37 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:03.812 02:43:37 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:03.812 02:43:37 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:24:03.812 192.168.100.9' 00:24:03.812 02:43:37 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:24:03.812 192.168.100.9' 00:24:03.812 02:43:37 -- nvmf/common.sh@446 -- # head -n 1 00:24:03.812 02:43:37 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:24:03.812 02:43:37 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:24:03.812 192.168.100.9' 00:24:03.812 02:43:37 -- nvmf/common.sh@447 -- # tail -n +2 00:24:03.812 02:43:37 -- nvmf/common.sh@447 -- # head -n 1 00:24:03.812 02:43:37 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:24:03.812 02:43:37 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:24:03.812 02:43:37 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:24:03.812 02:43:37 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:24:03.812 02:43:37 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:24:03.812 02:43:37 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:24:03.812 02:43:37 -- host/bdevperf.sh@25 -- # tgt_init 00:24:03.812 02:43:37 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:24:03.812 02:43:37 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:24:03.812 02:43:37 -- common/autotest_common.sh@710 -- # xtrace_disable 00:24:03.812 02:43:37 -- common/autotest_common.sh@10 -- # set +x 00:24:03.812 02:43:37 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:24:03.812 02:43:37 -- nvmf/common.sh@470 -- # nvmfpid=1649852 00:24:03.812 02:43:37 -- nvmf/common.sh@471 -- # waitforlisten 1649852 00:24:03.812 02:43:37 -- common/autotest_common.sh@817 -- # '[' -z 1649852 ']' 00:24:03.812 02:43:37 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:03.812 02:43:37 -- common/autotest_common.sh@822 -- # local max_retries=100 00:24:03.812 02:43:37 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:03.812 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:03.812 02:43:37 -- common/autotest_common.sh@826 -- # xtrace_disable 00:24:03.812 02:43:37 -- common/autotest_common.sh@10 -- # set +x 00:24:03.812 [2024-04-27 02:43:37.350668] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:24:03.812 [2024-04-27 02:43:37.350725] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:03.812 EAL: No free 2048 kB hugepages reported on node 1 00:24:03.812 [2024-04-27 02:43:37.422030] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:24:04.070 [2024-04-27 02:43:37.505811] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:04.070 [2024-04-27 02:43:37.505849] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:04.070 [2024-04-27 02:43:37.505864] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:24:04.071 [2024-04-27 02:43:37.505877] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:24:04.071 [2024-04-27 02:43:37.505887] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:04.071 [2024-04-27 02:43:37.505992] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:04.071 [2024-04-27 02:43:37.506069] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:04.071 [2024-04-27 02:43:37.506073] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:04.637 02:43:38 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:24:04.637 02:43:38 -- common/autotest_common.sh@850 -- # return 0 00:24:04.637 02:43:38 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:24:04.637 02:43:38 -- common/autotest_common.sh@716 -- # xtrace_disable 00:24:04.637 02:43:38 -- common/autotest_common.sh@10 -- # set +x 00:24:04.637 02:43:38 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:04.637 02:43:38 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:24:04.637 02:43:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:04.637 02:43:38 -- common/autotest_common.sh@10 -- # set +x 00:24:04.896 [2024-04-27 02:43:38.259417] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x8dad30/0x8df220) succeed. 00:24:04.896 [2024-04-27 02:43:38.269490] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x8dc2d0/0x9208b0) succeed. 00:24:04.896 02:43:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:04.896 02:43:38 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:24:04.896 02:43:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:04.896 02:43:38 -- common/autotest_common.sh@10 -- # set +x 00:24:04.896 Malloc0 00:24:04.896 02:43:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:04.896 02:43:38 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:04.896 02:43:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:04.896 02:43:38 -- common/autotest_common.sh@10 -- # set +x 00:24:04.896 02:43:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:04.896 02:43:38 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:24:04.896 02:43:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:04.896 02:43:38 -- common/autotest_common.sh@10 -- # set +x 00:24:04.896 02:43:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:04.896 02:43:38 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:24:04.896 02:43:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:04.896 02:43:38 -- common/autotest_common.sh@10 -- # set +x 00:24:04.896 [2024-04-27 02:43:38.404353] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:24:04.896 02:43:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:04.896 02:43:38 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:24:04.896 02:43:38 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:24:04.896 02:43:38 -- nvmf/common.sh@521 -- # config=() 00:24:04.896 02:43:38 -- nvmf/common.sh@521 -- # local subsystem config 00:24:04.896 02:43:38 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:04.896 02:43:38 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:04.896 { 00:24:04.896 "params": { 00:24:04.896 "name": "Nvme$subsystem", 00:24:04.896 "trtype": "$TEST_TRANSPORT", 00:24:04.896 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:04.896 "adrfam": "ipv4", 00:24:04.896 "trsvcid": "$NVMF_PORT", 00:24:04.896 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:04.896 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:04.896 "hdgst": ${hdgst:-false}, 00:24:04.896 "ddgst": ${ddgst:-false} 00:24:04.896 }, 00:24:04.896 "method": "bdev_nvme_attach_controller" 00:24:04.896 } 00:24:04.896 EOF 00:24:04.896 )") 00:24:04.896 02:43:38 -- nvmf/common.sh@543 -- # cat 00:24:04.896 02:43:38 -- nvmf/common.sh@545 -- # jq . 00:24:04.896 02:43:38 -- nvmf/common.sh@546 -- # IFS=, 00:24:04.896 02:43:38 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:24:04.896 "params": { 00:24:04.896 "name": "Nvme1", 00:24:04.896 "trtype": "rdma", 00:24:04.896 "traddr": "192.168.100.8", 00:24:04.896 "adrfam": "ipv4", 00:24:04.896 "trsvcid": "4420", 00:24:04.896 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:24:04.896 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:24:04.896 "hdgst": false, 00:24:04.896 "ddgst": false 00:24:04.896 }, 00:24:04.896 "method": "bdev_nvme_attach_controller" 00:24:04.896 }' 00:24:04.896 [2024-04-27 02:43:38.453304] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:24:04.896 [2024-04-27 02:43:38.453375] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1650054 ] 00:24:04.896 EAL: No free 2048 kB hugepages reported on node 1 00:24:05.154 [2024-04-27 02:43:38.525411] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:05.154 [2024-04-27 02:43:38.606067] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:05.412 Running I/O for 1 seconds... 00:24:06.375 00:24:06.375 Latency(us) 00:24:06.375 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:24:06.375 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:24:06.375 Verification LBA range: start 0x0 length 0x4000 00:24:06.375 Nvme1n1 : 1.00 18110.23 70.74 0.00 0.00 7027.18 302.75 12252.38 00:24:06.375 =================================================================================================================== 00:24:06.375 Total : 18110.23 70.74 0.00 0.00 7027.18 302.75 12252.38 00:24:06.632 02:43:40 -- host/bdevperf.sh@30 -- # bdevperfpid=1650240 00:24:06.632 02:43:40 -- host/bdevperf.sh@32 -- # sleep 3 00:24:06.632 02:43:40 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:24:06.632 02:43:40 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:24:06.632 02:43:40 -- nvmf/common.sh@521 -- # config=() 00:24:06.632 02:43:40 -- nvmf/common.sh@521 -- # local subsystem config 00:24:06.632 02:43:40 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:06.632 02:43:40 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:06.632 { 00:24:06.632 "params": { 00:24:06.632 "name": "Nvme$subsystem", 00:24:06.632 "trtype": "$TEST_TRANSPORT", 00:24:06.632 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:06.632 "adrfam": "ipv4", 00:24:06.632 "trsvcid": "$NVMF_PORT", 00:24:06.632 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:06.632 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:06.632 "hdgst": ${hdgst:-false}, 00:24:06.632 "ddgst": ${ddgst:-false} 00:24:06.632 }, 00:24:06.632 "method": "bdev_nvme_attach_controller" 00:24:06.632 } 00:24:06.632 EOF 00:24:06.632 )") 00:24:06.632 02:43:40 -- nvmf/common.sh@543 -- # cat 00:24:06.632 02:43:40 -- nvmf/common.sh@545 -- # jq . 00:24:06.632 02:43:40 -- nvmf/common.sh@546 -- # IFS=, 00:24:06.632 02:43:40 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:24:06.632 "params": { 00:24:06.632 "name": "Nvme1", 00:24:06.632 "trtype": "rdma", 00:24:06.633 "traddr": "192.168.100.8", 00:24:06.633 "adrfam": "ipv4", 00:24:06.633 "trsvcid": "4420", 00:24:06.633 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:24:06.633 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:24:06.633 "hdgst": false, 00:24:06.633 "ddgst": false 00:24:06.633 }, 00:24:06.633 "method": "bdev_nvme_attach_controller" 00:24:06.633 }' 00:24:06.633 [2024-04-27 02:43:40.093029] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:24:06.633 [2024-04-27 02:43:40.093082] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1650240 ] 00:24:06.633 EAL: No free 2048 kB hugepages reported on node 1 00:24:06.633 [2024-04-27 02:43:40.167219] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:06.633 [2024-04-27 02:43:40.246954] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:06.891 Running I/O for 15 seconds... 00:24:10.169 02:43:43 -- host/bdevperf.sh@33 -- # kill -9 1649852 00:24:10.169 02:43:43 -- host/bdevperf.sh@35 -- # sleep 3 00:24:10.736 [2024-04-27 02:43:44.075383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:120832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.736 [2024-04-27 02:43:44.075425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.736 [2024-04-27 02:43:44.075448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:120840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.736 [2024-04-27 02:43:44.075458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.736 [2024-04-27 02:43:44.075475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:120848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.736 [2024-04-27 02:43:44.075484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.736 [2024-04-27 02:43:44.075495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:120856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.736 [2024-04-27 02:43:44.075504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.736 [2024-04-27 02:43:44.075515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:120864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.736 [2024-04-27 02:43:44.075525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.736 [2024-04-27 02:43:44.075536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:120872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.736 [2024-04-27 02:43:44.075545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.736 [2024-04-27 02:43:44.075556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:120880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.736 [2024-04-27 02:43:44.075566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.736 [2024-04-27 02:43:44.075577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:120888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.736 [2024-04-27 02:43:44.075587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.736 [2024-04-27 02:43:44.075598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:120896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.736 [2024-04-27 02:43:44.075607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.736 [2024-04-27 02:43:44.075618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:120904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.736 [2024-04-27 02:43:44.075628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.736 [2024-04-27 02:43:44.075639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:120912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.736 [2024-04-27 02:43:44.075649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.736 [2024-04-27 02:43:44.075659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:120920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.736 [2024-04-27 02:43:44.075668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.736 [2024-04-27 02:43:44.075679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:120928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.736 [2024-04-27 02:43:44.075689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.736 [2024-04-27 02:43:44.075700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:120936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.736 [2024-04-27 02:43:44.075709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.736 [2024-04-27 02:43:44.075721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:120944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.736 [2024-04-27 02:43:44.075730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.736 [2024-04-27 02:43:44.075741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:120952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.736 [2024-04-27 02:43:44.075751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.736 [2024-04-27 02:43:44.075762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:120960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.736 [2024-04-27 02:43:44.075771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.736 [2024-04-27 02:43:44.075782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:120968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.736 [2024-04-27 02:43:44.075793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.736 [2024-04-27 02:43:44.075805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:120976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.736 [2024-04-27 02:43:44.075813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.736 [2024-04-27 02:43:44.075824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:120984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.736 [2024-04-27 02:43:44.075833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.736 [2024-04-27 02:43:44.075845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:120992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.736 [2024-04-27 02:43:44.075855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.736 [2024-04-27 02:43:44.075867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:121000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.736 [2024-04-27 02:43:44.075876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.736 [2024-04-27 02:43:44.075886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:121008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.736 [2024-04-27 02:43:44.075895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.736 [2024-04-27 02:43:44.075905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:121016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.736 [2024-04-27 02:43:44.075914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.736 [2024-04-27 02:43:44.075925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:121024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.736 [2024-04-27 02:43:44.075934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.736 [2024-04-27 02:43:44.075944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:121032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.736 [2024-04-27 02:43:44.075954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.736 [2024-04-27 02:43:44.075964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:121040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.736 [2024-04-27 02:43:44.075975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.736 [2024-04-27 02:43:44.075985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:121048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.736 [2024-04-27 02:43:44.075994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.736 [2024-04-27 02:43:44.076005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:121056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.736 [2024-04-27 02:43:44.076014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.736 [2024-04-27 02:43:44.076024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:121064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.736 [2024-04-27 02:43:44.076033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.736 [2024-04-27 02:43:44.076044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:121072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.736 [2024-04-27 02:43:44.076053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.737 [2024-04-27 02:43:44.076063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:121080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.737 [2024-04-27 02:43:44.076072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.737 [2024-04-27 02:43:44.076083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:121088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.737 [2024-04-27 02:43:44.076092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.737 [2024-04-27 02:43:44.076103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:121096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.737 [2024-04-27 02:43:44.076112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.737 [2024-04-27 02:43:44.076122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:121104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.737 [2024-04-27 02:43:44.076132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.737 [2024-04-27 02:43:44.076142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:121112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.737 [2024-04-27 02:43:44.076151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.737 [2024-04-27 02:43:44.076161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:121120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.737 [2024-04-27 02:43:44.076170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.737 [2024-04-27 02:43:44.076181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:121128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.737 [2024-04-27 02:43:44.076190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.737 [2024-04-27 02:43:44.076200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:121136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.737 [2024-04-27 02:43:44.076210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.737 [2024-04-27 02:43:44.076221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:121144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.737 [2024-04-27 02:43:44.076229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.737 [2024-04-27 02:43:44.076240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:121152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.737 [2024-04-27 02:43:44.076249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.737 [2024-04-27 02:43:44.076259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:121160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.737 [2024-04-27 02:43:44.076268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.737 [2024-04-27 02:43:44.076279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:121168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.737 [2024-04-27 02:43:44.076288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.737 [2024-04-27 02:43:44.076298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:121176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.737 [2024-04-27 02:43:44.076307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.737 [2024-04-27 02:43:44.076318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:121184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.737 [2024-04-27 02:43:44.076327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.737 [2024-04-27 02:43:44.076343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:121192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.737 [2024-04-27 02:43:44.076352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.737 [2024-04-27 02:43:44.076363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:121200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.737 [2024-04-27 02:43:44.076372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.737 [2024-04-27 02:43:44.076382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:121208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.737 [2024-04-27 02:43:44.076391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.737 [2024-04-27 02:43:44.076402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:121216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.737 [2024-04-27 02:43:44.076411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.737 [2024-04-27 02:43:44.076422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:121224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.737 [2024-04-27 02:43:44.076431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.737 [2024-04-27 02:43:44.076442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:121232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.737 [2024-04-27 02:43:44.076451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.737 [2024-04-27 02:43:44.076463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:121240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.737 [2024-04-27 02:43:44.076472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.737 [2024-04-27 02:43:44.076494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:121248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.737 [2024-04-27 02:43:44.076502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.737 [2024-04-27 02:43:44.076513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:121256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.737 [2024-04-27 02:43:44.076521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.737 [2024-04-27 02:43:44.076531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:121264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.737 [2024-04-27 02:43:44.076540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.737 [2024-04-27 02:43:44.076550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:121272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.737 [2024-04-27 02:43:44.076558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.737 [2024-04-27 02:43:44.076568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:121280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.737 [2024-04-27 02:43:44.076577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.737 [2024-04-27 02:43:44.076586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:121288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.737 [2024-04-27 02:43:44.076595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.737 [2024-04-27 02:43:44.076606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:121296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.737 [2024-04-27 02:43:44.076614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.737 [2024-04-27 02:43:44.076624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:121304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.737 [2024-04-27 02:43:44.076633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.737 [2024-04-27 02:43:44.076643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:121312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.737 [2024-04-27 02:43:44.076651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.737 [2024-04-27 02:43:44.076662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:121320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.737 [2024-04-27 02:43:44.076670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.737 [2024-04-27 02:43:44.076680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:121328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.737 [2024-04-27 02:43:44.076688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.737 [2024-04-27 02:43:44.076703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:121336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.737 [2024-04-27 02:43:44.076711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.737 [2024-04-27 02:43:44.076721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:121344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.737 [2024-04-27 02:43:44.076730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.737 [2024-04-27 02:43:44.076741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:121352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.737 [2024-04-27 02:43:44.076749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.737 [2024-04-27 02:43:44.076759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:121360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.737 [2024-04-27 02:43:44.076768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.737 [2024-04-27 02:43:44.076778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:121368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.737 [2024-04-27 02:43:44.076787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.737 [2024-04-27 02:43:44.076797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:121376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.737 [2024-04-27 02:43:44.076806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.737 [2024-04-27 02:43:44.076816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:121384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.738 [2024-04-27 02:43:44.076824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.738 [2024-04-27 02:43:44.076834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:121392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.738 [2024-04-27 02:43:44.076843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.738 [2024-04-27 02:43:44.076853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:121400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.738 [2024-04-27 02:43:44.076861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.738 [2024-04-27 02:43:44.076871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:121408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.738 [2024-04-27 02:43:44.076880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.738 [2024-04-27 02:43:44.076890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:121416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.738 [2024-04-27 02:43:44.076898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.738 [2024-04-27 02:43:44.076908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:121424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.738 [2024-04-27 02:43:44.076917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.738 [2024-04-27 02:43:44.076928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:121432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.738 [2024-04-27 02:43:44.076937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.738 [2024-04-27 02:43:44.076947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:121440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.738 [2024-04-27 02:43:44.076955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.738 [2024-04-27 02:43:44.076965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:121448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.738 [2024-04-27 02:43:44.076973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.738 [2024-04-27 02:43:44.076983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:121456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.738 [2024-04-27 02:43:44.076991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.738 [2024-04-27 02:43:44.077002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:121464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.738 [2024-04-27 02:43:44.077010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.738 [2024-04-27 02:43:44.077020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:121472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.738 [2024-04-27 02:43:44.077028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.738 [2024-04-27 02:43:44.077039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:121480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.738 [2024-04-27 02:43:44.077047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.738 [2024-04-27 02:43:44.077057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:121488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.738 [2024-04-27 02:43:44.077066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.738 [2024-04-27 02:43:44.077075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:121496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.738 [2024-04-27 02:43:44.077084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.738 [2024-04-27 02:43:44.077093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:121504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.738 [2024-04-27 02:43:44.077102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.738 [2024-04-27 02:43:44.077112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:121512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.738 [2024-04-27 02:43:44.077120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.738 [2024-04-27 02:43:44.077130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:121520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.738 [2024-04-27 02:43:44.077139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.738 [2024-04-27 02:43:44.077148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:121528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.738 [2024-04-27 02:43:44.077158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.738 [2024-04-27 02:43:44.077168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:121536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.738 [2024-04-27 02:43:44.077177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.738 [2024-04-27 02:43:44.077187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:121544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.738 [2024-04-27 02:43:44.077195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.738 [2024-04-27 02:43:44.077205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:121552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.738 [2024-04-27 02:43:44.077213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.738 [2024-04-27 02:43:44.077223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:121560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.738 [2024-04-27 02:43:44.077232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.738 [2024-04-27 02:43:44.077242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:121568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.738 [2024-04-27 02:43:44.077250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.738 [2024-04-27 02:43:44.077260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:121576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.738 [2024-04-27 02:43:44.077268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.738 [2024-04-27 02:43:44.077278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:121584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.738 [2024-04-27 02:43:44.077286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.738 [2024-04-27 02:43:44.077296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:121592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.738 [2024-04-27 02:43:44.077304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.738 [2024-04-27 02:43:44.077314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:121600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.738 [2024-04-27 02:43:44.077322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.738 [2024-04-27 02:43:44.077332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:121608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.738 [2024-04-27 02:43:44.077347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.738 [2024-04-27 02:43:44.077357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:121616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.738 [2024-04-27 02:43:44.077365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.738 [2024-04-27 02:43:44.077375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:121624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.738 [2024-04-27 02:43:44.077385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.738 [2024-04-27 02:43:44.077395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:121632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.738 [2024-04-27 02:43:44.077404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.738 [2024-04-27 02:43:44.077414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:121640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.738 [2024-04-27 02:43:44.077422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.738 [2024-04-27 02:43:44.077432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:121648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.738 [2024-04-27 02:43:44.077441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.738 [2024-04-27 02:43:44.077451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:121656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.738 [2024-04-27 02:43:44.077459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.738 [2024-04-27 02:43:44.077469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:121664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.738 [2024-04-27 02:43:44.077478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.738 [2024-04-27 02:43:44.077488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:121672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.738 [2024-04-27 02:43:44.077496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.738 [2024-04-27 02:43:44.077506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:121680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.738 [2024-04-27 02:43:44.077514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.738 [2024-04-27 02:43:44.077524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:121688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.738 [2024-04-27 02:43:44.077533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.739 [2024-04-27 02:43:44.077543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:121696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.739 [2024-04-27 02:43:44.077551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.739 [2024-04-27 02:43:44.077561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:121704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.739 [2024-04-27 02:43:44.077570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.739 [2024-04-27 02:43:44.077579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:121712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.739 [2024-04-27 02:43:44.077588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.739 [2024-04-27 02:43:44.077597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:121720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.739 [2024-04-27 02:43:44.077606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.739 [2024-04-27 02:43:44.077617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:121728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.739 [2024-04-27 02:43:44.077625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.739 [2024-04-27 02:43:44.077636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:121736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.739 [2024-04-27 02:43:44.077644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.739 [2024-04-27 02:43:44.077654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:121744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.739 [2024-04-27 02:43:44.077663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.739 [2024-04-27 02:43:44.077673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:121752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.739 [2024-04-27 02:43:44.077681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.739 [2024-04-27 02:43:44.077691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:121760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.739 [2024-04-27 02:43:44.077699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.739 [2024-04-27 02:43:44.077709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:121768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.739 [2024-04-27 02:43:44.077718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.739 [2024-04-27 02:43:44.077728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:121776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.739 [2024-04-27 02:43:44.077736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.739 [2024-04-27 02:43:44.077746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:121784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.739 [2024-04-27 02:43:44.077754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.739 [2024-04-27 02:43:44.077764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:121792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.739 [2024-04-27 02:43:44.077773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.739 [2024-04-27 02:43:44.077782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:121800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.739 [2024-04-27 02:43:44.077791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.739 [2024-04-27 02:43:44.077801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:121808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.739 [2024-04-27 02:43:44.077809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.739 [2024-04-27 02:43:44.077819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:121816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.739 [2024-04-27 02:43:44.077827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.739 [2024-04-27 02:43:44.077838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:121824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.739 [2024-04-27 02:43:44.077847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.739 [2024-04-27 02:43:44.077857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:121832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.739 [2024-04-27 02:43:44.077865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.739 [2024-04-27 02:43:44.077875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:121840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:10.739 [2024-04-27 02:43:44.077883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:09a0 p:0 m:0 dnr:0 00:24:10.739 [2024-04-27 02:43:44.079693] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:10.739 [2024-04-27 02:43:44.079707] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:10.739 [2024-04-27 02:43:44.079716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:121848 len:8 PRP1 0x0 PRP2 0x0 00:24:10.739 [2024-04-27 02:43:44.079725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:10.739 [2024-04-27 02:43:44.079769] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192e4a00 was disconnected and freed. reset controller. 00:24:10.739 [2024-04-27 02:43:44.082609] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:10.739 [2024-04-27 02:43:44.096685] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:10.739 [2024-04-27 02:43:44.099900] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:24:10.739 [2024-04-27 02:43:44.099922] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:24:10.739 [2024-04-27 02:43:44.099931] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:24:11.672 [2024-04-27 02:43:45.103780] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:11.672 [2024-04-27 02:43:45.103801] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:11.672 [2024-04-27 02:43:45.103973] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:11.672 [2024-04-27 02:43:45.103983] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:11.672 [2024-04-27 02:43:45.103993] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] already in failed state 00:24:11.672 [2024-04-27 02:43:45.105104] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:11.672 [2024-04-27 02:43:45.106680] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:11.672 [2024-04-27 02:43:45.117828] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:11.672 [2024-04-27 02:43:45.120530] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:24:11.672 [2024-04-27 02:43:45.120550] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:24:11.672 [2024-04-27 02:43:45.120559] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:24:12.604 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 1649852 Killed "${NVMF_APP[@]}" "$@" 00:24:12.604 02:43:46 -- host/bdevperf.sh@36 -- # tgt_init 00:24:12.604 02:43:46 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:24:12.604 02:43:46 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:24:12.604 02:43:46 -- common/autotest_common.sh@710 -- # xtrace_disable 00:24:12.604 02:43:46 -- common/autotest_common.sh@10 -- # set +x 00:24:12.604 02:43:46 -- nvmf/common.sh@470 -- # nvmfpid=1650994 00:24:12.604 02:43:46 -- nvmf/common.sh@471 -- # waitforlisten 1650994 00:24:12.604 02:43:46 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:24:12.604 02:43:46 -- common/autotest_common.sh@817 -- # '[' -z 1650994 ']' 00:24:12.604 02:43:46 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:12.604 02:43:46 -- common/autotest_common.sh@822 -- # local max_retries=100 00:24:12.604 02:43:46 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:12.604 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:12.604 02:43:46 -- common/autotest_common.sh@826 -- # xtrace_disable 00:24:12.604 02:43:46 -- common/autotest_common.sh@10 -- # set +x 00:24:12.604 [2024-04-27 02:43:46.118270] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:24:12.604 [2024-04-27 02:43:46.118323] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:12.604 [2024-04-27 02:43:46.124590] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:12.604 [2024-04-27 02:43:46.124618] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:12.604 [2024-04-27 02:43:46.124796] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:12.604 [2024-04-27 02:43:46.124808] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:12.604 [2024-04-27 02:43:46.124818] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] already in failed state 00:24:12.604 [2024-04-27 02:43:46.125483] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:12.604 [2024-04-27 02:43:46.127586] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:12.604 [2024-04-27 02:43:46.138364] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:12.604 [2024-04-27 02:43:46.140993] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:24:12.604 [2024-04-27 02:43:46.141016] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:24:12.604 [2024-04-27 02:43:46.141025] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:24:12.604 EAL: No free 2048 kB hugepages reported on node 1 00:24:12.604 [2024-04-27 02:43:46.192927] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:24:12.863 [2024-04-27 02:43:46.282726] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:12.863 [2024-04-27 02:43:46.282769] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:12.863 [2024-04-27 02:43:46.282784] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:24:12.863 [2024-04-27 02:43:46.282797] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:24:12.863 [2024-04-27 02:43:46.282806] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:12.863 [2024-04-27 02:43:46.282856] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:12.863 [2024-04-27 02:43:46.282935] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:12.863 [2024-04-27 02:43:46.282938] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:13.428 02:43:46 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:24:13.428 02:43:46 -- common/autotest_common.sh@850 -- # return 0 00:24:13.428 02:43:46 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:24:13.428 02:43:46 -- common/autotest_common.sh@716 -- # xtrace_disable 00:24:13.428 02:43:46 -- common/autotest_common.sh@10 -- # set +x 00:24:13.428 02:43:46 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:13.428 02:43:46 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:24:13.428 02:43:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:13.428 02:43:46 -- common/autotest_common.sh@10 -- # set +x 00:24:13.428 [2024-04-27 02:43:47.009025] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1e84d30/0x1e89220) succeed. 00:24:13.428 [2024-04-27 02:43:47.019073] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1e862d0/0x1eca8b0) succeed. 00:24:13.686 02:43:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:13.686 02:43:47 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:24:13.686 02:43:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:13.686 02:43:47 -- common/autotest_common.sh@10 -- # set +x 00:24:13.686 Malloc0 00:24:13.686 02:43:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:13.686 02:43:47 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:13.686 02:43:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:13.686 02:43:47 -- common/autotest_common.sh@10 -- # set +x 00:24:13.686 [2024-04-27 02:43:47.144985] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:13.686 [2024-04-27 02:43:47.145018] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:13.686 [2024-04-27 02:43:47.145196] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:13.686 [2024-04-27 02:43:47.145207] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:13.686 [2024-04-27 02:43:47.145218] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] already in failed state 00:24:13.686 02:43:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:13.686 02:43:47 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:24:13.686 02:43:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:13.686 02:43:47 -- common/autotest_common.sh@10 -- # set +x 00:24:13.686 [2024-04-27 02:43:47.148026] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:13.686 [2024-04-27 02:43:47.153379] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:13.686 02:43:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:13.686 02:43:47 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:24:13.686 02:43:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:13.686 02:43:47 -- common/autotest_common.sh@10 -- # set +x 00:24:13.686 [2024-04-27 02:43:47.156013] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:24:13.686 [2024-04-27 02:43:47.156034] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:24:13.686 [2024-04-27 02:43:47.156042] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:24:13.686 [2024-04-27 02:43:47.159348] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:24:13.686 02:43:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:13.686 02:43:47 -- host/bdevperf.sh@38 -- # wait 1650240 00:24:14.618 [2024-04-27 02:43:48.159985] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:14.619 [2024-04-27 02:43:48.160008] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:14.619 [2024-04-27 02:43:48.160183] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:14.619 [2024-04-27 02:43:48.160194] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:14.619 [2024-04-27 02:43:48.160208] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] already in failed state 00:24:14.619 [2024-04-27 02:43:48.162938] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:14.619 [2024-04-27 02:43:48.166317] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:14.619 [2024-04-27 02:43:48.209905] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:24:22.752 00:24:22.752 Latency(us) 00:24:22.752 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:24:22.752 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:24:22.752 Verification LBA range: start 0x0 length 0x4000 00:24:22.752 Nvme1n1 : 15.01 12020.90 46.96 13814.19 0.00 4935.04 454.12 1028516.29 00:24:22.752 =================================================================================================================== 00:24:22.752 Total : 12020.90 46.96 13814.19 0.00 4935.04 454.12 1028516.29 00:24:22.752 02:43:55 -- host/bdevperf.sh@39 -- # sync 00:24:22.752 02:43:55 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:22.752 02:43:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:22.752 02:43:55 -- common/autotest_common.sh@10 -- # set +x 00:24:22.752 02:43:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:22.752 02:43:55 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:24:22.752 02:43:55 -- host/bdevperf.sh@44 -- # nvmftestfini 00:24:22.752 02:43:55 -- nvmf/common.sh@477 -- # nvmfcleanup 00:24:22.752 02:43:55 -- nvmf/common.sh@117 -- # sync 00:24:22.752 02:43:55 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:24:22.752 02:43:55 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:24:22.752 02:43:55 -- nvmf/common.sh@120 -- # set +e 00:24:22.752 02:43:55 -- nvmf/common.sh@121 -- # for i in {1..20} 00:24:22.752 02:43:55 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:24:22.752 rmmod nvme_rdma 00:24:22.752 rmmod nvme_fabrics 00:24:22.752 02:43:55 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:24:22.752 02:43:55 -- nvmf/common.sh@124 -- # set -e 00:24:22.752 02:43:55 -- nvmf/common.sh@125 -- # return 0 00:24:22.753 02:43:55 -- nvmf/common.sh@478 -- # '[' -n 1650994 ']' 00:24:22.753 02:43:55 -- nvmf/common.sh@479 -- # killprocess 1650994 00:24:22.753 02:43:55 -- common/autotest_common.sh@936 -- # '[' -z 1650994 ']' 00:24:22.753 02:43:55 -- common/autotest_common.sh@940 -- # kill -0 1650994 00:24:22.753 02:43:55 -- common/autotest_common.sh@941 -- # uname 00:24:22.753 02:43:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:22.753 02:43:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1650994 00:24:22.753 02:43:55 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:24:22.753 02:43:55 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:24:22.753 02:43:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1650994' 00:24:22.753 killing process with pid 1650994 00:24:22.753 02:43:55 -- common/autotest_common.sh@955 -- # kill 1650994 00:24:22.753 02:43:55 -- common/autotest_common.sh@960 -- # wait 1650994 00:24:22.753 [2024-04-27 02:43:55.920457] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:24:22.753 02:43:56 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:24:22.753 02:43:56 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:24:22.753 00:24:22.753 real 0m24.598s 00:24:22.753 user 1m4.797s 00:24:22.753 sys 0m5.496s 00:24:22.753 02:43:56 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:24:22.753 02:43:56 -- common/autotest_common.sh@10 -- # set +x 00:24:22.753 ************************************ 00:24:22.753 END TEST nvmf_bdevperf 00:24:22.753 ************************************ 00:24:22.753 02:43:56 -- nvmf/nvmf.sh@120 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=rdma 00:24:22.753 02:43:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:22.753 02:43:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:22.753 02:43:56 -- common/autotest_common.sh@10 -- # set +x 00:24:22.753 ************************************ 00:24:22.753 START TEST nvmf_target_disconnect 00:24:22.753 ************************************ 00:24:22.753 02:43:56 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=rdma 00:24:23.011 * Looking for test storage... 00:24:23.011 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:24:23.011 02:43:56 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:24:23.011 02:43:56 -- nvmf/common.sh@7 -- # uname -s 00:24:23.011 02:43:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:23.011 02:43:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:23.011 02:43:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:23.011 02:43:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:23.011 02:43:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:23.011 02:43:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:23.011 02:43:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:23.011 02:43:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:23.011 02:43:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:23.011 02:43:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:23.011 02:43:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:24:23.011 02:43:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:24:23.011 02:43:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:23.011 02:43:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:23.011 02:43:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:23.011 02:43:56 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:24:23.011 02:43:56 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:24:23.011 02:43:56 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:23.011 02:43:56 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:23.011 02:43:56 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:23.011 02:43:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:23.011 02:43:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:23.011 02:43:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:23.011 02:43:56 -- paths/export.sh@5 -- # export PATH 00:24:23.011 02:43:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:23.011 02:43:56 -- nvmf/common.sh@47 -- # : 0 00:24:23.011 02:43:56 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:24:23.011 02:43:56 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:24:23.011 02:43:56 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:24:23.011 02:43:56 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:23.011 02:43:56 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:23.011 02:43:56 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:24:23.011 02:43:56 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:24:23.011 02:43:56 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:24:23.011 02:43:56 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme 00:24:23.011 02:43:56 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:24:23.011 02:43:56 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:24:23.012 02:43:56 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:24:23.012 02:43:56 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:24:23.012 02:43:56 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:23.012 02:43:56 -- nvmf/common.sh@437 -- # prepare_net_devs 00:24:23.012 02:43:56 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:24:23.012 02:43:56 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:24:23.012 02:43:56 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:23.012 02:43:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:23.012 02:43:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:23.012 02:43:56 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:24:23.012 02:43:56 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:24:23.012 02:43:56 -- nvmf/common.sh@285 -- # xtrace_disable 00:24:23.012 02:43:56 -- common/autotest_common.sh@10 -- # set +x 00:24:29.573 02:44:02 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:29.573 02:44:02 -- nvmf/common.sh@291 -- # pci_devs=() 00:24:29.573 02:44:02 -- nvmf/common.sh@291 -- # local -a pci_devs 00:24:29.573 02:44:02 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:24:29.573 02:44:02 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:24:29.573 02:44:02 -- nvmf/common.sh@293 -- # pci_drivers=() 00:24:29.573 02:44:02 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:24:29.573 02:44:02 -- nvmf/common.sh@295 -- # net_devs=() 00:24:29.573 02:44:02 -- nvmf/common.sh@295 -- # local -ga net_devs 00:24:29.573 02:44:02 -- nvmf/common.sh@296 -- # e810=() 00:24:29.573 02:44:02 -- nvmf/common.sh@296 -- # local -ga e810 00:24:29.573 02:44:02 -- nvmf/common.sh@297 -- # x722=() 00:24:29.573 02:44:02 -- nvmf/common.sh@297 -- # local -ga x722 00:24:29.573 02:44:02 -- nvmf/common.sh@298 -- # mlx=() 00:24:29.573 02:44:02 -- nvmf/common.sh@298 -- # local -ga mlx 00:24:29.573 02:44:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:29.573 02:44:02 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:29.573 02:44:02 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:29.573 02:44:02 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:29.573 02:44:02 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:29.573 02:44:02 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:29.573 02:44:02 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:29.573 02:44:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:29.573 02:44:02 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:29.573 02:44:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:29.573 02:44:02 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:29.573 02:44:02 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:24:29.573 02:44:02 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:24:29.573 02:44:02 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:24:29.573 02:44:02 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:24:29.573 02:44:02 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:24:29.573 02:44:02 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:24:29.573 02:44:02 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:24:29.573 02:44:02 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:24:29.573 02:44:02 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:24:29.573 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:24:29.573 02:44:02 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:24:29.573 02:44:02 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:24:29.573 02:44:02 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:24:29.573 02:44:02 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:24:29.573 02:44:02 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:24:29.573 02:44:02 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:24:29.573 02:44:02 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:24:29.573 02:44:02 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:24:29.573 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:24:29.573 02:44:02 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:24:29.573 02:44:02 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:24:29.573 02:44:02 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:24:29.573 02:44:02 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:24:29.574 02:44:02 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:24:29.574 02:44:02 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:24:29.574 02:44:02 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:24:29.574 02:44:02 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:24:29.574 02:44:02 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:24:29.574 02:44:02 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:29.574 02:44:02 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:24:29.574 02:44:02 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:29.574 02:44:02 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:24:29.574 Found net devices under 0000:18:00.0: mlx_0_0 00:24:29.574 02:44:02 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:24:29.574 02:44:02 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:24:29.574 02:44:02 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:29.574 02:44:02 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:24:29.574 02:44:02 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:29.574 02:44:02 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:24:29.574 Found net devices under 0000:18:00.1: mlx_0_1 00:24:29.574 02:44:02 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:24:29.574 02:44:02 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:24:29.574 02:44:02 -- nvmf/common.sh@403 -- # is_hw=yes 00:24:29.574 02:44:02 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:24:29.574 02:44:02 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:24:29.574 02:44:02 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:24:29.574 02:44:02 -- nvmf/common.sh@409 -- # rdma_device_init 00:24:29.574 02:44:02 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:24:29.574 02:44:02 -- nvmf/common.sh@58 -- # uname 00:24:29.574 02:44:02 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:24:29.574 02:44:02 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:24:29.574 02:44:02 -- nvmf/common.sh@63 -- # modprobe ib_core 00:24:29.574 02:44:02 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:24:29.574 02:44:02 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:24:29.574 02:44:02 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:24:29.574 02:44:02 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:24:29.574 02:44:02 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:24:29.574 02:44:02 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:24:29.574 02:44:02 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:24:29.574 02:44:02 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:24:29.574 02:44:02 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:24:29.574 02:44:02 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:24:29.574 02:44:02 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:24:29.574 02:44:02 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:24:29.574 02:44:02 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:24:29.574 02:44:02 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:24:29.574 02:44:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:29.574 02:44:02 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:24:29.574 02:44:02 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:24:29.574 02:44:02 -- nvmf/common.sh@105 -- # continue 2 00:24:29.574 02:44:02 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:24:29.574 02:44:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:29.574 02:44:02 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:24:29.574 02:44:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:29.574 02:44:02 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:24:29.574 02:44:02 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:24:29.574 02:44:02 -- nvmf/common.sh@105 -- # continue 2 00:24:29.574 02:44:02 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:24:29.574 02:44:02 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:24:29.574 02:44:02 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:24:29.574 02:44:02 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:24:29.574 02:44:02 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:29.574 02:44:02 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:29.574 02:44:02 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:24:29.574 02:44:02 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:24:29.574 02:44:02 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:24:29.574 64: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:24:29.574 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:24:29.574 altname enp24s0f0np0 00:24:29.574 altname ens785f0np0 00:24:29.574 inet 192.168.100.8/24 scope global mlx_0_0 00:24:29.574 valid_lft forever preferred_lft forever 00:24:29.574 02:44:02 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:24:29.574 02:44:02 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:24:29.574 02:44:02 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:24:29.574 02:44:02 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:24:29.574 02:44:02 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:29.574 02:44:02 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:29.574 02:44:02 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:24:29.574 02:44:02 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:24:29.574 02:44:02 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:24:29.574 65: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:24:29.574 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:24:29.574 altname enp24s0f1np1 00:24:29.574 altname ens785f1np1 00:24:29.574 inet 192.168.100.9/24 scope global mlx_0_1 00:24:29.574 valid_lft forever preferred_lft forever 00:24:29.574 02:44:02 -- nvmf/common.sh@411 -- # return 0 00:24:29.574 02:44:02 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:24:29.574 02:44:02 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:24:29.574 02:44:02 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:24:29.574 02:44:02 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:24:29.574 02:44:02 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:24:29.574 02:44:02 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:24:29.574 02:44:02 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:24:29.574 02:44:02 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:24:29.574 02:44:02 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:24:29.574 02:44:02 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:24:29.574 02:44:02 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:24:29.574 02:44:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:29.574 02:44:02 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:24:29.574 02:44:02 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:24:29.574 02:44:02 -- nvmf/common.sh@105 -- # continue 2 00:24:29.574 02:44:02 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:24:29.574 02:44:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:29.574 02:44:02 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:24:29.574 02:44:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:29.574 02:44:02 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:24:29.574 02:44:02 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:24:29.574 02:44:02 -- nvmf/common.sh@105 -- # continue 2 00:24:29.574 02:44:02 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:24:29.574 02:44:02 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:24:29.574 02:44:02 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:24:29.574 02:44:02 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:24:29.574 02:44:02 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:29.574 02:44:02 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:29.574 02:44:02 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:24:29.574 02:44:02 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:24:29.574 02:44:02 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:24:29.574 02:44:02 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:29.574 02:44:02 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:24:29.574 02:44:02 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:29.574 02:44:02 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:24:29.574 192.168.100.9' 00:24:29.574 02:44:02 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:24:29.574 192.168.100.9' 00:24:29.574 02:44:02 -- nvmf/common.sh@446 -- # head -n 1 00:24:29.574 02:44:02 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:24:29.574 02:44:02 -- nvmf/common.sh@447 -- # tail -n +2 00:24:29.574 02:44:02 -- nvmf/common.sh@447 -- # head -n 1 00:24:29.574 02:44:02 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:24:29.574 192.168.100.9' 00:24:29.574 02:44:02 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:24:29.574 02:44:02 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:24:29.574 02:44:02 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:24:29.574 02:44:02 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:24:29.574 02:44:02 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:24:29.574 02:44:02 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:24:29.574 02:44:02 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:24:29.574 02:44:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:24:29.574 02:44:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:29.574 02:44:02 -- common/autotest_common.sh@10 -- # set +x 00:24:29.574 ************************************ 00:24:29.574 START TEST nvmf_target_disconnect_tc1 00:24:29.574 ************************************ 00:24:29.574 02:44:02 -- common/autotest_common.sh@1111 -- # nvmf_target_disconnect_tc1 00:24:29.574 02:44:02 -- host/target_disconnect.sh@32 -- # set +e 00:24:29.574 02:44:02 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:24:29.574 EAL: No free 2048 kB hugepages reported on node 1 00:24:29.574 [2024-04-27 02:44:02.603886] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:24:29.574 [2024-04-27 02:44:02.603944] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:24:29.574 [2024-04-27 02:44:02.603958] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d7080 00:24:30.138 [2024-04-27 02:44:03.607989] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:30.139 [2024-04-27 02:44:03.608057] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:24:30.139 [2024-04-27 02:44:03.608092] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr is in error state 00:24:30.139 [2024-04-27 02:44:03.608158] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:24:30.139 [2024-04-27 02:44:03.608188] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:24:30.139 spdk_nvme_probe() failed for transport address '192.168.100.8' 00:24:30.139 /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:24:30.139 Initializing NVMe Controllers 00:24:30.139 02:44:03 -- host/target_disconnect.sh@33 -- # trap - ERR 00:24:30.139 02:44:03 -- host/target_disconnect.sh@33 -- # print_backtrace 00:24:30.139 02:44:03 -- common/autotest_common.sh@1139 -- # [[ hxBET =~ e ]] 00:24:30.139 02:44:03 -- common/autotest_common.sh@1139 -- # return 0 00:24:30.139 02:44:03 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:24:30.139 02:44:03 -- host/target_disconnect.sh@41 -- # set -e 00:24:30.139 00:24:30.139 real 0m1.126s 00:24:30.139 user 0m0.852s 00:24:30.139 sys 0m0.262s 00:24:30.139 02:44:03 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:24:30.139 02:44:03 -- common/autotest_common.sh@10 -- # set +x 00:24:30.139 ************************************ 00:24:30.139 END TEST nvmf_target_disconnect_tc1 00:24:30.139 ************************************ 00:24:30.139 02:44:03 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:24:30.139 02:44:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:24:30.139 02:44:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:30.139 02:44:03 -- common/autotest_common.sh@10 -- # set +x 00:24:30.396 ************************************ 00:24:30.396 START TEST nvmf_target_disconnect_tc2 00:24:30.396 ************************************ 00:24:30.396 02:44:03 -- common/autotest_common.sh@1111 -- # nvmf_target_disconnect_tc2 00:24:30.396 02:44:03 -- host/target_disconnect.sh@45 -- # disconnect_init 192.168.100.8 00:24:30.396 02:44:03 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:24:30.396 02:44:03 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:24:30.396 02:44:03 -- common/autotest_common.sh@710 -- # xtrace_disable 00:24:30.396 02:44:03 -- common/autotest_common.sh@10 -- # set +x 00:24:30.396 02:44:03 -- nvmf/common.sh@470 -- # nvmfpid=1655397 00:24:30.396 02:44:03 -- nvmf/common.sh@471 -- # waitforlisten 1655397 00:24:30.396 02:44:03 -- common/autotest_common.sh@817 -- # '[' -z 1655397 ']' 00:24:30.396 02:44:03 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:30.396 02:44:03 -- common/autotest_common.sh@822 -- # local max_retries=100 00:24:30.396 02:44:03 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:30.396 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:30.396 02:44:03 -- common/autotest_common.sh@826 -- # xtrace_disable 00:24:30.396 02:44:03 -- common/autotest_common.sh@10 -- # set +x 00:24:30.396 02:44:03 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:24:30.396 [2024-04-27 02:44:03.858113] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:24:30.396 [2024-04-27 02:44:03.858165] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:30.396 EAL: No free 2048 kB hugepages reported on node 1 00:24:30.396 [2024-04-27 02:44:03.944237] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:30.654 [2024-04-27 02:44:04.029840] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:30.654 [2024-04-27 02:44:04.029882] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:30.654 [2024-04-27 02:44:04.029891] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:24:30.654 [2024-04-27 02:44:04.029899] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:24:30.654 [2024-04-27 02:44:04.029906] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:30.654 [2024-04-27 02:44:04.030030] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:24:30.654 [2024-04-27 02:44:04.030132] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:24:30.654 [2024-04-27 02:44:04.030235] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:24:30.654 [2024-04-27 02:44:04.030236] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:24:31.218 02:44:04 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:24:31.218 02:44:04 -- common/autotest_common.sh@850 -- # return 0 00:24:31.218 02:44:04 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:24:31.218 02:44:04 -- common/autotest_common.sh@716 -- # xtrace_disable 00:24:31.218 02:44:04 -- common/autotest_common.sh@10 -- # set +x 00:24:31.218 02:44:04 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:31.218 02:44:04 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:24:31.218 02:44:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:31.218 02:44:04 -- common/autotest_common.sh@10 -- # set +x 00:24:31.218 Malloc0 00:24:31.218 02:44:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:31.218 02:44:04 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:24:31.218 02:44:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:31.218 02:44:04 -- common/autotest_common.sh@10 -- # set +x 00:24:31.218 [2024-04-27 02:44:04.756489] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xe72400/0xe7e220) succeed. 00:24:31.218 [2024-04-27 02:44:04.767419] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xe73a40/0xefe280) succeed. 00:24:31.475 02:44:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:31.475 02:44:04 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:31.475 02:44:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:31.475 02:44:04 -- common/autotest_common.sh@10 -- # set +x 00:24:31.475 02:44:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:31.475 02:44:04 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:24:31.475 02:44:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:31.475 02:44:04 -- common/autotest_common.sh@10 -- # set +x 00:24:31.475 02:44:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:31.475 02:44:04 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:24:31.475 02:44:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:31.475 02:44:04 -- common/autotest_common.sh@10 -- # set +x 00:24:31.475 [2024-04-27 02:44:04.918199] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:24:31.475 02:44:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:31.475 02:44:04 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:24:31.475 02:44:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:31.475 02:44:04 -- common/autotest_common.sh@10 -- # set +x 00:24:31.475 02:44:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:31.475 02:44:04 -- host/target_disconnect.sh@50 -- # reconnectpid=1655593 00:24:31.475 02:44:04 -- host/target_disconnect.sh@52 -- # sleep 2 00:24:31.475 02:44:04 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:24:31.475 EAL: No free 2048 kB hugepages reported on node 1 00:24:33.371 02:44:06 -- host/target_disconnect.sh@53 -- # kill -9 1655397 00:24:33.371 02:44:06 -- host/target_disconnect.sh@55 -- # sleep 2 00:24:34.743 Read completed with error (sct=0, sc=8) 00:24:34.743 starting I/O failed 00:24:34.744 Read completed with error (sct=0, sc=8) 00:24:34.744 starting I/O failed 00:24:34.744 Write completed with error (sct=0, sc=8) 00:24:34.744 starting I/O failed 00:24:34.744 Read completed with error (sct=0, sc=8) 00:24:34.744 starting I/O failed 00:24:34.744 Write completed with error (sct=0, sc=8) 00:24:34.744 starting I/O failed 00:24:34.744 Write completed with error (sct=0, sc=8) 00:24:34.744 starting I/O failed 00:24:34.744 Write completed with error (sct=0, sc=8) 00:24:34.744 starting I/O failed 00:24:34.744 Read completed with error (sct=0, sc=8) 00:24:34.744 starting I/O failed 00:24:34.744 Read completed with error (sct=0, sc=8) 00:24:34.744 starting I/O failed 00:24:34.744 Read completed with error (sct=0, sc=8) 00:24:34.744 starting I/O failed 00:24:34.744 Read completed with error (sct=0, sc=8) 00:24:34.744 starting I/O failed 00:24:34.744 Write completed with error (sct=0, sc=8) 00:24:34.744 starting I/O failed 00:24:34.744 Read completed with error (sct=0, sc=8) 00:24:34.744 starting I/O failed 00:24:34.744 Read completed with error (sct=0, sc=8) 00:24:34.744 starting I/O failed 00:24:34.744 Read completed with error (sct=0, sc=8) 00:24:34.744 starting I/O failed 00:24:34.744 Write completed with error (sct=0, sc=8) 00:24:34.744 starting I/O failed 00:24:34.744 Read completed with error (sct=0, sc=8) 00:24:34.744 starting I/O failed 00:24:34.744 Read completed with error (sct=0, sc=8) 00:24:34.744 starting I/O failed 00:24:34.744 Write completed with error (sct=0, sc=8) 00:24:34.744 starting I/O failed 00:24:34.744 Write completed with error (sct=0, sc=8) 00:24:34.744 starting I/O failed 00:24:34.744 Read completed with error (sct=0, sc=8) 00:24:34.744 starting I/O failed 00:24:34.744 Read completed with error (sct=0, sc=8) 00:24:34.744 starting I/O failed 00:24:34.744 Read completed with error (sct=0, sc=8) 00:24:34.744 starting I/O failed 00:24:34.744 Write completed with error (sct=0, sc=8) 00:24:34.744 starting I/O failed 00:24:34.744 Read completed with error (sct=0, sc=8) 00:24:34.744 starting I/O failed 00:24:34.744 Read completed with error (sct=0, sc=8) 00:24:34.744 starting I/O failed 00:24:34.744 Write completed with error (sct=0, sc=8) 00:24:34.744 starting I/O failed 00:24:34.744 Read completed with error (sct=0, sc=8) 00:24:34.744 starting I/O failed 00:24:34.744 Read completed with error (sct=0, sc=8) 00:24:34.744 starting I/O failed 00:24:34.744 Write completed with error (sct=0, sc=8) 00:24:34.744 starting I/O failed 00:24:34.744 Write completed with error (sct=0, sc=8) 00:24:34.744 starting I/O failed 00:24:34.744 Read completed with error (sct=0, sc=8) 00:24:34.744 starting I/O failed 00:24:34.744 [2024-04-27 02:44:08.122513] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:24:35.678 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 1655397 Killed "${NVMF_APP[@]}" "$@" 00:24:35.678 02:44:08 -- host/target_disconnect.sh@56 -- # disconnect_init 192.168.100.8 00:24:35.678 02:44:08 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:24:35.678 02:44:08 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:24:35.678 02:44:08 -- common/autotest_common.sh@710 -- # xtrace_disable 00:24:35.678 02:44:08 -- common/autotest_common.sh@10 -- # set +x 00:24:35.678 02:44:08 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:24:35.678 02:44:08 -- nvmf/common.sh@470 -- # nvmfpid=1656089 00:24:35.678 02:44:08 -- nvmf/common.sh@471 -- # waitforlisten 1656089 00:24:35.678 02:44:08 -- common/autotest_common.sh@817 -- # '[' -z 1656089 ']' 00:24:35.678 02:44:08 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:35.678 02:44:08 -- common/autotest_common.sh@822 -- # local max_retries=100 00:24:35.678 02:44:08 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:35.678 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:35.678 02:44:08 -- common/autotest_common.sh@826 -- # xtrace_disable 00:24:35.678 02:44:08 -- common/autotest_common.sh@10 -- # set +x 00:24:35.678 [2024-04-27 02:44:08.982511] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:24:35.678 [2024-04-27 02:44:08.982565] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:35.678 EAL: No free 2048 kB hugepages reported on node 1 00:24:35.678 [2024-04-27 02:44:09.069358] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:35.678 Read completed with error (sct=0, sc=8) 00:24:35.678 starting I/O failed 00:24:35.678 Read completed with error (sct=0, sc=8) 00:24:35.678 starting I/O failed 00:24:35.678 Read completed with error (sct=0, sc=8) 00:24:35.678 starting I/O failed 00:24:35.678 Write completed with error (sct=0, sc=8) 00:24:35.678 starting I/O failed 00:24:35.678 Write completed with error (sct=0, sc=8) 00:24:35.678 starting I/O failed 00:24:35.678 Read completed with error (sct=0, sc=8) 00:24:35.678 starting I/O failed 00:24:35.678 Write completed with error (sct=0, sc=8) 00:24:35.678 starting I/O failed 00:24:35.678 Write completed with error (sct=0, sc=8) 00:24:35.678 starting I/O failed 00:24:35.678 Read completed with error (sct=0, sc=8) 00:24:35.678 starting I/O failed 00:24:35.678 Write completed with error (sct=0, sc=8) 00:24:35.678 starting I/O failed 00:24:35.678 Read completed with error (sct=0, sc=8) 00:24:35.678 starting I/O failed 00:24:35.678 Write completed with error (sct=0, sc=8) 00:24:35.678 starting I/O failed 00:24:35.678 Read completed with error (sct=0, sc=8) 00:24:35.678 starting I/O failed 00:24:35.678 Read completed with error (sct=0, sc=8) 00:24:35.678 starting I/O failed 00:24:35.678 Read completed with error (sct=0, sc=8) 00:24:35.678 starting I/O failed 00:24:35.678 Read completed with error (sct=0, sc=8) 00:24:35.678 starting I/O failed 00:24:35.678 Write completed with error (sct=0, sc=8) 00:24:35.678 starting I/O failed 00:24:35.678 Write completed with error (sct=0, sc=8) 00:24:35.678 starting I/O failed 00:24:35.678 Read completed with error (sct=0, sc=8) 00:24:35.678 starting I/O failed 00:24:35.678 Read completed with error (sct=0, sc=8) 00:24:35.678 starting I/O failed 00:24:35.678 Write completed with error (sct=0, sc=8) 00:24:35.678 starting I/O failed 00:24:35.678 Write completed with error (sct=0, sc=8) 00:24:35.678 starting I/O failed 00:24:35.678 Write completed with error (sct=0, sc=8) 00:24:35.678 starting I/O failed 00:24:35.678 Read completed with error (sct=0, sc=8) 00:24:35.678 starting I/O failed 00:24:35.678 Write completed with error (sct=0, sc=8) 00:24:35.678 starting I/O failed 00:24:35.678 Write completed with error (sct=0, sc=8) 00:24:35.678 starting I/O failed 00:24:35.678 Read completed with error (sct=0, sc=8) 00:24:35.678 starting I/O failed 00:24:35.678 Read completed with error (sct=0, sc=8) 00:24:35.678 starting I/O failed 00:24:35.678 Read completed with error (sct=0, sc=8) 00:24:35.678 starting I/O failed 00:24:35.678 Write completed with error (sct=0, sc=8) 00:24:35.678 starting I/O failed 00:24:35.678 Write completed with error (sct=0, sc=8) 00:24:35.678 starting I/O failed 00:24:35.678 Write completed with error (sct=0, sc=8) 00:24:35.678 starting I/O failed 00:24:35.678 [2024-04-27 02:44:09.127556] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:24:35.678 [2024-04-27 02:44:09.149684] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:35.678 [2024-04-27 02:44:09.149725] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:35.678 [2024-04-27 02:44:09.149735] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:24:35.678 [2024-04-27 02:44:09.149744] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:24:35.678 [2024-04-27 02:44:09.149752] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:35.678 [2024-04-27 02:44:09.149873] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:24:35.678 [2024-04-27 02:44:09.149993] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:24:35.678 [2024-04-27 02:44:09.150091] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:24:35.678 [2024-04-27 02:44:09.150091] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:24:36.242 02:44:09 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:24:36.242 02:44:09 -- common/autotest_common.sh@850 -- # return 0 00:24:36.242 02:44:09 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:24:36.242 02:44:09 -- common/autotest_common.sh@716 -- # xtrace_disable 00:24:36.242 02:44:09 -- common/autotest_common.sh@10 -- # set +x 00:24:36.499 02:44:09 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:36.499 02:44:09 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:24:36.499 02:44:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:36.499 02:44:09 -- common/autotest_common.sh@10 -- # set +x 00:24:36.499 Malloc0 00:24:36.499 02:44:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:36.499 02:44:09 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:24:36.499 02:44:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:36.499 02:44:09 -- common/autotest_common.sh@10 -- # set +x 00:24:36.499 [2024-04-27 02:44:09.914169] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x2509400/0x2515220) succeed. 00:24:36.499 [2024-04-27 02:44:09.924933] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x250aa40/0x2595280) succeed. 00:24:36.499 02:44:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:36.499 02:44:10 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:36.499 02:44:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:36.499 02:44:10 -- common/autotest_common.sh@10 -- # set +x 00:24:36.499 02:44:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:36.499 02:44:10 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:24:36.499 02:44:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:36.499 02:44:10 -- common/autotest_common.sh@10 -- # set +x 00:24:36.499 02:44:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:36.499 02:44:10 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:24:36.499 02:44:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:36.499 02:44:10 -- common/autotest_common.sh@10 -- # set +x 00:24:36.499 [2024-04-27 02:44:10.077014] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:24:36.499 02:44:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:36.499 02:44:10 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:24:36.499 02:44:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:36.499 02:44:10 -- common/autotest_common.sh@10 -- # set +x 00:24:36.499 02:44:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:36.499 02:44:10 -- host/target_disconnect.sh@58 -- # wait 1655593 00:24:36.755 Read completed with error (sct=0, sc=8) 00:24:36.755 starting I/O failed 00:24:36.755 Write completed with error (sct=0, sc=8) 00:24:36.755 starting I/O failed 00:24:36.755 Read completed with error (sct=0, sc=8) 00:24:36.755 starting I/O failed 00:24:36.755 Read completed with error (sct=0, sc=8) 00:24:36.755 starting I/O failed 00:24:36.755 Write completed with error (sct=0, sc=8) 00:24:36.755 starting I/O failed 00:24:36.755 Write completed with error (sct=0, sc=8) 00:24:36.755 starting I/O failed 00:24:36.755 Read completed with error (sct=0, sc=8) 00:24:36.755 starting I/O failed 00:24:36.755 Read completed with error (sct=0, sc=8) 00:24:36.755 starting I/O failed 00:24:36.755 Write completed with error (sct=0, sc=8) 00:24:36.755 starting I/O failed 00:24:36.755 Read completed with error (sct=0, sc=8) 00:24:36.755 starting I/O failed 00:24:36.755 Write completed with error (sct=0, sc=8) 00:24:36.755 starting I/O failed 00:24:36.755 Read completed with error (sct=0, sc=8) 00:24:36.755 starting I/O failed 00:24:36.755 Write completed with error (sct=0, sc=8) 00:24:36.755 starting I/O failed 00:24:36.756 Write completed with error (sct=0, sc=8) 00:24:36.756 starting I/O failed 00:24:36.756 Write completed with error (sct=0, sc=8) 00:24:36.756 starting I/O failed 00:24:36.756 Write completed with error (sct=0, sc=8) 00:24:36.756 starting I/O failed 00:24:36.756 Write completed with error (sct=0, sc=8) 00:24:36.756 starting I/O failed 00:24:36.756 Read completed with error (sct=0, sc=8) 00:24:36.756 starting I/O failed 00:24:36.756 Write completed with error (sct=0, sc=8) 00:24:36.756 starting I/O failed 00:24:36.756 Write completed with error (sct=0, sc=8) 00:24:36.756 starting I/O failed 00:24:36.756 Read completed with error (sct=0, sc=8) 00:24:36.756 starting I/O failed 00:24:36.756 Write completed with error (sct=0, sc=8) 00:24:36.756 starting I/O failed 00:24:36.756 Write completed with error (sct=0, sc=8) 00:24:36.756 starting I/O failed 00:24:36.756 Read completed with error (sct=0, sc=8) 00:24:36.756 starting I/O failed 00:24:36.756 Read completed with error (sct=0, sc=8) 00:24:36.756 starting I/O failed 00:24:36.756 Read completed with error (sct=0, sc=8) 00:24:36.756 starting I/O failed 00:24:36.756 Read completed with error (sct=0, sc=8) 00:24:36.756 starting I/O failed 00:24:36.756 Write completed with error (sct=0, sc=8) 00:24:36.756 starting I/O failed 00:24:36.756 Write completed with error (sct=0, sc=8) 00:24:36.756 starting I/O failed 00:24:36.756 Read completed with error (sct=0, sc=8) 00:24:36.756 starting I/O failed 00:24:36.756 Write completed with error (sct=0, sc=8) 00:24:36.756 starting I/O failed 00:24:36.756 Read completed with error (sct=0, sc=8) 00:24:36.756 starting I/O failed 00:24:36.756 [2024-04-27 02:44:10.132826] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:36.756 [2024-04-27 02:44:10.145132] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:36.756 [2024-04-27 02:44:10.145189] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:36.756 [2024-04-27 02:44:10.145211] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:36.756 [2024-04-27 02:44:10.145222] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:36.756 [2024-04-27 02:44:10.145232] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:36.756 [2024-04-27 02:44:10.155379] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:36.756 qpair failed and we were unable to recover it. 00:24:36.756 [2024-04-27 02:44:10.165135] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:36.756 [2024-04-27 02:44:10.165175] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:36.756 [2024-04-27 02:44:10.165194] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:36.756 [2024-04-27 02:44:10.165204] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:36.756 [2024-04-27 02:44:10.165213] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:36.756 [2024-04-27 02:44:10.175353] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:36.756 qpair failed and we were unable to recover it. 00:24:36.756 [2024-04-27 02:44:10.184980] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:36.756 [2024-04-27 02:44:10.185020] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:36.756 [2024-04-27 02:44:10.185040] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:36.756 [2024-04-27 02:44:10.185050] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:36.756 [2024-04-27 02:44:10.185059] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:36.756 [2024-04-27 02:44:10.195692] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:36.756 qpair failed and we were unable to recover it. 00:24:36.756 [2024-04-27 02:44:10.205147] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:36.756 [2024-04-27 02:44:10.205192] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:36.756 [2024-04-27 02:44:10.205211] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:36.756 [2024-04-27 02:44:10.205227] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:36.756 [2024-04-27 02:44:10.205236] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:36.756 [2024-04-27 02:44:10.215517] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:36.756 qpair failed and we were unable to recover it. 00:24:36.756 [2024-04-27 02:44:10.225212] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:36.756 [2024-04-27 02:44:10.225260] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:36.756 [2024-04-27 02:44:10.225277] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:36.756 [2024-04-27 02:44:10.225287] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:36.756 [2024-04-27 02:44:10.225296] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:36.756 [2024-04-27 02:44:10.235607] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:36.756 qpair failed and we were unable to recover it. 00:24:36.756 [2024-04-27 02:44:10.245283] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:36.756 [2024-04-27 02:44:10.245321] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:36.756 [2024-04-27 02:44:10.245344] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:36.756 [2024-04-27 02:44:10.245355] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:36.756 [2024-04-27 02:44:10.245364] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:36.756 [2024-04-27 02:44:10.255726] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:36.756 qpair failed and we were unable to recover it. 00:24:36.756 [2024-04-27 02:44:10.265363] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:36.756 [2024-04-27 02:44:10.265400] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:36.756 [2024-04-27 02:44:10.265418] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:36.756 [2024-04-27 02:44:10.265434] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:36.756 [2024-04-27 02:44:10.265443] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:36.756 [2024-04-27 02:44:10.275587] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:36.756 qpair failed and we were unable to recover it. 00:24:36.756 [2024-04-27 02:44:10.285415] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:36.756 [2024-04-27 02:44:10.285456] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:36.756 [2024-04-27 02:44:10.285473] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:36.756 [2024-04-27 02:44:10.285483] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:36.756 [2024-04-27 02:44:10.285492] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:36.756 [2024-04-27 02:44:10.295688] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:36.756 qpair failed and we were unable to recover it. 00:24:36.756 [2024-04-27 02:44:10.305314] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:36.756 [2024-04-27 02:44:10.305369] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:36.756 [2024-04-27 02:44:10.305397] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:36.756 [2024-04-27 02:44:10.305407] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:36.756 [2024-04-27 02:44:10.305415] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:36.756 [2024-04-27 02:44:10.315726] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:36.756 qpair failed and we were unable to recover it. 00:24:36.756 [2024-04-27 02:44:10.325369] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:36.756 [2024-04-27 02:44:10.325406] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:36.756 [2024-04-27 02:44:10.325423] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:36.756 [2024-04-27 02:44:10.325440] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:36.756 [2024-04-27 02:44:10.325449] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:36.756 [2024-04-27 02:44:10.335731] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:36.756 qpair failed and we were unable to recover it. 00:24:36.756 [2024-04-27 02:44:10.345424] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:36.756 [2024-04-27 02:44:10.345462] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:36.756 [2024-04-27 02:44:10.345480] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:36.756 [2024-04-27 02:44:10.345497] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:36.756 [2024-04-27 02:44:10.345506] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:36.756 [2024-04-27 02:44:10.355637] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:36.757 qpair failed and we were unable to recover it. 00:24:36.757 [2024-04-27 02:44:10.365625] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:36.757 [2024-04-27 02:44:10.365666] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:36.757 [2024-04-27 02:44:10.365683] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:36.757 [2024-04-27 02:44:10.365693] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:36.757 [2024-04-27 02:44:10.365702] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.013 [2024-04-27 02:44:10.375859] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.013 qpair failed and we were unable to recover it. 00:24:37.013 [2024-04-27 02:44:10.385591] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.013 [2024-04-27 02:44:10.385637] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.013 [2024-04-27 02:44:10.385654] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.013 [2024-04-27 02:44:10.385669] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.013 [2024-04-27 02:44:10.385678] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.013 [2024-04-27 02:44:10.395992] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.013 qpair failed and we were unable to recover it. 00:24:37.013 [2024-04-27 02:44:10.405564] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.013 [2024-04-27 02:44:10.405605] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.013 [2024-04-27 02:44:10.405623] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.013 [2024-04-27 02:44:10.405637] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.013 [2024-04-27 02:44:10.405646] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.013 [2024-04-27 02:44:10.415888] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.013 qpair failed and we were unable to recover it. 00:24:37.013 [2024-04-27 02:44:10.425823] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.013 [2024-04-27 02:44:10.425869] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.013 [2024-04-27 02:44:10.425887] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.013 [2024-04-27 02:44:10.425913] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.013 [2024-04-27 02:44:10.425923] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.013 [2024-04-27 02:44:10.436078] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.013 qpair failed and we were unable to recover it. 00:24:37.013 [2024-04-27 02:44:10.445714] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.013 [2024-04-27 02:44:10.445757] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.013 [2024-04-27 02:44:10.445775] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.013 [2024-04-27 02:44:10.445787] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.013 [2024-04-27 02:44:10.445796] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.014 [2024-04-27 02:44:10.456238] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.014 qpair failed and we were unable to recover it. 00:24:37.014 [2024-04-27 02:44:10.465792] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.014 [2024-04-27 02:44:10.465836] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.014 [2024-04-27 02:44:10.465853] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.014 [2024-04-27 02:44:10.465870] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.014 [2024-04-27 02:44:10.465879] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.014 [2024-04-27 02:44:10.476166] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.014 qpair failed and we were unable to recover it. 00:24:37.014 [2024-04-27 02:44:10.485797] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.014 [2024-04-27 02:44:10.485839] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.014 [2024-04-27 02:44:10.485857] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.014 [2024-04-27 02:44:10.485875] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.014 [2024-04-27 02:44:10.485884] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.014 [2024-04-27 02:44:10.496253] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.014 qpair failed and we were unable to recover it. 00:24:37.014 [2024-04-27 02:44:10.505899] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.014 [2024-04-27 02:44:10.505939] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.014 [2024-04-27 02:44:10.505956] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.014 [2024-04-27 02:44:10.505969] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.014 [2024-04-27 02:44:10.505978] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.014 [2024-04-27 02:44:10.516434] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.014 qpair failed and we were unable to recover it. 00:24:37.014 [2024-04-27 02:44:10.525848] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.014 [2024-04-27 02:44:10.525888] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.014 [2024-04-27 02:44:10.525905] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.014 [2024-04-27 02:44:10.525914] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.014 [2024-04-27 02:44:10.525927] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.014 [2024-04-27 02:44:10.536290] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.014 qpair failed and we were unable to recover it. 00:24:37.014 [2024-04-27 02:44:10.546108] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.014 [2024-04-27 02:44:10.546148] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.014 [2024-04-27 02:44:10.546166] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.014 [2024-04-27 02:44:10.546184] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.014 [2024-04-27 02:44:10.546193] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.014 [2024-04-27 02:44:10.556586] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.014 qpair failed and we were unable to recover it. 00:24:37.014 [2024-04-27 02:44:10.566108] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.014 [2024-04-27 02:44:10.566146] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.014 [2024-04-27 02:44:10.566163] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.014 [2024-04-27 02:44:10.566180] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.014 [2024-04-27 02:44:10.566189] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.014 [2024-04-27 02:44:10.576460] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.014 qpair failed and we were unable to recover it. 00:24:37.014 [2024-04-27 02:44:10.586125] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.014 [2024-04-27 02:44:10.586166] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.014 [2024-04-27 02:44:10.586184] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.014 [2024-04-27 02:44:10.586196] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.014 [2024-04-27 02:44:10.586205] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.014 [2024-04-27 02:44:10.596502] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.014 qpair failed and we were unable to recover it. 00:24:37.014 [2024-04-27 02:44:10.606250] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.014 [2024-04-27 02:44:10.606293] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.014 [2024-04-27 02:44:10.606311] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.014 [2024-04-27 02:44:10.606327] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.014 [2024-04-27 02:44:10.606340] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.014 [2024-04-27 02:44:10.616559] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.014 qpair failed and we were unable to recover it. 00:24:37.014 [2024-04-27 02:44:10.626353] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.014 [2024-04-27 02:44:10.626397] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.014 [2024-04-27 02:44:10.626417] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.014 [2024-04-27 02:44:10.626426] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.014 [2024-04-27 02:44:10.626435] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.272 [2024-04-27 02:44:10.636805] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.272 qpair failed and we were unable to recover it. 00:24:37.272 [2024-04-27 02:44:10.646406] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.272 [2024-04-27 02:44:10.646440] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.272 [2024-04-27 02:44:10.646458] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.272 [2024-04-27 02:44:10.646467] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.272 [2024-04-27 02:44:10.646477] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.272 [2024-04-27 02:44:10.656819] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.272 qpair failed and we were unable to recover it. 00:24:37.272 [2024-04-27 02:44:10.666434] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.272 [2024-04-27 02:44:10.666472] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.272 [2024-04-27 02:44:10.666489] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.272 [2024-04-27 02:44:10.666499] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.272 [2024-04-27 02:44:10.666509] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.272 [2024-04-27 02:44:10.676898] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.272 qpair failed and we were unable to recover it. 00:24:37.272 [2024-04-27 02:44:10.686509] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.272 [2024-04-27 02:44:10.686553] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.272 [2024-04-27 02:44:10.686571] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.272 [2024-04-27 02:44:10.686588] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.272 [2024-04-27 02:44:10.686597] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.272 [2024-04-27 02:44:10.696801] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.272 qpair failed and we were unable to recover it. 00:24:37.272 [2024-04-27 02:44:10.706538] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.272 [2024-04-27 02:44:10.706577] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.272 [2024-04-27 02:44:10.706594] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.272 [2024-04-27 02:44:10.706604] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.272 [2024-04-27 02:44:10.706614] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.272 [2024-04-27 02:44:10.716760] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.272 qpair failed and we were unable to recover it. 00:24:37.272 [2024-04-27 02:44:10.726566] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.272 [2024-04-27 02:44:10.726604] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.272 [2024-04-27 02:44:10.726623] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.272 [2024-04-27 02:44:10.726639] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.272 [2024-04-27 02:44:10.726648] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.272 [2024-04-27 02:44:10.736847] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.272 qpair failed and we were unable to recover it. 00:24:37.272 [2024-04-27 02:44:10.746616] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.272 [2024-04-27 02:44:10.746655] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.272 [2024-04-27 02:44:10.746676] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.272 [2024-04-27 02:44:10.746687] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.272 [2024-04-27 02:44:10.746696] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.272 [2024-04-27 02:44:10.757034] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.272 qpair failed and we were unable to recover it. 00:24:37.272 [2024-04-27 02:44:10.766585] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.272 [2024-04-27 02:44:10.766624] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.272 [2024-04-27 02:44:10.766641] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.272 [2024-04-27 02:44:10.766650] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.272 [2024-04-27 02:44:10.766661] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.272 [2024-04-27 02:44:10.777000] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.272 qpair failed and we were unable to recover it. 00:24:37.272 [2024-04-27 02:44:10.786753] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.272 [2024-04-27 02:44:10.786799] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.272 [2024-04-27 02:44:10.786817] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.272 [2024-04-27 02:44:10.786827] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.272 [2024-04-27 02:44:10.786837] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.272 [2024-04-27 02:44:10.797163] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.272 qpair failed and we were unable to recover it. 00:24:37.272 [2024-04-27 02:44:10.806884] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.272 [2024-04-27 02:44:10.806930] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.272 [2024-04-27 02:44:10.806955] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.272 [2024-04-27 02:44:10.806965] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.272 [2024-04-27 02:44:10.806975] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.272 [2024-04-27 02:44:10.817275] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.272 qpair failed and we were unable to recover it. 00:24:37.272 [2024-04-27 02:44:10.826704] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.272 [2024-04-27 02:44:10.826744] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.272 [2024-04-27 02:44:10.826761] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.272 [2024-04-27 02:44:10.826774] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.272 [2024-04-27 02:44:10.826783] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.272 [2024-04-27 02:44:10.837360] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.272 qpair failed and we were unable to recover it. 00:24:37.272 [2024-04-27 02:44:10.846909] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.272 [2024-04-27 02:44:10.846949] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.272 [2024-04-27 02:44:10.846967] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.272 [2024-04-27 02:44:10.846984] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.272 [2024-04-27 02:44:10.846993] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.272 [2024-04-27 02:44:10.857437] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.272 qpair failed and we were unable to recover it. 00:24:37.272 [2024-04-27 02:44:10.866979] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.272 [2024-04-27 02:44:10.867038] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.272 [2024-04-27 02:44:10.867060] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.272 [2024-04-27 02:44:10.867071] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.272 [2024-04-27 02:44:10.867081] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.273 [2024-04-27 02:44:10.877326] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.273 qpair failed and we were unable to recover it. 00:24:37.273 [2024-04-27 02:44:10.887044] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.273 [2024-04-27 02:44:10.887092] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.273 [2024-04-27 02:44:10.887111] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.273 [2024-04-27 02:44:10.887121] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.273 [2024-04-27 02:44:10.887131] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.529 [2024-04-27 02:44:10.897530] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.529 qpair failed and we were unable to recover it. 00:24:37.529 [2024-04-27 02:44:10.907086] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.529 [2024-04-27 02:44:10.907144] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.529 [2024-04-27 02:44:10.907163] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.529 [2024-04-27 02:44:10.907173] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.529 [2024-04-27 02:44:10.907183] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.529 [2024-04-27 02:44:10.917530] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.529 qpair failed and we were unable to recover it. 00:24:37.529 [2024-04-27 02:44:10.927126] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.529 [2024-04-27 02:44:10.927189] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.529 [2024-04-27 02:44:10.927219] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.529 [2024-04-27 02:44:10.927228] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.529 [2024-04-27 02:44:10.927237] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.529 [2024-04-27 02:44:10.937635] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.529 qpair failed and we were unable to recover it. 00:24:37.529 [2024-04-27 02:44:10.947123] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.529 [2024-04-27 02:44:10.947168] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.529 [2024-04-27 02:44:10.947184] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.529 [2024-04-27 02:44:10.947194] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.529 [2024-04-27 02:44:10.947210] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.529 [2024-04-27 02:44:10.957716] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.529 qpair failed and we were unable to recover it. 00:24:37.529 [2024-04-27 02:44:10.967205] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.529 [2024-04-27 02:44:10.967238] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.529 [2024-04-27 02:44:10.967256] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.529 [2024-04-27 02:44:10.967265] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.529 [2024-04-27 02:44:10.967275] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.529 [2024-04-27 02:44:10.977567] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.529 qpair failed and we were unable to recover it. 00:24:37.530 [2024-04-27 02:44:10.987264] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.530 [2024-04-27 02:44:10.987303] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.530 [2024-04-27 02:44:10.987320] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.530 [2024-04-27 02:44:10.987334] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.530 [2024-04-27 02:44:10.987348] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.530 [2024-04-27 02:44:10.997669] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.530 qpair failed and we were unable to recover it. 00:24:37.530 [2024-04-27 02:44:11.007421] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.530 [2024-04-27 02:44:11.007460] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.530 [2024-04-27 02:44:11.007477] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.530 [2024-04-27 02:44:11.007496] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.530 [2024-04-27 02:44:11.007505] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.530 [2024-04-27 02:44:11.017884] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.530 qpair failed and we were unable to recover it. 00:24:37.530 [2024-04-27 02:44:11.027455] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.530 [2024-04-27 02:44:11.027500] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.530 [2024-04-27 02:44:11.027517] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.530 [2024-04-27 02:44:11.027530] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.530 [2024-04-27 02:44:11.027539] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.530 [2024-04-27 02:44:11.037740] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.530 qpair failed and we were unable to recover it. 00:24:37.530 [2024-04-27 02:44:11.047474] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.530 [2024-04-27 02:44:11.047510] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.530 [2024-04-27 02:44:11.047527] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.530 [2024-04-27 02:44:11.047544] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.530 [2024-04-27 02:44:11.047553] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.530 [2024-04-27 02:44:11.057868] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.530 qpair failed and we were unable to recover it. 00:24:37.530 [2024-04-27 02:44:11.067457] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.530 [2024-04-27 02:44:11.067494] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.530 [2024-04-27 02:44:11.067511] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.530 [2024-04-27 02:44:11.067526] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.530 [2024-04-27 02:44:11.067535] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.530 [2024-04-27 02:44:11.077945] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.530 qpair failed and we were unable to recover it. 00:24:37.530 [2024-04-27 02:44:11.087558] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.530 [2024-04-27 02:44:11.087598] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.530 [2024-04-27 02:44:11.087616] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.530 [2024-04-27 02:44:11.087634] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.530 [2024-04-27 02:44:11.087643] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.530 [2024-04-27 02:44:11.098231] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.530 qpair failed and we were unable to recover it. 00:24:37.530 [2024-04-27 02:44:11.107740] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.530 [2024-04-27 02:44:11.107786] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.530 [2024-04-27 02:44:11.107803] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.530 [2024-04-27 02:44:11.107813] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.530 [2024-04-27 02:44:11.107822] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.530 [2024-04-27 02:44:11.118163] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.530 qpair failed and we were unable to recover it. 00:24:37.530 [2024-04-27 02:44:11.127792] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.530 [2024-04-27 02:44:11.127835] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.530 [2024-04-27 02:44:11.127852] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.530 [2024-04-27 02:44:11.127864] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.530 [2024-04-27 02:44:11.127873] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.530 [2024-04-27 02:44:11.138139] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.530 qpair failed and we were unable to recover it. 00:24:37.530 [2024-04-27 02:44:11.148441] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.530 [2024-04-27 02:44:11.148482] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.530 [2024-04-27 02:44:11.148499] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.530 [2024-04-27 02:44:11.148509] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.530 [2024-04-27 02:44:11.148519] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.786 [2024-04-27 02:44:11.158333] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.786 qpair failed and we were unable to recover it. 00:24:37.786 [2024-04-27 02:44:11.167882] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.786 [2024-04-27 02:44:11.167921] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.786 [2024-04-27 02:44:11.167938] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.786 [2024-04-27 02:44:11.167956] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.786 [2024-04-27 02:44:11.167965] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.786 [2024-04-27 02:44:11.178268] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.786 qpair failed and we were unable to recover it. 00:24:37.786 [2024-04-27 02:44:11.187975] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.786 [2024-04-27 02:44:11.188023] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.786 [2024-04-27 02:44:11.188043] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.786 [2024-04-27 02:44:11.188055] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.786 [2024-04-27 02:44:11.188064] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.786 [2024-04-27 02:44:11.198352] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.786 qpair failed and we were unable to recover it. 00:24:37.786 [2024-04-27 02:44:11.208002] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.786 [2024-04-27 02:44:11.208040] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.786 [2024-04-27 02:44:11.208056] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.786 [2024-04-27 02:44:11.208074] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.786 [2024-04-27 02:44:11.208083] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.786 [2024-04-27 02:44:11.218457] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.786 qpair failed and we were unable to recover it. 00:24:37.786 [2024-04-27 02:44:11.228106] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.786 [2024-04-27 02:44:11.228147] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.786 [2024-04-27 02:44:11.228165] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.786 [2024-04-27 02:44:11.228178] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.786 [2024-04-27 02:44:11.228187] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.786 [2024-04-27 02:44:11.238364] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.786 qpair failed and we were unable to recover it. 00:24:37.786 [2024-04-27 02:44:11.248215] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.786 [2024-04-27 02:44:11.248255] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.786 [2024-04-27 02:44:11.248272] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.786 [2024-04-27 02:44:11.248282] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.786 [2024-04-27 02:44:11.248291] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.786 [2024-04-27 02:44:11.258605] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.786 qpair failed and we were unable to recover it. 00:24:37.786 [2024-04-27 02:44:11.268211] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.786 [2024-04-27 02:44:11.268260] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.786 [2024-04-27 02:44:11.268276] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.786 [2024-04-27 02:44:11.268287] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.786 [2024-04-27 02:44:11.268296] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.786 [2024-04-27 02:44:11.278559] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.786 qpair failed and we were unable to recover it. 00:24:37.786 [2024-04-27 02:44:11.288234] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.786 [2024-04-27 02:44:11.288274] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.786 [2024-04-27 02:44:11.288291] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.786 [2024-04-27 02:44:11.288305] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.786 [2024-04-27 02:44:11.288314] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.786 [2024-04-27 02:44:11.298467] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.787 qpair failed and we were unable to recover it. 00:24:37.787 [2024-04-27 02:44:11.308321] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.787 [2024-04-27 02:44:11.308365] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.787 [2024-04-27 02:44:11.308382] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.787 [2024-04-27 02:44:11.308392] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.787 [2024-04-27 02:44:11.308402] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.787 [2024-04-27 02:44:11.318610] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.787 qpair failed and we were unable to recover it. 00:24:37.787 [2024-04-27 02:44:11.328451] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.787 [2024-04-27 02:44:11.328490] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.787 [2024-04-27 02:44:11.328507] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.787 [2024-04-27 02:44:11.328517] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.787 [2024-04-27 02:44:11.328532] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.787 [2024-04-27 02:44:11.338733] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.787 qpair failed and we were unable to recover it. 00:24:37.787 [2024-04-27 02:44:11.348435] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.787 [2024-04-27 02:44:11.348495] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.787 [2024-04-27 02:44:11.348516] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.787 [2024-04-27 02:44:11.348527] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.787 [2024-04-27 02:44:11.348537] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.787 [2024-04-27 02:44:11.358993] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.787 qpair failed and we were unable to recover it. 00:24:37.787 [2024-04-27 02:44:11.368522] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.787 [2024-04-27 02:44:11.368565] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.787 [2024-04-27 02:44:11.368582] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.787 [2024-04-27 02:44:11.368597] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.787 [2024-04-27 02:44:11.368606] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.787 [2024-04-27 02:44:11.378792] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.787 qpair failed and we were unable to recover it. 00:24:37.787 [2024-04-27 02:44:11.388585] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:37.787 [2024-04-27 02:44:11.388624] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:37.787 [2024-04-27 02:44:11.388641] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:37.787 [2024-04-27 02:44:11.388655] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:37.787 [2024-04-27 02:44:11.388664] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:37.787 [2024-04-27 02:44:11.398883] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:37.787 qpair failed and we were unable to recover it. 00:24:38.043 [2024-04-27 02:44:11.408575] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.043 [2024-04-27 02:44:11.408616] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.043 [2024-04-27 02:44:11.408634] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.043 [2024-04-27 02:44:11.408643] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.043 [2024-04-27 02:44:11.408652] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.044 [2024-04-27 02:44:11.418910] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.044 qpair failed and we were unable to recover it. 00:24:38.044 [2024-04-27 02:44:11.428640] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.044 [2024-04-27 02:44:11.428686] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.044 [2024-04-27 02:44:11.428704] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.044 [2024-04-27 02:44:11.428717] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.044 [2024-04-27 02:44:11.428726] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.044 [2024-04-27 02:44:11.439062] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.044 qpair failed and we were unable to recover it. 00:24:38.044 [2024-04-27 02:44:11.448704] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.044 [2024-04-27 02:44:11.448745] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.044 [2024-04-27 02:44:11.448763] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.044 [2024-04-27 02:44:11.448780] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.044 [2024-04-27 02:44:11.448789] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.044 [2024-04-27 02:44:11.459098] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.044 qpair failed and we were unable to recover it. 00:24:38.044 [2024-04-27 02:44:11.468809] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.044 [2024-04-27 02:44:11.468851] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.044 [2024-04-27 02:44:11.468869] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.044 [2024-04-27 02:44:11.468880] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.044 [2024-04-27 02:44:11.468889] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.044 [2024-04-27 02:44:11.479102] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.044 qpair failed and we were unable to recover it. 00:24:38.044 [2024-04-27 02:44:11.488828] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.044 [2024-04-27 02:44:11.488868] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.044 [2024-04-27 02:44:11.488885] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.044 [2024-04-27 02:44:11.488902] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.044 [2024-04-27 02:44:11.488911] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.044 [2024-04-27 02:44:11.499367] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.044 qpair failed and we were unable to recover it. 00:24:38.044 [2024-04-27 02:44:11.508924] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.044 [2024-04-27 02:44:11.508963] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.044 [2024-04-27 02:44:11.508980] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.044 [2024-04-27 02:44:11.508990] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.044 [2024-04-27 02:44:11.509001] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.044 [2024-04-27 02:44:11.519209] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.044 qpair failed and we were unable to recover it. 00:24:38.044 [2024-04-27 02:44:11.529019] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.044 [2024-04-27 02:44:11.529058] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.044 [2024-04-27 02:44:11.529075] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.044 [2024-04-27 02:44:11.529093] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.044 [2024-04-27 02:44:11.529102] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.044 [2024-04-27 02:44:11.539252] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.044 qpair failed and we were unable to recover it. 00:24:38.044 [2024-04-27 02:44:11.548992] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.044 [2024-04-27 02:44:11.549030] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.044 [2024-04-27 02:44:11.549047] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.044 [2024-04-27 02:44:11.549064] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.044 [2024-04-27 02:44:11.549074] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.044 [2024-04-27 02:44:11.559417] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.044 qpair failed and we were unable to recover it. 00:24:38.044 [2024-04-27 02:44:11.569048] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.044 [2024-04-27 02:44:11.569084] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.044 [2024-04-27 02:44:11.569101] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.044 [2024-04-27 02:44:11.569111] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.044 [2024-04-27 02:44:11.569122] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.044 [2024-04-27 02:44:11.579409] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.044 qpair failed and we were unable to recover it. 00:24:38.044 [2024-04-27 02:44:11.589197] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.044 [2024-04-27 02:44:11.589243] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.044 [2024-04-27 02:44:11.589260] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.044 [2024-04-27 02:44:11.589275] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.044 [2024-04-27 02:44:11.589284] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.044 [2024-04-27 02:44:11.599473] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.044 qpair failed and we were unable to recover it. 00:24:38.044 [2024-04-27 02:44:11.609248] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.044 [2024-04-27 02:44:11.609283] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.045 [2024-04-27 02:44:11.609300] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.045 [2024-04-27 02:44:11.609309] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.045 [2024-04-27 02:44:11.609320] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.045 [2024-04-27 02:44:11.619490] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.045 qpair failed and we were unable to recover it. 00:24:38.045 [2024-04-27 02:44:11.629146] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.045 [2024-04-27 02:44:11.629186] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.045 [2024-04-27 02:44:11.629206] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.045 [2024-04-27 02:44:11.629218] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.045 [2024-04-27 02:44:11.629227] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.045 [2024-04-27 02:44:11.639509] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.045 qpair failed and we were unable to recover it. 00:24:38.045 [2024-04-27 02:44:11.649293] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.045 [2024-04-27 02:44:11.649332] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.045 [2024-04-27 02:44:11.649354] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.045 [2024-04-27 02:44:11.649369] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.045 [2024-04-27 02:44:11.649378] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.045 [2024-04-27 02:44:11.659682] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.045 qpair failed and we were unable to recover it. 00:24:38.301 [2024-04-27 02:44:11.669292] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.302 [2024-04-27 02:44:11.669331] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.302 [2024-04-27 02:44:11.669352] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.302 [2024-04-27 02:44:11.669367] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.302 [2024-04-27 02:44:11.669376] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.302 [2024-04-27 02:44:11.679754] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.302 qpair failed and we were unable to recover it. 00:24:38.302 [2024-04-27 02:44:11.689385] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.302 [2024-04-27 02:44:11.689429] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.302 [2024-04-27 02:44:11.689446] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.302 [2024-04-27 02:44:11.689464] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.302 [2024-04-27 02:44:11.689472] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.302 [2024-04-27 02:44:11.699735] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.302 qpair failed and we were unable to recover it. 00:24:38.302 [2024-04-27 02:44:11.709390] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.302 [2024-04-27 02:44:11.709426] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.302 [2024-04-27 02:44:11.709444] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.302 [2024-04-27 02:44:11.709461] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.302 [2024-04-27 02:44:11.709470] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.302 [2024-04-27 02:44:11.719908] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.302 qpair failed and we were unable to recover it. 00:24:38.302 [2024-04-27 02:44:11.729489] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.302 [2024-04-27 02:44:11.729533] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.302 [2024-04-27 02:44:11.729550] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.302 [2024-04-27 02:44:11.729560] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.302 [2024-04-27 02:44:11.729570] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.302 [2024-04-27 02:44:11.739806] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.302 qpair failed and we were unable to recover it. 00:24:38.302 [2024-04-27 02:44:11.749586] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.302 [2024-04-27 02:44:11.749632] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.302 [2024-04-27 02:44:11.749649] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.302 [2024-04-27 02:44:11.749666] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.302 [2024-04-27 02:44:11.749675] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.302 [2024-04-27 02:44:11.759963] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.302 qpair failed and we were unable to recover it. 00:24:38.302 [2024-04-27 02:44:11.769632] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.302 [2024-04-27 02:44:11.769671] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.302 [2024-04-27 02:44:11.769688] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.302 [2024-04-27 02:44:11.769706] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.302 [2024-04-27 02:44:11.769715] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.302 [2024-04-27 02:44:11.779960] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.302 qpair failed and we were unable to recover it. 00:24:38.302 [2024-04-27 02:44:11.789702] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.302 [2024-04-27 02:44:11.789740] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.302 [2024-04-27 02:44:11.789757] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.302 [2024-04-27 02:44:11.789775] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.302 [2024-04-27 02:44:11.789784] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.302 [2024-04-27 02:44:11.799962] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.302 qpair failed and we were unable to recover it. 00:24:38.302 [2024-04-27 02:44:11.809870] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.302 [2024-04-27 02:44:11.809916] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.302 [2024-04-27 02:44:11.809933] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.302 [2024-04-27 02:44:11.809943] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.302 [2024-04-27 02:44:11.809952] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.302 [2024-04-27 02:44:11.820142] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.302 qpair failed and we were unable to recover it. 00:24:38.302 [2024-04-27 02:44:11.829852] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.302 [2024-04-27 02:44:11.829895] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.302 [2024-04-27 02:44:11.829912] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.302 [2024-04-27 02:44:11.829922] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.302 [2024-04-27 02:44:11.829931] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.302 [2024-04-27 02:44:11.840280] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.302 qpair failed and we were unable to recover it. 00:24:38.302 [2024-04-27 02:44:11.849809] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.302 [2024-04-27 02:44:11.849847] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.302 [2024-04-27 02:44:11.849865] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.302 [2024-04-27 02:44:11.849874] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.302 [2024-04-27 02:44:11.849885] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.302 [2024-04-27 02:44:11.860252] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.302 qpair failed and we were unable to recover it. 00:24:38.302 [2024-04-27 02:44:11.869884] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.302 [2024-04-27 02:44:11.869922] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.302 [2024-04-27 02:44:11.869939] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.302 [2024-04-27 02:44:11.869957] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.302 [2024-04-27 02:44:11.869966] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.302 [2024-04-27 02:44:11.880158] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.302 qpair failed and we were unable to recover it. 00:24:38.302 [2024-04-27 02:44:11.890020] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.302 [2024-04-27 02:44:11.890058] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.302 [2024-04-27 02:44:11.890076] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.302 [2024-04-27 02:44:11.890097] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.302 [2024-04-27 02:44:11.890107] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.302 [2024-04-27 02:44:11.900325] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.302 qpair failed and we were unable to recover it. 00:24:38.302 [2024-04-27 02:44:11.910004] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.302 [2024-04-27 02:44:11.910048] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.302 [2024-04-27 02:44:11.910065] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.302 [2024-04-27 02:44:11.910075] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.302 [2024-04-27 02:44:11.910084] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.302 [2024-04-27 02:44:11.920471] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.302 qpair failed and we were unable to recover it. 00:24:38.560 [2024-04-27 02:44:11.930087] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.560 [2024-04-27 02:44:11.930134] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.560 [2024-04-27 02:44:11.930151] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.560 [2024-04-27 02:44:11.930167] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.560 [2024-04-27 02:44:11.930176] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.560 [2024-04-27 02:44:11.940577] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.560 qpair failed and we were unable to recover it. 00:24:38.560 [2024-04-27 02:44:11.950122] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.560 [2024-04-27 02:44:11.950160] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.560 [2024-04-27 02:44:11.950177] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.560 [2024-04-27 02:44:11.950186] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.560 [2024-04-27 02:44:11.950197] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.560 [2024-04-27 02:44:11.960529] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.560 qpair failed and we were unable to recover it. 00:24:38.560 [2024-04-27 02:44:11.970284] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.560 [2024-04-27 02:44:11.970326] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.560 [2024-04-27 02:44:11.970348] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.560 [2024-04-27 02:44:11.970359] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.560 [2024-04-27 02:44:11.970368] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.560 [2024-04-27 02:44:11.980613] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.560 qpair failed and we were unable to recover it. 00:24:38.560 [2024-04-27 02:44:11.990270] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.560 [2024-04-27 02:44:11.990307] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.560 [2024-04-27 02:44:11.990323] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.560 [2024-04-27 02:44:11.990333] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.560 [2024-04-27 02:44:11.990354] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.560 [2024-04-27 02:44:12.000616] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.560 qpair failed and we were unable to recover it. 00:24:38.560 [2024-04-27 02:44:12.010367] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.560 [2024-04-27 02:44:12.010405] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.560 [2024-04-27 02:44:12.010423] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.560 [2024-04-27 02:44:12.010440] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.560 [2024-04-27 02:44:12.010449] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.560 [2024-04-27 02:44:12.020707] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.560 qpair failed and we were unable to recover it. 00:24:38.560 [2024-04-27 02:44:12.030467] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.560 [2024-04-27 02:44:12.030500] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.560 [2024-04-27 02:44:12.030517] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.560 [2024-04-27 02:44:12.030527] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.560 [2024-04-27 02:44:12.030538] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.560 [2024-04-27 02:44:12.040929] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.560 qpair failed and we were unable to recover it. 00:24:38.560 [2024-04-27 02:44:12.050488] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.560 [2024-04-27 02:44:12.050527] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.560 [2024-04-27 02:44:12.050544] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.560 [2024-04-27 02:44:12.050554] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.560 [2024-04-27 02:44:12.050564] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.560 [2024-04-27 02:44:12.060906] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.560 qpair failed and we were unable to recover it. 00:24:38.560 [2024-04-27 02:44:12.070620] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.560 [2024-04-27 02:44:12.070658] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.560 [2024-04-27 02:44:12.070678] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.560 [2024-04-27 02:44:12.070695] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.560 [2024-04-27 02:44:12.070704] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.560 [2024-04-27 02:44:12.080994] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.560 qpair failed and we were unable to recover it. 00:24:38.560 [2024-04-27 02:44:12.090593] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.560 [2024-04-27 02:44:12.090628] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.560 [2024-04-27 02:44:12.090645] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.560 [2024-04-27 02:44:12.090655] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.560 [2024-04-27 02:44:12.090664] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.560 [2024-04-27 02:44:12.100895] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.560 qpair failed and we were unable to recover it. 00:24:38.560 [2024-04-27 02:44:12.110729] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.560 [2024-04-27 02:44:12.110765] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.560 [2024-04-27 02:44:12.110782] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.560 [2024-04-27 02:44:12.110799] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.560 [2024-04-27 02:44:12.110808] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.560 [2024-04-27 02:44:12.121152] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.560 qpair failed and we were unable to recover it. 00:24:38.560 [2024-04-27 02:44:12.130765] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.560 [2024-04-27 02:44:12.130806] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.560 [2024-04-27 02:44:12.130823] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.560 [2024-04-27 02:44:12.130840] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.560 [2024-04-27 02:44:12.130848] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.560 [2024-04-27 02:44:12.141163] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.560 qpair failed and we were unable to recover it. 00:24:38.560 [2024-04-27 02:44:12.150836] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.560 [2024-04-27 02:44:12.150874] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.560 [2024-04-27 02:44:12.150892] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.560 [2024-04-27 02:44:12.150902] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.560 [2024-04-27 02:44:12.150911] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.560 [2024-04-27 02:44:12.161227] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.560 qpair failed and we were unable to recover it. 00:24:38.560 [2024-04-27 02:44:12.170878] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.560 [2024-04-27 02:44:12.170922] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.560 [2024-04-27 02:44:12.170938] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.560 [2024-04-27 02:44:12.170948] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.560 [2024-04-27 02:44:12.170957] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.817 [2024-04-27 02:44:12.181242] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.818 qpair failed and we were unable to recover it. 00:24:38.818 [2024-04-27 02:44:12.190915] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.818 [2024-04-27 02:44:12.190962] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.818 [2024-04-27 02:44:12.190980] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.818 [2024-04-27 02:44:12.190993] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.818 [2024-04-27 02:44:12.191002] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.818 [2024-04-27 02:44:12.201260] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.818 qpair failed and we were unable to recover it. 00:24:38.818 [2024-04-27 02:44:12.210968] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.818 [2024-04-27 02:44:12.211011] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.818 [2024-04-27 02:44:12.211027] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.818 [2024-04-27 02:44:12.211037] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.818 [2024-04-27 02:44:12.211047] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.818 [2024-04-27 02:44:12.221410] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.818 qpair failed and we were unable to recover it. 00:24:38.818 [2024-04-27 02:44:12.231013] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.818 [2024-04-27 02:44:12.231059] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.818 [2024-04-27 02:44:12.231076] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.818 [2024-04-27 02:44:12.231088] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.818 [2024-04-27 02:44:12.231096] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.818 [2024-04-27 02:44:12.241387] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.818 qpair failed and we were unable to recover it. 00:24:38.818 [2024-04-27 02:44:12.251065] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.818 [2024-04-27 02:44:12.251104] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.818 [2024-04-27 02:44:12.251121] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.818 [2024-04-27 02:44:12.251131] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.818 [2024-04-27 02:44:12.251141] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.818 [2024-04-27 02:44:12.261407] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.818 qpair failed and we were unable to recover it. 00:24:38.818 [2024-04-27 02:44:12.271172] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.818 [2024-04-27 02:44:12.271216] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.818 [2024-04-27 02:44:12.271233] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.818 [2024-04-27 02:44:12.271243] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.818 [2024-04-27 02:44:12.271252] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.818 [2024-04-27 02:44:12.281627] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.818 qpair failed and we were unable to recover it. 00:24:38.818 [2024-04-27 02:44:12.291252] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.818 [2024-04-27 02:44:12.291294] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.818 [2024-04-27 02:44:12.291311] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.818 [2024-04-27 02:44:12.291329] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.818 [2024-04-27 02:44:12.291350] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.818 [2024-04-27 02:44:12.301654] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.818 qpair failed and we were unable to recover it. 00:24:38.818 [2024-04-27 02:44:12.311252] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.818 [2024-04-27 02:44:12.311294] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.818 [2024-04-27 02:44:12.311311] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.818 [2024-04-27 02:44:12.311321] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.818 [2024-04-27 02:44:12.311332] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.818 [2024-04-27 02:44:12.321862] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.818 qpair failed and we were unable to recover it. 00:24:38.818 [2024-04-27 02:44:12.331344] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.818 [2024-04-27 02:44:12.331384] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.818 [2024-04-27 02:44:12.331401] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.818 [2024-04-27 02:44:12.331417] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.818 [2024-04-27 02:44:12.331426] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.818 [2024-04-27 02:44:12.341622] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.818 qpair failed and we were unable to recover it. 00:24:38.818 [2024-04-27 02:44:12.351373] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.818 [2024-04-27 02:44:12.351408] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.818 [2024-04-27 02:44:12.351425] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.818 [2024-04-27 02:44:12.351435] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.818 [2024-04-27 02:44:12.351444] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.818 [2024-04-27 02:44:12.361842] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.818 qpair failed and we were unable to recover it. 00:24:38.818 [2024-04-27 02:44:12.371419] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.818 [2024-04-27 02:44:12.371459] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.819 [2024-04-27 02:44:12.371478] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.819 [2024-04-27 02:44:12.371496] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.819 [2024-04-27 02:44:12.371505] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.819 [2024-04-27 02:44:12.381868] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.819 qpair failed and we were unable to recover it. 00:24:38.819 [2024-04-27 02:44:12.391529] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.819 [2024-04-27 02:44:12.391576] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.819 [2024-04-27 02:44:12.391593] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.819 [2024-04-27 02:44:12.391603] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.819 [2024-04-27 02:44:12.391612] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.819 [2024-04-27 02:44:12.401865] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.819 qpair failed and we were unable to recover it. 00:24:38.819 [2024-04-27 02:44:12.411561] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.819 [2024-04-27 02:44:12.411597] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.819 [2024-04-27 02:44:12.411614] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.819 [2024-04-27 02:44:12.411631] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.819 [2024-04-27 02:44:12.411640] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:38.819 [2024-04-27 02:44:12.421943] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:38.819 qpair failed and we were unable to recover it. 00:24:38.819 [2024-04-27 02:44:12.431664] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:38.819 [2024-04-27 02:44:12.431706] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:38.819 [2024-04-27 02:44:12.431722] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:38.819 [2024-04-27 02:44:12.431732] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:38.819 [2024-04-27 02:44:12.431741] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.077 [2024-04-27 02:44:12.441968] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.077 qpair failed and we were unable to recover it. 00:24:39.077 [2024-04-27 02:44:12.451708] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.077 [2024-04-27 02:44:12.451748] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.077 [2024-04-27 02:44:12.451766] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.077 [2024-04-27 02:44:12.451775] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.077 [2024-04-27 02:44:12.451784] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.077 [2024-04-27 02:44:12.462021] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.077 qpair failed and we were unable to recover it. 00:24:39.077 [2024-04-27 02:44:12.471789] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.077 [2024-04-27 02:44:12.471831] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.077 [2024-04-27 02:44:12.471849] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.077 [2024-04-27 02:44:12.471865] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.077 [2024-04-27 02:44:12.471874] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.077 [2024-04-27 02:44:12.482136] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.077 qpair failed and we were unable to recover it. 00:24:39.077 [2024-04-27 02:44:12.491860] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.077 [2024-04-27 02:44:12.491898] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.077 [2024-04-27 02:44:12.491915] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.077 [2024-04-27 02:44:12.491931] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.077 [2024-04-27 02:44:12.491940] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.077 [2024-04-27 02:44:12.502300] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.077 qpair failed and we were unable to recover it. 00:24:39.077 [2024-04-27 02:44:12.511866] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.077 [2024-04-27 02:44:12.511909] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.077 [2024-04-27 02:44:12.511936] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.077 [2024-04-27 02:44:12.511946] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.077 [2024-04-27 02:44:12.511954] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.077 [2024-04-27 02:44:12.522213] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.077 qpair failed and we were unable to recover it. 00:24:39.077 [2024-04-27 02:44:12.532001] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.077 [2024-04-27 02:44:12.532040] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.077 [2024-04-27 02:44:12.532057] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.077 [2024-04-27 02:44:12.532066] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.077 [2024-04-27 02:44:12.532075] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.077 [2024-04-27 02:44:12.542290] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.077 qpair failed and we were unable to recover it. 00:24:39.077 [2024-04-27 02:44:12.552036] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.077 [2024-04-27 02:44:12.552082] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.077 [2024-04-27 02:44:12.552099] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.077 [2024-04-27 02:44:12.552111] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.077 [2024-04-27 02:44:12.552120] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.077 [2024-04-27 02:44:12.562383] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.077 qpair failed and we were unable to recover it. 00:24:39.077 [2024-04-27 02:44:12.572068] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.077 [2024-04-27 02:44:12.572107] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.077 [2024-04-27 02:44:12.572123] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.077 [2024-04-27 02:44:12.572140] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.077 [2024-04-27 02:44:12.572149] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.077 [2024-04-27 02:44:12.582364] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.077 qpair failed and we were unable to recover it. 00:24:39.077 [2024-04-27 02:44:12.592095] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.077 [2024-04-27 02:44:12.592129] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.077 [2024-04-27 02:44:12.592147] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.077 [2024-04-27 02:44:12.592157] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.077 [2024-04-27 02:44:12.592166] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.077 [2024-04-27 02:44:12.602590] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.077 qpair failed and we were unable to recover it. 00:24:39.077 [2024-04-27 02:44:12.612158] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.077 [2024-04-27 02:44:12.612200] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.077 [2024-04-27 02:44:12.612219] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.077 [2024-04-27 02:44:12.612234] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.077 [2024-04-27 02:44:12.612242] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.077 [2024-04-27 02:44:12.622596] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.077 qpair failed and we were unable to recover it. 00:24:39.077 [2024-04-27 02:44:12.632170] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.077 [2024-04-27 02:44:12.632208] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.077 [2024-04-27 02:44:12.632226] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.077 [2024-04-27 02:44:12.632235] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.077 [2024-04-27 02:44:12.632244] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.077 [2024-04-27 02:44:12.642607] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.077 qpair failed and we were unable to recover it. 00:24:39.077 [2024-04-27 02:44:12.652286] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.077 [2024-04-27 02:44:12.652322] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.077 [2024-04-27 02:44:12.652358] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.077 [2024-04-27 02:44:12.652368] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.077 [2024-04-27 02:44:12.652377] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.077 [2024-04-27 02:44:12.662666] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.077 qpair failed and we were unable to recover it. 00:24:39.077 [2024-04-27 02:44:12.672377] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.077 [2024-04-27 02:44:12.672415] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.077 [2024-04-27 02:44:12.672432] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.077 [2024-04-27 02:44:12.672448] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.077 [2024-04-27 02:44:12.672458] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.077 [2024-04-27 02:44:12.682743] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.077 qpair failed and we were unable to recover it. 00:24:39.077 [2024-04-27 02:44:12.692391] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.078 [2024-04-27 02:44:12.692455] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.078 [2024-04-27 02:44:12.692479] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.078 [2024-04-27 02:44:12.692490] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.078 [2024-04-27 02:44:12.692500] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.335 [2024-04-27 02:44:12.702743] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.335 qpair failed and we were unable to recover it. 00:24:39.335 [2024-04-27 02:44:12.712448] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.335 [2024-04-27 02:44:12.712495] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.335 [2024-04-27 02:44:12.712513] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.335 [2024-04-27 02:44:12.712529] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.335 [2024-04-27 02:44:12.712538] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.335 [2024-04-27 02:44:12.723045] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.335 qpair failed and we were unable to recover it. 00:24:39.335 [2024-04-27 02:44:12.732545] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.335 [2024-04-27 02:44:12.732581] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.335 [2024-04-27 02:44:12.732598] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.335 [2024-04-27 02:44:12.732616] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.335 [2024-04-27 02:44:12.732625] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.335 [2024-04-27 02:44:12.742874] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.335 qpair failed and we were unable to recover it. 00:24:39.335 [2024-04-27 02:44:12.752630] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.335 [2024-04-27 02:44:12.752665] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.335 [2024-04-27 02:44:12.752682] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.335 [2024-04-27 02:44:12.752692] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.335 [2024-04-27 02:44:12.752701] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.335 [2024-04-27 02:44:12.763030] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.335 qpair failed and we were unable to recover it. 00:24:39.335 [2024-04-27 02:44:12.772616] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.335 [2024-04-27 02:44:12.772655] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.335 [2024-04-27 02:44:12.772672] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.335 [2024-04-27 02:44:12.772692] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.335 [2024-04-27 02:44:12.772701] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.335 [2024-04-27 02:44:12.783001] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.335 qpair failed and we were unable to recover it. 00:24:39.335 [2024-04-27 02:44:12.792733] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.335 [2024-04-27 02:44:12.792774] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.335 [2024-04-27 02:44:12.792792] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.335 [2024-04-27 02:44:12.792808] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.335 [2024-04-27 02:44:12.792817] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.335 [2024-04-27 02:44:12.803045] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.335 qpair failed and we were unable to recover it. 00:24:39.335 [2024-04-27 02:44:12.812833] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.335 [2024-04-27 02:44:12.812870] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.335 [2024-04-27 02:44:12.812887] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.335 [2024-04-27 02:44:12.812904] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.335 [2024-04-27 02:44:12.812913] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.335 [2024-04-27 02:44:12.823057] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.335 qpair failed and we were unable to recover it. 00:24:39.335 [2024-04-27 02:44:12.832769] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.335 [2024-04-27 02:44:12.832803] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.335 [2024-04-27 02:44:12.832820] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.335 [2024-04-27 02:44:12.832829] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.335 [2024-04-27 02:44:12.832839] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.335 [2024-04-27 02:44:12.843188] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.335 qpair failed and we were unable to recover it. 00:24:39.335 [2024-04-27 02:44:12.852909] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.335 [2024-04-27 02:44:12.852951] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.335 [2024-04-27 02:44:12.852968] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.335 [2024-04-27 02:44:12.852984] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.335 [2024-04-27 02:44:12.852993] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.335 [2024-04-27 02:44:12.863350] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.335 qpair failed and we were unable to recover it. 00:24:39.335 [2024-04-27 02:44:12.872955] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.335 [2024-04-27 02:44:12.873001] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.335 [2024-04-27 02:44:12.873018] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.336 [2024-04-27 02:44:12.873030] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.336 [2024-04-27 02:44:12.873039] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.336 [2024-04-27 02:44:12.883245] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.336 qpair failed and we were unable to recover it. 00:24:39.336 [2024-04-27 02:44:12.892968] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.336 [2024-04-27 02:44:12.893008] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.336 [2024-04-27 02:44:12.893026] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.336 [2024-04-27 02:44:12.893038] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.336 [2024-04-27 02:44:12.893047] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.336 [2024-04-27 02:44:12.903357] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.336 qpair failed and we were unable to recover it. 00:24:39.336 [2024-04-27 02:44:12.913114] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.336 [2024-04-27 02:44:12.913148] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.336 [2024-04-27 02:44:12.913166] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.336 [2024-04-27 02:44:12.913175] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.336 [2024-04-27 02:44:12.913185] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.336 [2024-04-27 02:44:12.923343] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.336 qpair failed and we were unable to recover it. 00:24:39.336 [2024-04-27 02:44:12.933227] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.336 [2024-04-27 02:44:12.933274] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.336 [2024-04-27 02:44:12.933291] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.336 [2024-04-27 02:44:12.933309] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.336 [2024-04-27 02:44:12.933317] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.336 [2024-04-27 02:44:12.943490] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.336 qpair failed and we were unable to recover it. 00:24:39.336 [2024-04-27 02:44:12.953272] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.336 [2024-04-27 02:44:12.953316] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.336 [2024-04-27 02:44:12.953340] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.336 [2024-04-27 02:44:12.953351] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.336 [2024-04-27 02:44:12.953377] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.593 [2024-04-27 02:44:12.963665] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.593 qpair failed and we were unable to recover it. 00:24:39.593 [2024-04-27 02:44:12.973273] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.593 [2024-04-27 02:44:12.973315] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.593 [2024-04-27 02:44:12.973333] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.593 [2024-04-27 02:44:12.973356] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.593 [2024-04-27 02:44:12.973365] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.593 [2024-04-27 02:44:12.983569] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.593 qpair failed and we were unable to recover it. 00:24:39.593 [2024-04-27 02:44:12.993359] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.593 [2024-04-27 02:44:12.993397] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.593 [2024-04-27 02:44:12.993415] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.593 [2024-04-27 02:44:12.993430] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.593 [2024-04-27 02:44:12.993439] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.593 [2024-04-27 02:44:13.003622] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.593 qpair failed and we were unable to recover it. 00:24:39.593 [2024-04-27 02:44:13.013481] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.593 [2024-04-27 02:44:13.013520] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.593 [2024-04-27 02:44:13.013537] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.593 [2024-04-27 02:44:13.013547] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.593 [2024-04-27 02:44:13.013556] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.593 [2024-04-27 02:44:13.023740] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.593 qpair failed and we were unable to recover it. 00:24:39.593 [2024-04-27 02:44:13.033497] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.593 [2024-04-27 02:44:13.033544] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.593 [2024-04-27 02:44:13.033562] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.593 [2024-04-27 02:44:13.033573] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.593 [2024-04-27 02:44:13.033582] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.593 [2024-04-27 02:44:13.043772] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.593 qpair failed and we were unable to recover it. 00:24:39.593 [2024-04-27 02:44:13.053560] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.593 [2024-04-27 02:44:13.053597] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.593 [2024-04-27 02:44:13.053614] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.593 [2024-04-27 02:44:13.053624] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.593 [2024-04-27 02:44:13.053633] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.593 [2024-04-27 02:44:13.063843] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.593 qpair failed and we were unable to recover it. 00:24:39.593 [2024-04-27 02:44:13.073604] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.593 [2024-04-27 02:44:13.073643] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.593 [2024-04-27 02:44:13.073660] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.593 [2024-04-27 02:44:13.073674] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.593 [2024-04-27 02:44:13.073684] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.593 [2024-04-27 02:44:13.083833] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.593 qpair failed and we were unable to recover it. 00:24:39.593 [2024-04-27 02:44:13.093595] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.593 [2024-04-27 02:44:13.093635] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.593 [2024-04-27 02:44:13.093653] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.593 [2024-04-27 02:44:13.093663] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.593 [2024-04-27 02:44:13.093672] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.593 [2024-04-27 02:44:13.103952] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.593 qpair failed and we were unable to recover it. 00:24:39.593 [2024-04-27 02:44:13.113681] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.593 [2024-04-27 02:44:13.113735] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.593 [2024-04-27 02:44:13.113760] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.593 [2024-04-27 02:44:13.113771] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.593 [2024-04-27 02:44:13.113781] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.593 [2024-04-27 02:44:13.123979] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.593 qpair failed and we were unable to recover it. 00:24:39.593 [2024-04-27 02:44:13.133767] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.593 [2024-04-27 02:44:13.133810] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.593 [2024-04-27 02:44:13.133827] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.593 [2024-04-27 02:44:13.133837] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.593 [2024-04-27 02:44:13.133846] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.593 [2024-04-27 02:44:13.144085] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.593 qpair failed and we were unable to recover it. 00:24:39.593 [2024-04-27 02:44:13.153774] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.593 [2024-04-27 02:44:13.153813] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.593 [2024-04-27 02:44:13.153830] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.593 [2024-04-27 02:44:13.153840] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.593 [2024-04-27 02:44:13.153849] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.593 [2024-04-27 02:44:13.164159] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.593 qpair failed and we were unable to recover it. 00:24:39.593 [2024-04-27 02:44:13.173925] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.593 [2024-04-27 02:44:13.173966] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.593 [2024-04-27 02:44:13.173982] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.593 [2024-04-27 02:44:13.173999] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.593 [2024-04-27 02:44:13.174008] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.594 [2024-04-27 02:44:13.184251] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.594 qpair failed and we were unable to recover it. 00:24:39.594 [2024-04-27 02:44:13.193965] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.594 [2024-04-27 02:44:13.194007] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.594 [2024-04-27 02:44:13.194025] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.594 [2024-04-27 02:44:13.194043] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.594 [2024-04-27 02:44:13.194052] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.594 [2024-04-27 02:44:13.204093] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.594 qpair failed and we were unable to recover it. 00:24:39.850 [2024-04-27 02:44:13.214005] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.850 [2024-04-27 02:44:13.214047] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.850 [2024-04-27 02:44:13.214063] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.850 [2024-04-27 02:44:13.214077] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.850 [2024-04-27 02:44:13.214086] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.850 [2024-04-27 02:44:13.224288] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.850 qpair failed and we were unable to recover it. 00:24:39.850 [2024-04-27 02:44:13.234077] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.850 [2024-04-27 02:44:13.234117] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.850 [2024-04-27 02:44:13.234133] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.850 [2024-04-27 02:44:13.234148] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.850 [2024-04-27 02:44:13.234157] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.850 [2024-04-27 02:44:13.244408] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.850 qpair failed and we were unable to recover it. 00:24:39.850 [2024-04-27 02:44:13.254002] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.850 [2024-04-27 02:44:13.254040] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.850 [2024-04-27 02:44:13.254057] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.850 [2024-04-27 02:44:13.254067] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.850 [2024-04-27 02:44:13.254077] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.850 [2024-04-27 02:44:13.264333] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.850 qpair failed and we were unable to recover it. 00:24:39.850 [2024-04-27 02:44:13.274278] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.850 [2024-04-27 02:44:13.274320] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.850 [2024-04-27 02:44:13.274342] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.850 [2024-04-27 02:44:13.274356] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.850 [2024-04-27 02:44:13.274365] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.850 [2024-04-27 02:44:13.284627] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.850 qpair failed and we were unable to recover it. 00:24:39.850 [2024-04-27 02:44:13.294164] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.850 [2024-04-27 02:44:13.294205] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.851 [2024-04-27 02:44:13.294223] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.851 [2024-04-27 02:44:13.294235] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.851 [2024-04-27 02:44:13.294244] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.851 [2024-04-27 02:44:13.304608] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.851 qpair failed and we were unable to recover it. 00:24:39.851 [2024-04-27 02:44:13.314218] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.851 [2024-04-27 02:44:13.314261] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.851 [2024-04-27 02:44:13.314278] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.851 [2024-04-27 02:44:13.314289] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.851 [2024-04-27 02:44:13.314297] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.851 [2024-04-27 02:44:13.324671] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.851 qpair failed and we were unable to recover it. 00:24:39.851 [2024-04-27 02:44:13.334217] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.851 [2024-04-27 02:44:13.334256] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.851 [2024-04-27 02:44:13.334273] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.851 [2024-04-27 02:44:13.334291] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.851 [2024-04-27 02:44:13.334300] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.851 [2024-04-27 02:44:13.344419] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.851 qpair failed and we were unable to recover it. 00:24:39.851 [2024-04-27 02:44:13.354423] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.851 [2024-04-27 02:44:13.354468] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.851 [2024-04-27 02:44:13.354485] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.851 [2024-04-27 02:44:13.354501] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.851 [2024-04-27 02:44:13.354509] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.851 [2024-04-27 02:44:13.364638] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.851 qpair failed and we were unable to recover it. 00:24:39.851 [2024-04-27 02:44:13.374373] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.851 [2024-04-27 02:44:13.374413] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.851 [2024-04-27 02:44:13.374430] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.851 [2024-04-27 02:44:13.374444] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.851 [2024-04-27 02:44:13.374452] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.851 [2024-04-27 02:44:13.384636] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.851 qpair failed and we were unable to recover it. 00:24:39.851 [2024-04-27 02:44:13.394450] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.851 [2024-04-27 02:44:13.394484] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.851 [2024-04-27 02:44:13.394505] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.851 [2024-04-27 02:44:13.394520] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.851 [2024-04-27 02:44:13.394528] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.851 [2024-04-27 02:44:13.404798] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.851 qpair failed and we were unable to recover it. 00:24:39.851 [2024-04-27 02:44:13.414524] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.851 [2024-04-27 02:44:13.414564] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.851 [2024-04-27 02:44:13.414580] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.851 [2024-04-27 02:44:13.414598] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.851 [2024-04-27 02:44:13.414607] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.851 [2024-04-27 02:44:13.424921] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.851 qpair failed and we were unable to recover it. 00:24:39.851 [2024-04-27 02:44:13.434612] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.851 [2024-04-27 02:44:13.434677] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.851 [2024-04-27 02:44:13.434696] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.851 [2024-04-27 02:44:13.434706] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.851 [2024-04-27 02:44:13.434716] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.851 [2024-04-27 02:44:13.444923] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.851 qpair failed and we were unable to recover it. 00:24:39.851 [2024-04-27 02:44:13.454733] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:39.851 [2024-04-27 02:44:13.454772] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:39.851 [2024-04-27 02:44:13.454789] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:39.851 [2024-04-27 02:44:13.454798] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:39.851 [2024-04-27 02:44:13.454807] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:39.851 [2024-04-27 02:44:13.465047] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:39.851 qpair failed and we were unable to recover it. 00:24:40.108 [2024-04-27 02:44:13.474660] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.108 [2024-04-27 02:44:13.474702] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.108 [2024-04-27 02:44:13.474719] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.108 [2024-04-27 02:44:13.474729] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.108 [2024-04-27 02:44:13.474741] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.108 [2024-04-27 02:44:13.484907] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.108 qpair failed and we were unable to recover it. 00:24:40.108 [2024-04-27 02:44:13.494785] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.109 [2024-04-27 02:44:13.494827] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.109 [2024-04-27 02:44:13.494845] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.109 [2024-04-27 02:44:13.494854] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.109 [2024-04-27 02:44:13.494866] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.109 [2024-04-27 02:44:13.505057] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.109 qpair failed and we were unable to recover it. 00:24:40.109 [2024-04-27 02:44:13.514842] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.109 [2024-04-27 02:44:13.514885] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.109 [2024-04-27 02:44:13.514902] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.109 [2024-04-27 02:44:13.514920] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.109 [2024-04-27 02:44:13.514929] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.109 [2024-04-27 02:44:13.525282] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.109 qpair failed and we were unable to recover it. 00:24:40.109 [2024-04-27 02:44:13.534842] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.109 [2024-04-27 02:44:13.534880] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.109 [2024-04-27 02:44:13.534898] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.109 [2024-04-27 02:44:13.534913] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.109 [2024-04-27 02:44:13.534922] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.109 [2024-04-27 02:44:13.545291] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.109 qpair failed and we were unable to recover it. 00:24:40.109 [2024-04-27 02:44:13.555035] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.109 [2024-04-27 02:44:13.555070] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.109 [2024-04-27 02:44:13.555087] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.109 [2024-04-27 02:44:13.555097] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.109 [2024-04-27 02:44:13.555108] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.109 [2024-04-27 02:44:13.565359] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.109 qpair failed and we were unable to recover it. 00:24:40.109 [2024-04-27 02:44:13.575016] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.109 [2024-04-27 02:44:13.575062] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.109 [2024-04-27 02:44:13.575079] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.109 [2024-04-27 02:44:13.575096] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.109 [2024-04-27 02:44:13.575105] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.109 [2024-04-27 02:44:13.585389] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.109 qpair failed and we were unable to recover it. 00:24:40.109 [2024-04-27 02:44:13.595041] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.109 [2024-04-27 02:44:13.595080] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.109 [2024-04-27 02:44:13.595098] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.109 [2024-04-27 02:44:13.595108] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.109 [2024-04-27 02:44:13.595120] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.109 [2024-04-27 02:44:13.605389] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.109 qpair failed and we were unable to recover it. 00:24:40.109 [2024-04-27 02:44:13.615199] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.109 [2024-04-27 02:44:13.615237] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.109 [2024-04-27 02:44:13.615256] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.109 [2024-04-27 02:44:13.615274] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.109 [2024-04-27 02:44:13.615282] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.109 [2024-04-27 02:44:13.625480] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.109 qpair failed and we were unable to recover it. 00:24:40.109 [2024-04-27 02:44:13.635153] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.109 [2024-04-27 02:44:13.635188] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.109 [2024-04-27 02:44:13.635206] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.109 [2024-04-27 02:44:13.635215] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.109 [2024-04-27 02:44:13.635227] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.109 [2024-04-27 02:44:13.645640] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.109 qpair failed and we were unable to recover it. 00:24:40.109 [2024-04-27 02:44:13.655233] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.109 [2024-04-27 02:44:13.655276] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.109 [2024-04-27 02:44:13.655293] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.109 [2024-04-27 02:44:13.655311] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.109 [2024-04-27 02:44:13.655319] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.109 [2024-04-27 02:44:13.665650] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.109 qpair failed and we were unable to recover it. 00:24:40.109 [2024-04-27 02:44:13.675351] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.109 [2024-04-27 02:44:13.675394] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.109 [2024-04-27 02:44:13.675412] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.109 [2024-04-27 02:44:13.675421] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.109 [2024-04-27 02:44:13.675432] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.109 [2024-04-27 02:44:13.685709] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.109 qpair failed and we were unable to recover it. 00:24:40.109 [2024-04-27 02:44:13.695421] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.109 [2024-04-27 02:44:13.695467] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.109 [2024-04-27 02:44:13.695502] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.109 [2024-04-27 02:44:13.695517] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.109 [2024-04-27 02:44:13.695527] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.109 [2024-04-27 02:44:13.705702] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.109 qpair failed and we were unable to recover it. 00:24:40.109 [2024-04-27 02:44:13.715476] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.109 [2024-04-27 02:44:13.715520] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.109 [2024-04-27 02:44:13.715538] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.109 [2024-04-27 02:44:13.715550] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.109 [2024-04-27 02:44:13.715559] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.109 [2024-04-27 02:44:13.726028] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.109 qpair failed and we were unable to recover it. 00:24:40.366 [2024-04-27 02:44:13.735566] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.366 [2024-04-27 02:44:13.735612] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.366 [2024-04-27 02:44:13.735630] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.366 [2024-04-27 02:44:13.735646] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.366 [2024-04-27 02:44:13.735655] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.367 [2024-04-27 02:44:13.745941] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.367 qpair failed and we were unable to recover it. 00:24:40.367 [2024-04-27 02:44:13.755581] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.367 [2024-04-27 02:44:13.755624] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.367 [2024-04-27 02:44:13.755641] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.367 [2024-04-27 02:44:13.755651] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.367 [2024-04-27 02:44:13.755660] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.367 [2024-04-27 02:44:13.766018] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.367 qpair failed and we were unable to recover it. 00:24:40.367 [2024-04-27 02:44:13.775651] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.367 [2024-04-27 02:44:13.775695] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.367 [2024-04-27 02:44:13.775712] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.367 [2024-04-27 02:44:13.775727] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.367 [2024-04-27 02:44:13.775736] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.367 [2024-04-27 02:44:13.785964] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.367 qpair failed and we were unable to recover it. 00:24:40.367 [2024-04-27 02:44:13.795657] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.367 [2024-04-27 02:44:13.795700] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.367 [2024-04-27 02:44:13.795719] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.367 [2024-04-27 02:44:13.795729] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.367 [2024-04-27 02:44:13.795738] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.367 [2024-04-27 02:44:13.806050] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.367 qpair failed and we were unable to recover it. 00:24:40.367 [2024-04-27 02:44:13.815695] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.367 [2024-04-27 02:44:13.815736] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.367 [2024-04-27 02:44:13.815753] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.367 [2024-04-27 02:44:13.815762] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.367 [2024-04-27 02:44:13.815773] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.367 [2024-04-27 02:44:13.825912] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.367 qpair failed and we were unable to recover it. 00:24:40.367 [2024-04-27 02:44:13.835734] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.367 [2024-04-27 02:44:13.835780] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.367 [2024-04-27 02:44:13.835802] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.367 [2024-04-27 02:44:13.835813] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.367 [2024-04-27 02:44:13.835822] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.367 [2024-04-27 02:44:13.845934] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.367 qpair failed and we were unable to recover it. 00:24:40.367 [2024-04-27 02:44:13.855776] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.367 [2024-04-27 02:44:13.855820] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.367 [2024-04-27 02:44:13.855837] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.367 [2024-04-27 02:44:13.855848] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.367 [2024-04-27 02:44:13.855857] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.367 [2024-04-27 02:44:13.866281] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.367 qpair failed and we were unable to recover it. 00:24:40.367 [2024-04-27 02:44:13.875830] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.367 [2024-04-27 02:44:13.875867] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.367 [2024-04-27 02:44:13.875886] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.367 [2024-04-27 02:44:13.875896] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.367 [2024-04-27 02:44:13.875905] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.367 [2024-04-27 02:44:13.886303] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.367 qpair failed and we were unable to recover it. 00:24:40.367 [2024-04-27 02:44:13.895856] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.367 [2024-04-27 02:44:13.895895] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.367 [2024-04-27 02:44:13.895912] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.367 [2024-04-27 02:44:13.895922] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.367 [2024-04-27 02:44:13.895933] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.367 [2024-04-27 02:44:13.906502] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.367 qpair failed and we were unable to recover it. 00:24:40.367 [2024-04-27 02:44:13.916003] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.367 [2024-04-27 02:44:13.916041] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.367 [2024-04-27 02:44:13.916059] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.367 [2024-04-27 02:44:13.916068] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.367 [2024-04-27 02:44:13.916082] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.367 [2024-04-27 02:44:13.926311] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.367 qpair failed and we were unable to recover it. 00:24:40.367 [2024-04-27 02:44:13.936086] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.367 [2024-04-27 02:44:13.936133] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.367 [2024-04-27 02:44:13.936151] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.367 [2024-04-27 02:44:13.936163] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.367 [2024-04-27 02:44:13.936172] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.367 [2024-04-27 02:44:13.946524] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.367 qpair failed and we were unable to recover it. 00:24:40.367 [2024-04-27 02:44:13.956106] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.367 [2024-04-27 02:44:13.956144] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.367 [2024-04-27 02:44:13.956161] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.367 [2024-04-27 02:44:13.956171] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.367 [2024-04-27 02:44:13.956179] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.367 [2024-04-27 02:44:13.966395] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.367 qpair failed and we were unable to recover it. 00:24:40.367 [2024-04-27 02:44:13.976159] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.367 [2024-04-27 02:44:13.976198] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.367 [2024-04-27 02:44:13.976214] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.367 [2024-04-27 02:44:13.976224] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.367 [2024-04-27 02:44:13.976233] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.367 [2024-04-27 02:44:13.986681] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.367 qpair failed and we were unable to recover it. 00:24:40.625 [2024-04-27 02:44:13.996226] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.625 [2024-04-27 02:44:13.996274] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.625 [2024-04-27 02:44:13.996291] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.625 [2024-04-27 02:44:13.996305] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.625 [2024-04-27 02:44:13.996314] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.625 [2024-04-27 02:44:14.006502] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.625 qpair failed and we were unable to recover it. 00:24:40.625 [2024-04-27 02:44:14.016322] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.625 [2024-04-27 02:44:14.016370] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.625 [2024-04-27 02:44:14.016388] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.625 [2024-04-27 02:44:14.016398] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.625 [2024-04-27 02:44:14.016416] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.625 [2024-04-27 02:44:14.026715] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.625 qpair failed and we were unable to recover it. 00:24:40.625 [2024-04-27 02:44:14.036508] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.625 [2024-04-27 02:44:14.036550] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.625 [2024-04-27 02:44:14.036567] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.625 [2024-04-27 02:44:14.036579] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.625 [2024-04-27 02:44:14.036589] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.625 [2024-04-27 02:44:14.046684] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.625 qpair failed and we were unable to recover it. 00:24:40.625 [2024-04-27 02:44:14.056384] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.625 [2024-04-27 02:44:14.056426] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.625 [2024-04-27 02:44:14.056444] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.625 [2024-04-27 02:44:14.056454] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.625 [2024-04-27 02:44:14.056463] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.625 [2024-04-27 02:44:14.066993] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.625 qpair failed and we were unable to recover it. 00:24:40.625 [2024-04-27 02:44:14.076507] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.625 [2024-04-27 02:44:14.076548] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.625 [2024-04-27 02:44:14.076565] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.625 [2024-04-27 02:44:14.076575] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.625 [2024-04-27 02:44:14.076584] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.625 [2024-04-27 02:44:14.086869] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.625 qpair failed and we were unable to recover it. 00:24:40.625 [2024-04-27 02:44:14.096526] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.625 [2024-04-27 02:44:14.096564] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.625 [2024-04-27 02:44:14.096581] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.625 [2024-04-27 02:44:14.096601] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.625 [2024-04-27 02:44:14.096610] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.625 [2024-04-27 02:44:14.106975] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.625 qpair failed and we were unable to recover it. 00:24:40.625 [2024-04-27 02:44:14.116655] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.625 [2024-04-27 02:44:14.116695] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.625 [2024-04-27 02:44:14.116712] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.625 [2024-04-27 02:44:14.116722] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.625 [2024-04-27 02:44:14.116730] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.625 [2024-04-27 02:44:14.127059] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.625 qpair failed and we were unable to recover it. 00:24:40.625 [2024-04-27 02:44:14.136633] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.625 [2024-04-27 02:44:14.136674] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.625 [2024-04-27 02:44:14.136693] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.625 [2024-04-27 02:44:14.136702] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.625 [2024-04-27 02:44:14.136715] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.625 [2024-04-27 02:44:14.147043] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.625 qpair failed and we were unable to recover it. 00:24:40.625 [2024-04-27 02:44:14.156743] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.625 [2024-04-27 02:44:14.156788] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.625 [2024-04-27 02:44:14.156806] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.625 [2024-04-27 02:44:14.156816] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.625 [2024-04-27 02:44:14.156825] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.625 [2024-04-27 02:44:14.167027] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.625 qpair failed and we were unable to recover it. 00:24:40.625 [2024-04-27 02:44:14.176812] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.625 [2024-04-27 02:44:14.176854] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.625 [2024-04-27 02:44:14.176871] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.625 [2024-04-27 02:44:14.176883] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.625 [2024-04-27 02:44:14.176892] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.625 [2024-04-27 02:44:14.187188] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.625 qpair failed and we were unable to recover it. 00:24:40.625 [2024-04-27 02:44:14.196812] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.626 [2024-04-27 02:44:14.196854] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.626 [2024-04-27 02:44:14.196871] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.626 [2024-04-27 02:44:14.196889] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.626 [2024-04-27 02:44:14.196898] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.626 [2024-04-27 02:44:14.207376] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.626 qpair failed and we were unable to recover it. 00:24:40.626 [2024-04-27 02:44:14.216912] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.626 [2024-04-27 02:44:14.216954] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.626 [2024-04-27 02:44:14.216971] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.626 [2024-04-27 02:44:14.216988] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.626 [2024-04-27 02:44:14.216997] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.626 [2024-04-27 02:44:14.227436] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.626 qpair failed and we were unable to recover it. 00:24:40.626 [2024-04-27 02:44:14.236857] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.626 [2024-04-27 02:44:14.236900] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.626 [2024-04-27 02:44:14.236924] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.626 [2024-04-27 02:44:14.236934] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.626 [2024-04-27 02:44:14.236943] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.883 [2024-04-27 02:44:14.247417] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.883 qpair failed and we were unable to recover it. 00:24:40.883 [2024-04-27 02:44:14.257055] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.883 [2024-04-27 02:44:14.257102] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.883 [2024-04-27 02:44:14.257119] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.883 [2024-04-27 02:44:14.257133] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.883 [2024-04-27 02:44:14.257142] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.883 [2024-04-27 02:44:14.267407] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.883 qpair failed and we were unable to recover it. 00:24:40.883 [2024-04-27 02:44:14.277081] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.883 [2024-04-27 02:44:14.277118] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.883 [2024-04-27 02:44:14.277138] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.883 [2024-04-27 02:44:14.277153] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.883 [2024-04-27 02:44:14.277162] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.883 [2024-04-27 02:44:14.287538] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.883 qpair failed and we were unable to recover it. 00:24:40.883 [2024-04-27 02:44:14.297149] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.883 [2024-04-27 02:44:14.297191] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.883 [2024-04-27 02:44:14.297209] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.883 [2024-04-27 02:44:14.297224] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.883 [2024-04-27 02:44:14.297233] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.883 [2024-04-27 02:44:14.307455] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.883 qpair failed and we were unable to recover it. 00:24:40.883 [2024-04-27 02:44:14.317164] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.883 [2024-04-27 02:44:14.317211] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.883 [2024-04-27 02:44:14.317228] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.883 [2024-04-27 02:44:14.317242] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.883 [2024-04-27 02:44:14.317251] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.883 [2024-04-27 02:44:14.327584] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.883 qpair failed and we were unable to recover it. 00:24:40.883 [2024-04-27 02:44:14.337233] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.883 [2024-04-27 02:44:14.337276] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.883 [2024-04-27 02:44:14.337294] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.883 [2024-04-27 02:44:14.337304] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.883 [2024-04-27 02:44:14.337313] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.883 [2024-04-27 02:44:14.347615] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.883 qpair failed and we were unable to recover it. 00:24:40.884 [2024-04-27 02:44:14.357494] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.884 [2024-04-27 02:44:14.357530] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.884 [2024-04-27 02:44:14.357548] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.884 [2024-04-27 02:44:14.357557] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.884 [2024-04-27 02:44:14.357569] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.884 [2024-04-27 02:44:14.367613] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.884 qpair failed and we were unable to recover it. 00:24:40.884 [2024-04-27 02:44:14.377442] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.884 [2024-04-27 02:44:14.377486] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.884 [2024-04-27 02:44:14.377503] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.884 [2024-04-27 02:44:14.377518] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.884 [2024-04-27 02:44:14.377527] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.884 [2024-04-27 02:44:14.387813] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.884 qpair failed and we were unable to recover it. 00:24:40.884 [2024-04-27 02:44:14.397457] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.884 [2024-04-27 02:44:14.397496] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.884 [2024-04-27 02:44:14.397513] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.884 [2024-04-27 02:44:14.397522] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.884 [2024-04-27 02:44:14.397532] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.884 [2024-04-27 02:44:14.407908] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.884 qpair failed and we were unable to recover it. 00:24:40.884 [2024-04-27 02:44:14.417766] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.884 [2024-04-27 02:44:14.417804] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.884 [2024-04-27 02:44:14.417821] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.884 [2024-04-27 02:44:14.417837] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.884 [2024-04-27 02:44:14.417846] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.884 [2024-04-27 02:44:14.427857] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.884 qpair failed and we were unable to recover it. 00:24:40.884 [2024-04-27 02:44:14.437589] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.884 [2024-04-27 02:44:14.437640] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.884 [2024-04-27 02:44:14.437657] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.884 [2024-04-27 02:44:14.437666] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.884 [2024-04-27 02:44:14.437675] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.884 [2024-04-27 02:44:14.447928] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.884 qpair failed and we were unable to recover it. 00:24:40.884 [2024-04-27 02:44:14.457760] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.884 [2024-04-27 02:44:14.457805] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.884 [2024-04-27 02:44:14.457821] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.884 [2024-04-27 02:44:14.457831] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.884 [2024-04-27 02:44:14.457840] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.884 [2024-04-27 02:44:14.468059] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.884 qpair failed and we were unable to recover it. 00:24:40.884 [2024-04-27 02:44:14.477750] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.884 [2024-04-27 02:44:14.477797] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.884 [2024-04-27 02:44:14.477814] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.884 [2024-04-27 02:44:14.477828] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.884 [2024-04-27 02:44:14.477837] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:40.884 [2024-04-27 02:44:14.488138] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:40.884 qpair failed and we were unable to recover it. 00:24:40.884 [2024-04-27 02:44:14.497882] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:40.884 [2024-04-27 02:44:14.497918] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:40.884 [2024-04-27 02:44:14.497935] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:40.884 [2024-04-27 02:44:14.497945] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:40.884 [2024-04-27 02:44:14.497955] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:41.144 [2024-04-27 02:44:14.508206] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:41.144 qpair failed and we were unable to recover it. 00:24:41.144 [2024-04-27 02:44:14.517857] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:41.144 [2024-04-27 02:44:14.517900] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:41.144 [2024-04-27 02:44:14.517917] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:41.144 [2024-04-27 02:44:14.517935] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:41.144 [2024-04-27 02:44:14.517943] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:41.144 [2024-04-27 02:44:14.528208] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:41.144 qpair failed and we were unable to recover it. 00:24:41.144 [2024-04-27 02:44:14.537905] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:41.144 [2024-04-27 02:44:14.537950] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:41.144 [2024-04-27 02:44:14.537967] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:41.144 [2024-04-27 02:44:14.537983] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:41.144 [2024-04-27 02:44:14.537993] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:41.144 [2024-04-27 02:44:14.548373] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:41.144 qpair failed and we were unable to recover it. 00:24:41.144 [2024-04-27 02:44:14.558078] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:41.144 [2024-04-27 02:44:14.558124] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:41.144 [2024-04-27 02:44:14.558141] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:41.144 [2024-04-27 02:44:14.558159] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:41.144 [2024-04-27 02:44:14.558168] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:41.144 [2024-04-27 02:44:14.568316] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:41.144 qpair failed and we were unable to recover it. 00:24:41.144 [2024-04-27 02:44:14.578046] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:41.144 [2024-04-27 02:44:14.578092] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:41.144 [2024-04-27 02:44:14.578118] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:41.144 [2024-04-27 02:44:14.578128] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:41.144 [2024-04-27 02:44:14.578136] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:41.144 [2024-04-27 02:44:14.588342] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:41.144 qpair failed and we were unable to recover it. 00:24:41.144 [2024-04-27 02:44:14.598123] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:41.144 [2024-04-27 02:44:14.598159] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:41.144 [2024-04-27 02:44:14.598176] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:41.144 [2024-04-27 02:44:14.598194] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:41.144 [2024-04-27 02:44:14.598202] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:41.144 [2024-04-27 02:44:14.608490] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:41.144 qpair failed and we were unable to recover it. 00:24:41.144 [2024-04-27 02:44:14.618206] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:41.144 [2024-04-27 02:44:14.618245] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:41.144 [2024-04-27 02:44:14.618264] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:41.144 [2024-04-27 02:44:14.618281] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:41.144 [2024-04-27 02:44:14.618290] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:41.144 [2024-04-27 02:44:14.628612] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:41.144 qpair failed and we were unable to recover it. 00:24:41.144 [2024-04-27 02:44:14.638359] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:41.144 [2024-04-27 02:44:14.638400] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:41.144 [2024-04-27 02:44:14.638418] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:41.144 [2024-04-27 02:44:14.638434] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:41.144 [2024-04-27 02:44:14.638442] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:41.144 [2024-04-27 02:44:14.648658] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:41.144 qpair failed and we were unable to recover it. 00:24:41.144 [2024-04-27 02:44:14.658340] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:41.144 [2024-04-27 02:44:14.658379] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:41.144 [2024-04-27 02:44:14.658396] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:41.144 [2024-04-27 02:44:14.658410] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:41.144 [2024-04-27 02:44:14.658419] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:41.144 [2024-04-27 02:44:14.668622] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:41.144 qpair failed and we were unable to recover it. 00:24:41.144 [2024-04-27 02:44:14.678434] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:41.144 [2024-04-27 02:44:14.678472] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:41.144 [2024-04-27 02:44:14.678489] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:41.144 [2024-04-27 02:44:14.678504] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:41.144 [2024-04-27 02:44:14.678513] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:41.144 [2024-04-27 02:44:14.688741] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:41.144 qpair failed and we were unable to recover it. 00:24:41.144 [2024-04-27 02:44:14.698430] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:41.144 [2024-04-27 02:44:14.698492] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:41.144 [2024-04-27 02:44:14.698522] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:41.144 [2024-04-27 02:44:14.698531] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:41.144 [2024-04-27 02:44:14.698540] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:41.144 [2024-04-27 02:44:14.708719] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:41.145 qpair failed and we were unable to recover it. 00:24:41.145 [2024-04-27 02:44:14.718560] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:41.145 [2024-04-27 02:44:14.718601] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:41.145 [2024-04-27 02:44:14.718622] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:41.145 [2024-04-27 02:44:14.718637] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:41.145 [2024-04-27 02:44:14.718646] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:41.145 [2024-04-27 02:44:14.728787] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:41.145 qpair failed and we were unable to recover it. 00:24:41.145 [2024-04-27 02:44:14.738581] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:41.145 [2024-04-27 02:44:14.738618] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:41.145 [2024-04-27 02:44:14.738635] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:41.145 [2024-04-27 02:44:14.738653] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:41.145 [2024-04-27 02:44:14.738662] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:41.145 [2024-04-27 02:44:14.748914] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:41.145 qpair failed and we were unable to recover it. 00:24:41.145 [2024-04-27 02:44:14.758652] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:41.145 [2024-04-27 02:44:14.758699] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:41.145 [2024-04-27 02:44:14.758717] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:41.145 [2024-04-27 02:44:14.758727] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:41.145 [2024-04-27 02:44:14.758737] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:41.443 [2024-04-27 02:44:14.768792] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:41.443 qpair failed and we were unable to recover it. 00:24:41.443 [2024-04-27 02:44:14.778618] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:41.443 [2024-04-27 02:44:14.778662] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:41.443 [2024-04-27 02:44:14.778680] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:41.443 [2024-04-27 02:44:14.778696] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:41.443 [2024-04-27 02:44:14.778706] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:41.443 [2024-04-27 02:44:14.788966] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:41.443 qpair failed and we were unable to recover it. 00:24:41.443 [2024-04-27 02:44:14.798711] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:41.443 [2024-04-27 02:44:14.798758] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:41.443 [2024-04-27 02:44:14.798775] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:41.443 [2024-04-27 02:44:14.798789] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:41.443 [2024-04-27 02:44:14.798801] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:41.443 [2024-04-27 02:44:14.808952] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:41.443 qpair failed and we were unable to recover it. 00:24:41.443 [2024-04-27 02:44:14.818723] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:41.443 [2024-04-27 02:44:14.818765] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:41.444 [2024-04-27 02:44:14.818782] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:41.444 [2024-04-27 02:44:14.818795] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:41.444 [2024-04-27 02:44:14.818804] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:41.444 [2024-04-27 02:44:14.829197] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:41.444 qpair failed and we were unable to recover it. 00:24:41.444 [2024-04-27 02:44:14.838927] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:41.444 [2024-04-27 02:44:14.838964] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:41.444 [2024-04-27 02:44:14.838981] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:41.444 [2024-04-27 02:44:14.838997] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:41.444 [2024-04-27 02:44:14.839006] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:41.444 [2024-04-27 02:44:14.849296] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:41.444 qpair failed and we were unable to recover it. 00:24:41.444 [2024-04-27 02:44:14.858886] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:41.444 [2024-04-27 02:44:14.858928] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:41.444 [2024-04-27 02:44:14.858945] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:41.444 [2024-04-27 02:44:14.858963] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:41.444 [2024-04-27 02:44:14.858971] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:41.444 [2024-04-27 02:44:14.869121] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:41.444 qpair failed and we were unable to recover it. 00:24:41.444 [2024-04-27 02:44:14.878937] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:41.444 [2024-04-27 02:44:14.878982] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:41.444 [2024-04-27 02:44:14.879000] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:41.444 [2024-04-27 02:44:14.879011] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:41.444 [2024-04-27 02:44:14.879020] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:41.444 [2024-04-27 02:44:14.889309] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:41.444 qpair failed and we were unable to recover it. 00:24:41.444 [2024-04-27 02:44:14.898996] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:41.444 [2024-04-27 02:44:14.899039] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:41.444 [2024-04-27 02:44:14.899056] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:41.444 [2024-04-27 02:44:14.899073] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:41.444 [2024-04-27 02:44:14.899082] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:41.444 [2024-04-27 02:44:14.909353] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:41.444 qpair failed and we were unable to recover it. 00:24:41.444 [2024-04-27 02:44:14.919129] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:41.444 [2024-04-27 02:44:14.919169] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:41.444 [2024-04-27 02:44:14.919185] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:41.444 [2024-04-27 02:44:14.919200] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:41.444 [2024-04-27 02:44:14.919209] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:41.444 [2024-04-27 02:44:14.929397] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:41.444 qpair failed and we were unable to recover it. 00:24:41.444 [2024-04-27 02:44:14.939200] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:41.444 [2024-04-27 02:44:14.939247] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:41.444 [2024-04-27 02:44:14.939264] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:41.444 [2024-04-27 02:44:14.939280] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:41.444 [2024-04-27 02:44:14.939289] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:41.444 [2024-04-27 02:44:14.949390] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:41.444 qpair failed and we were unable to recover it. 00:24:41.444 [2024-04-27 02:44:14.959232] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:41.444 [2024-04-27 02:44:14.959279] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:41.444 [2024-04-27 02:44:14.959297] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:41.444 [2024-04-27 02:44:14.959307] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:41.444 [2024-04-27 02:44:14.959316] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:41.444 [2024-04-27 02:44:14.969467] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:41.444 qpair failed and we were unable to recover it. 00:24:41.444 [2024-04-27 02:44:14.979351] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:41.444 [2024-04-27 02:44:14.979389] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:41.444 [2024-04-27 02:44:14.979406] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:41.444 [2024-04-27 02:44:14.979425] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:41.444 [2024-04-27 02:44:14.979434] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:41.444 [2024-04-27 02:44:14.989506] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:41.444 qpair failed and we were unable to recover it. 00:24:41.444 [2024-04-27 02:44:14.999228] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:41.444 [2024-04-27 02:44:14.999262] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:41.444 [2024-04-27 02:44:14.999279] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:41.444 [2024-04-27 02:44:14.999288] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:41.444 [2024-04-27 02:44:14.999298] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:41.444 [2024-04-27 02:44:15.009513] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:41.444 qpair failed and we were unable to recover it. 00:24:41.444 [2024-04-27 02:44:15.019327] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:41.444 [2024-04-27 02:44:15.019371] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:41.444 [2024-04-27 02:44:15.019388] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:41.444 [2024-04-27 02:44:15.019406] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:41.444 [2024-04-27 02:44:15.019415] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:41.444 [2024-04-27 02:44:15.029658] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:41.445 qpair failed and we were unable to recover it. 00:24:41.445 [2024-04-27 02:44:15.039374] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:41.445 [2024-04-27 02:44:15.039420] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:41.445 [2024-04-27 02:44:15.039437] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:41.445 [2024-04-27 02:44:15.039449] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:41.445 [2024-04-27 02:44:15.039457] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:41.445 [2024-04-27 02:44:15.049671] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:41.445 qpair failed and we were unable to recover it. 00:24:41.713 [2024-04-27 02:44:15.059418] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:41.713 [2024-04-27 02:44:15.059467] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:41.713 [2024-04-27 02:44:15.059483] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:41.713 [2024-04-27 02:44:15.059497] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:41.713 [2024-04-27 02:44:15.059506] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:41.713 [2024-04-27 02:44:15.069804] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:41.713 qpair failed and we were unable to recover it. 00:24:41.713 [2024-04-27 02:44:15.079517] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:41.713 [2024-04-27 02:44:15.079559] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:41.713 [2024-04-27 02:44:15.079576] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:41.713 [2024-04-27 02:44:15.079593] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:41.713 [2024-04-27 02:44:15.079602] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:41.713 [2024-04-27 02:44:15.089939] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:41.713 qpair failed and we were unable to recover it. 00:24:41.713 [2024-04-27 02:44:15.099508] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:41.713 [2024-04-27 02:44:15.099551] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:41.713 [2024-04-27 02:44:15.099568] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:41.713 [2024-04-27 02:44:15.099585] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:41.713 [2024-04-27 02:44:15.099594] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:41.713 [2024-04-27 02:44:15.109951] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:41.713 qpair failed and we were unable to recover it. 00:24:41.713 [2024-04-27 02:44:15.119611] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:41.713 [2024-04-27 02:44:15.119656] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:41.713 [2024-04-27 02:44:15.119673] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:41.713 [2024-04-27 02:44:15.119688] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:41.713 [2024-04-27 02:44:15.119698] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:41.713 [2024-04-27 02:44:15.130259] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:41.713 qpair failed and we were unable to recover it. 00:24:41.713 [2024-04-27 02:44:15.139647] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:41.713 [2024-04-27 02:44:15.139688] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:41.713 [2024-04-27 02:44:15.139706] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:41.713 [2024-04-27 02:44:15.139719] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:41.713 [2024-04-27 02:44:15.139728] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:41.713 [2024-04-27 02:44:15.150039] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:41.713 qpair failed and we were unable to recover it. 00:24:41.713 [2024-04-27 02:44:15.159726] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:41.713 [2024-04-27 02:44:15.159761] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:41.713 [2024-04-27 02:44:15.159781] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:41.713 [2024-04-27 02:44:15.159791] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:41.713 [2024-04-27 02:44:15.159800] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:41.713 [2024-04-27 02:44:15.170215] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:41.713 qpair failed and we were unable to recover it. 00:24:41.713 [2024-04-27 02:44:15.179789] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:41.713 [2024-04-27 02:44:15.179829] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:41.713 [2024-04-27 02:44:15.179847] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:41.713 [2024-04-27 02:44:15.179864] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:41.713 [2024-04-27 02:44:15.179874] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:41.713 [2024-04-27 02:44:15.190055] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:41.713 qpair failed and we were unable to recover it. 00:24:41.713 [2024-04-27 02:44:15.190202] nvme_ctrlr.c:4340:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:24:41.713 A controller has encountered a failure and is being reset. 00:24:41.713 [2024-04-27 02:44:15.199959] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:41.713 [2024-04-27 02:44:15.200014] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:41.713 [2024-04-27 02:44:15.200044] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:41.713 [2024-04-27 02:44:15.200060] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:41.713 [2024-04-27 02:44:15.200073] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:24:41.713 [2024-04-27 02:44:15.210263] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:24:41.713 qpair failed and we were unable to recover it. 00:24:41.713 [2024-04-27 02:44:15.219900] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:24:41.713 [2024-04-27 02:44:15.219940] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:24:41.713 [2024-04-27 02:44:15.219958] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:24:41.713 [2024-04-27 02:44:15.219969] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:24:41.713 [2024-04-27 02:44:15.219978] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:24:41.713 [2024-04-27 02:44:15.230365] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:24:41.713 qpair failed and we were unable to recover it. 00:24:42.643 Write completed with error (sct=0, sc=8) 00:24:42.643 starting I/O failed 00:24:42.643 Write completed with error (sct=0, sc=8) 00:24:42.643 starting I/O failed 00:24:42.643 Write completed with error (sct=0, sc=8) 00:24:42.643 starting I/O failed 00:24:42.643 Read completed with error (sct=0, sc=8) 00:24:42.643 starting I/O failed 00:24:42.643 Read completed with error (sct=0, sc=8) 00:24:42.643 starting I/O failed 00:24:42.643 Write completed with error (sct=0, sc=8) 00:24:42.643 starting I/O failed 00:24:42.643 Write completed with error (sct=0, sc=8) 00:24:42.643 starting I/O failed 00:24:42.643 Read completed with error (sct=0, sc=8) 00:24:42.643 starting I/O failed 00:24:42.643 Write completed with error (sct=0, sc=8) 00:24:42.643 starting I/O failed 00:24:42.643 Read completed with error (sct=0, sc=8) 00:24:42.643 starting I/O failed 00:24:42.643 Write completed with error (sct=0, sc=8) 00:24:42.643 starting I/O failed 00:24:42.643 Write completed with error (sct=0, sc=8) 00:24:42.643 starting I/O failed 00:24:42.643 Write completed with error (sct=0, sc=8) 00:24:42.643 starting I/O failed 00:24:42.643 Read completed with error (sct=0, sc=8) 00:24:42.643 starting I/O failed 00:24:42.643 Write completed with error (sct=0, sc=8) 00:24:42.643 starting I/O failed 00:24:42.643 Read completed with error (sct=0, sc=8) 00:24:42.643 starting I/O failed 00:24:42.643 Write completed with error (sct=0, sc=8) 00:24:42.643 starting I/O failed 00:24:42.643 Write completed with error (sct=0, sc=8) 00:24:42.643 starting I/O failed 00:24:42.643 Write completed with error (sct=0, sc=8) 00:24:42.643 starting I/O failed 00:24:42.643 Read completed with error (sct=0, sc=8) 00:24:42.643 starting I/O failed 00:24:42.643 Write completed with error (sct=0, sc=8) 00:24:42.643 starting I/O failed 00:24:42.643 Write completed with error (sct=0, sc=8) 00:24:42.643 starting I/O failed 00:24:42.643 Write completed with error (sct=0, sc=8) 00:24:42.643 starting I/O failed 00:24:42.643 Write completed with error (sct=0, sc=8) 00:24:42.643 starting I/O failed 00:24:42.643 Write completed with error (sct=0, sc=8) 00:24:42.643 starting I/O failed 00:24:42.643 Write completed with error (sct=0, sc=8) 00:24:42.643 starting I/O failed 00:24:42.643 Write completed with error (sct=0, sc=8) 00:24:42.643 starting I/O failed 00:24:42.643 Write completed with error (sct=0, sc=8) 00:24:42.643 starting I/O failed 00:24:42.643 Write completed with error (sct=0, sc=8) 00:24:42.643 starting I/O failed 00:24:42.643 Read completed with error (sct=0, sc=8) 00:24:42.643 starting I/O failed 00:24:42.643 Write completed with error (sct=0, sc=8) 00:24:42.643 starting I/O failed 00:24:42.643 Read completed with error (sct=0, sc=8) 00:24:42.643 starting I/O failed 00:24:42.644 [2024-04-27 02:44:16.235390] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:24:42.644 [2024-04-27 02:44:16.235449] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:24:42.900 [2024-04-27 02:44:16.266378] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:42.901 Controller properly reset. 00:24:42.901 Initializing NVMe Controllers 00:24:42.901 Attaching to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:24:42.901 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:24:42.901 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:24:42.901 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:24:42.901 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:24:42.901 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:24:42.901 Initialization complete. Launching workers. 00:24:42.901 Starting thread on core 1 00:24:42.901 Starting thread on core 2 00:24:42.901 Starting thread on core 3 00:24:42.901 Starting thread on core 0 00:24:42.901 02:44:16 -- host/target_disconnect.sh@59 -- # sync 00:24:42.901 00:24:42.901 real 0m12.541s 00:24:42.901 user 0m26.850s 00:24:42.901 sys 0m3.386s 00:24:42.901 02:44:16 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:24:42.901 02:44:16 -- common/autotest_common.sh@10 -- # set +x 00:24:42.901 ************************************ 00:24:42.901 END TEST nvmf_target_disconnect_tc2 00:24:42.901 ************************************ 00:24:42.901 02:44:16 -- host/target_disconnect.sh@80 -- # '[' -n 192.168.100.9 ']' 00:24:42.901 02:44:16 -- host/target_disconnect.sh@81 -- # run_test nvmf_target_disconnect_tc3 nvmf_target_disconnect_tc3 00:24:42.901 02:44:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:24:42.901 02:44:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:42.901 02:44:16 -- common/autotest_common.sh@10 -- # set +x 00:24:43.158 ************************************ 00:24:43.158 START TEST nvmf_target_disconnect_tc3 00:24:43.158 ************************************ 00:24:43.158 02:44:16 -- common/autotest_common.sh@1111 -- # nvmf_target_disconnect_tc3 00:24:43.158 02:44:16 -- host/target_disconnect.sh@65 -- # reconnectpid=1657096 00:24:43.158 02:44:16 -- host/target_disconnect.sh@67 -- # sleep 2 00:24:43.158 02:44:16 -- host/target_disconnect.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 alt_traddr:192.168.100.9' 00:24:43.158 EAL: No free 2048 kB hugepages reported on node 1 00:24:45.055 02:44:18 -- host/target_disconnect.sh@68 -- # kill -9 1656089 00:24:45.055 02:44:18 -- host/target_disconnect.sh@70 -- # sleep 2 00:24:46.432 Read completed with error (sct=0, sc=8) 00:24:46.432 starting I/O failed 00:24:46.432 Read completed with error (sct=0, sc=8) 00:24:46.432 starting I/O failed 00:24:46.432 Read completed with error (sct=0, sc=8) 00:24:46.432 starting I/O failed 00:24:46.432 Write completed with error (sct=0, sc=8) 00:24:46.432 starting I/O failed 00:24:46.432 Write completed with error (sct=0, sc=8) 00:24:46.432 starting I/O failed 00:24:46.432 Read completed with error (sct=0, sc=8) 00:24:46.432 starting I/O failed 00:24:46.432 Write completed with error (sct=0, sc=8) 00:24:46.432 starting I/O failed 00:24:46.432 Read completed with error (sct=0, sc=8) 00:24:46.432 starting I/O failed 00:24:46.432 Write completed with error (sct=0, sc=8) 00:24:46.432 starting I/O failed 00:24:46.432 Write completed with error (sct=0, sc=8) 00:24:46.432 starting I/O failed 00:24:46.432 Write completed with error (sct=0, sc=8) 00:24:46.432 starting I/O failed 00:24:46.432 Read completed with error (sct=0, sc=8) 00:24:46.432 starting I/O failed 00:24:46.432 Read completed with error (sct=0, sc=8) 00:24:46.432 starting I/O failed 00:24:46.432 Write completed with error (sct=0, sc=8) 00:24:46.432 starting I/O failed 00:24:46.432 Write completed with error (sct=0, sc=8) 00:24:46.432 starting I/O failed 00:24:46.432 Read completed with error (sct=0, sc=8) 00:24:46.432 starting I/O failed 00:24:46.432 Write completed with error (sct=0, sc=8) 00:24:46.432 starting I/O failed 00:24:46.432 Write completed with error (sct=0, sc=8) 00:24:46.432 starting I/O failed 00:24:46.432 Read completed with error (sct=0, sc=8) 00:24:46.432 starting I/O failed 00:24:46.432 Write completed with error (sct=0, sc=8) 00:24:46.432 starting I/O failed 00:24:46.433 Read completed with error (sct=0, sc=8) 00:24:46.433 starting I/O failed 00:24:46.433 Read completed with error (sct=0, sc=8) 00:24:46.433 starting I/O failed 00:24:46.433 Read completed with error (sct=0, sc=8) 00:24:46.433 starting I/O failed 00:24:46.433 Write completed with error (sct=0, sc=8) 00:24:46.433 starting I/O failed 00:24:46.433 Read completed with error (sct=0, sc=8) 00:24:46.433 starting I/O failed 00:24:46.433 Write completed with error (sct=0, sc=8) 00:24:46.433 starting I/O failed 00:24:46.433 Write completed with error (sct=0, sc=8) 00:24:46.433 starting I/O failed 00:24:46.433 Write completed with error (sct=0, sc=8) 00:24:46.433 starting I/O failed 00:24:46.433 Read completed with error (sct=0, sc=8) 00:24:46.433 starting I/O failed 00:24:46.433 Read completed with error (sct=0, sc=8) 00:24:46.433 starting I/O failed 00:24:46.433 Write completed with error (sct=0, sc=8) 00:24:46.433 starting I/O failed 00:24:46.433 Read completed with error (sct=0, sc=8) 00:24:46.433 starting I/O failed 00:24:46.433 [2024-04-27 02:44:19.750115] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:24:46.999 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 62: 1656089 Killed "${NVMF_APP[@]}" "$@" 00:24:46.999 02:44:20 -- host/target_disconnect.sh@71 -- # disconnect_init 192.168.100.9 00:24:46.999 02:44:20 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:24:46.999 02:44:20 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:24:46.999 02:44:20 -- common/autotest_common.sh@710 -- # xtrace_disable 00:24:46.999 02:44:20 -- common/autotest_common.sh@10 -- # set +x 00:24:46.999 02:44:20 -- nvmf/common.sh@470 -- # nvmfpid=1657646 00:24:46.999 02:44:20 -- nvmf/common.sh@471 -- # waitforlisten 1657646 00:24:46.999 02:44:20 -- common/autotest_common.sh@817 -- # '[' -z 1657646 ']' 00:24:46.999 02:44:20 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:46.999 02:44:20 -- common/autotest_common.sh@822 -- # local max_retries=100 00:24:46.999 02:44:20 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:24:46.999 02:44:20 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:46.999 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:46.999 02:44:20 -- common/autotest_common.sh@826 -- # xtrace_disable 00:24:46.999 02:44:20 -- common/autotest_common.sh@10 -- # set +x 00:24:47.257 [2024-04-27 02:44:20.629099] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:24:47.257 [2024-04-27 02:44:20.629167] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:47.257 EAL: No free 2048 kB hugepages reported on node 1 00:24:47.257 [2024-04-27 02:44:20.713792] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:47.257 Write completed with error (sct=0, sc=8) 00:24:47.257 starting I/O failed 00:24:47.257 Write completed with error (sct=0, sc=8) 00:24:47.257 starting I/O failed 00:24:47.257 Write completed with error (sct=0, sc=8) 00:24:47.257 starting I/O failed 00:24:47.257 Write completed with error (sct=0, sc=8) 00:24:47.257 starting I/O failed 00:24:47.257 Read completed with error (sct=0, sc=8) 00:24:47.257 starting I/O failed 00:24:47.257 Write completed with error (sct=0, sc=8) 00:24:47.257 starting I/O failed 00:24:47.257 Read completed with error (sct=0, sc=8) 00:24:47.257 starting I/O failed 00:24:47.257 Write completed with error (sct=0, sc=8) 00:24:47.257 starting I/O failed 00:24:47.257 Read completed with error (sct=0, sc=8) 00:24:47.257 starting I/O failed 00:24:47.257 Write completed with error (sct=0, sc=8) 00:24:47.257 starting I/O failed 00:24:47.257 Read completed with error (sct=0, sc=8) 00:24:47.257 starting I/O failed 00:24:47.257 Read completed with error (sct=0, sc=8) 00:24:47.257 starting I/O failed 00:24:47.257 Write completed with error (sct=0, sc=8) 00:24:47.257 starting I/O failed 00:24:47.257 Write completed with error (sct=0, sc=8) 00:24:47.257 starting I/O failed 00:24:47.257 Write completed with error (sct=0, sc=8) 00:24:47.257 starting I/O failed 00:24:47.258 Read completed with error (sct=0, sc=8) 00:24:47.258 starting I/O failed 00:24:47.258 Read completed with error (sct=0, sc=8) 00:24:47.258 starting I/O failed 00:24:47.258 Read completed with error (sct=0, sc=8) 00:24:47.258 starting I/O failed 00:24:47.258 Read completed with error (sct=0, sc=8) 00:24:47.258 starting I/O failed 00:24:47.258 Read completed with error (sct=0, sc=8) 00:24:47.258 starting I/O failed 00:24:47.258 Read completed with error (sct=0, sc=8) 00:24:47.258 starting I/O failed 00:24:47.258 Write completed with error (sct=0, sc=8) 00:24:47.258 starting I/O failed 00:24:47.258 Read completed with error (sct=0, sc=8) 00:24:47.258 starting I/O failed 00:24:47.258 Read completed with error (sct=0, sc=8) 00:24:47.258 starting I/O failed 00:24:47.258 Read completed with error (sct=0, sc=8) 00:24:47.258 starting I/O failed 00:24:47.258 Read completed with error (sct=0, sc=8) 00:24:47.258 starting I/O failed 00:24:47.258 Write completed with error (sct=0, sc=8) 00:24:47.258 starting I/O failed 00:24:47.258 Read completed with error (sct=0, sc=8) 00:24:47.258 starting I/O failed 00:24:47.258 Read completed with error (sct=0, sc=8) 00:24:47.258 starting I/O failed 00:24:47.258 Write completed with error (sct=0, sc=8) 00:24:47.258 starting I/O failed 00:24:47.258 Read completed with error (sct=0, sc=8) 00:24:47.258 starting I/O failed 00:24:47.258 Write completed with error (sct=0, sc=8) 00:24:47.258 starting I/O failed 00:24:47.258 [2024-04-27 02:44:20.755289] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:24:47.258 [2024-04-27 02:44:20.794043] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:47.258 [2024-04-27 02:44:20.794090] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:47.258 [2024-04-27 02:44:20.794100] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:24:47.258 [2024-04-27 02:44:20.794108] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:24:47.258 [2024-04-27 02:44:20.794116] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:47.258 [2024-04-27 02:44:20.794237] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:24:47.258 [2024-04-27 02:44:20.794355] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:24:47.258 [2024-04-27 02:44:20.794429] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:24:47.258 [2024-04-27 02:44:20.794429] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:24:47.821 02:44:21 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:24:47.821 02:44:21 -- common/autotest_common.sh@850 -- # return 0 00:24:47.821 02:44:21 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:24:47.821 02:44:21 -- common/autotest_common.sh@716 -- # xtrace_disable 00:24:47.821 02:44:21 -- common/autotest_common.sh@10 -- # set +x 00:24:48.078 02:44:21 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:48.078 02:44:21 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:24:48.078 02:44:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:48.078 02:44:21 -- common/autotest_common.sh@10 -- # set +x 00:24:48.078 Malloc0 00:24:48.078 02:44:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:48.078 02:44:21 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:24:48.078 02:44:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:48.078 02:44:21 -- common/autotest_common.sh@10 -- # set +x 00:24:48.078 [2024-04-27 02:44:21.535598] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1c5a400/0x1c66220) succeed. 00:24:48.078 [2024-04-27 02:44:21.546484] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1c5ba40/0x1ce6280) succeed. 00:24:48.078 02:44:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:48.078 02:44:21 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:48.078 02:44:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:48.078 02:44:21 -- common/autotest_common.sh@10 -- # set +x 00:24:48.078 02:44:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:48.078 02:44:21 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:24:48.078 02:44:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:48.078 02:44:21 -- common/autotest_common.sh@10 -- # set +x 00:24:48.078 02:44:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:48.078 02:44:21 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.9 -s 4420 00:24:48.078 02:44:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:48.078 02:44:21 -- common/autotest_common.sh@10 -- # set +x 00:24:48.078 [2024-04-27 02:44:21.692763] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:24:48.078 02:44:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:48.078 02:44:21 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.9 -s 4420 00:24:48.078 02:44:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:48.078 02:44:21 -- common/autotest_common.sh@10 -- # set +x 00:24:48.335 02:44:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:48.335 02:44:21 -- host/target_disconnect.sh@73 -- # wait 1657096 00:24:48.335 Read completed with error (sct=0, sc=8) 00:24:48.335 starting I/O failed 00:24:48.335 Write completed with error (sct=0, sc=8) 00:24:48.335 starting I/O failed 00:24:48.335 Write completed with error (sct=0, sc=8) 00:24:48.335 starting I/O failed 00:24:48.335 Read completed with error (sct=0, sc=8) 00:24:48.335 starting I/O failed 00:24:48.335 Write completed with error (sct=0, sc=8) 00:24:48.335 starting I/O failed 00:24:48.335 Read completed with error (sct=0, sc=8) 00:24:48.335 starting I/O failed 00:24:48.335 Read completed with error (sct=0, sc=8) 00:24:48.335 starting I/O failed 00:24:48.335 Read completed with error (sct=0, sc=8) 00:24:48.335 starting I/O failed 00:24:48.335 Read completed with error (sct=0, sc=8) 00:24:48.335 starting I/O failed 00:24:48.335 Write completed with error (sct=0, sc=8) 00:24:48.335 starting I/O failed 00:24:48.335 Read completed with error (sct=0, sc=8) 00:24:48.335 starting I/O failed 00:24:48.335 Read completed with error (sct=0, sc=8) 00:24:48.335 starting I/O failed 00:24:48.335 Write completed with error (sct=0, sc=8) 00:24:48.335 starting I/O failed 00:24:48.335 Write completed with error (sct=0, sc=8) 00:24:48.335 starting I/O failed 00:24:48.335 Write completed with error (sct=0, sc=8) 00:24:48.335 starting I/O failed 00:24:48.335 Read completed with error (sct=0, sc=8) 00:24:48.335 starting I/O failed 00:24:48.335 Read completed with error (sct=0, sc=8) 00:24:48.335 starting I/O failed 00:24:48.335 Read completed with error (sct=0, sc=8) 00:24:48.335 starting I/O failed 00:24:48.335 Write completed with error (sct=0, sc=8) 00:24:48.335 starting I/O failed 00:24:48.335 Read completed with error (sct=0, sc=8) 00:24:48.335 starting I/O failed 00:24:48.335 Write completed with error (sct=0, sc=8) 00:24:48.335 starting I/O failed 00:24:48.335 Write completed with error (sct=0, sc=8) 00:24:48.335 starting I/O failed 00:24:48.336 Read completed with error (sct=0, sc=8) 00:24:48.336 starting I/O failed 00:24:48.336 Write completed with error (sct=0, sc=8) 00:24:48.336 starting I/O failed 00:24:48.336 Read completed with error (sct=0, sc=8) 00:24:48.336 starting I/O failed 00:24:48.336 Read completed with error (sct=0, sc=8) 00:24:48.336 starting I/O failed 00:24:48.336 Read completed with error (sct=0, sc=8) 00:24:48.336 starting I/O failed 00:24:48.336 Read completed with error (sct=0, sc=8) 00:24:48.336 starting I/O failed 00:24:48.336 Read completed with error (sct=0, sc=8) 00:24:48.336 starting I/O failed 00:24:48.336 Read completed with error (sct=0, sc=8) 00:24:48.336 starting I/O failed 00:24:48.336 Read completed with error (sct=0, sc=8) 00:24:48.336 starting I/O failed 00:24:48.336 Read completed with error (sct=0, sc=8) 00:24:48.336 starting I/O failed 00:24:48.336 [2024-04-27 02:44:21.760379] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:48.336 [2024-04-27 02:44:21.761901] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:24:48.336 [2024-04-27 02:44:21.761920] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:24:48.336 [2024-04-27 02:44:21.761929] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:49.266 [2024-04-27 02:44:22.765682] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:49.266 qpair failed and we were unable to recover it. 00:24:49.266 [2024-04-27 02:44:22.767095] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:24:49.266 [2024-04-27 02:44:22.767115] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:24:49.266 [2024-04-27 02:44:22.767125] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:50.193 [2024-04-27 02:44:23.770874] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:50.193 qpair failed and we were unable to recover it. 00:24:50.193 [2024-04-27 02:44:23.772315] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:24:50.193 [2024-04-27 02:44:23.772332] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:24:50.193 [2024-04-27 02:44:23.772347] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:51.560 [2024-04-27 02:44:24.776229] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:51.560 qpair failed and we were unable to recover it. 00:24:51.560 [2024-04-27 02:44:24.777620] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:24:51.560 [2024-04-27 02:44:24.777637] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:24:51.560 [2024-04-27 02:44:24.777646] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:52.492 [2024-04-27 02:44:25.781485] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:52.492 qpair failed and we were unable to recover it. 00:24:52.492 [2024-04-27 02:44:25.782911] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:24:52.492 [2024-04-27 02:44:25.782929] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:24:52.492 [2024-04-27 02:44:25.782937] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:53.424 [2024-04-27 02:44:26.786744] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:53.424 qpair failed and we were unable to recover it. 00:24:53.424 [2024-04-27 02:44:26.788139] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:24:53.424 [2024-04-27 02:44:26.788156] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:24:53.424 [2024-04-27 02:44:26.788165] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:54.353 [2024-04-27 02:44:27.791994] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:54.353 qpair failed and we were unable to recover it. 00:24:54.353 [2024-04-27 02:44:27.793413] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:24:54.353 [2024-04-27 02:44:27.793431] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:24:54.353 [2024-04-27 02:44:27.793440] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:24:55.283 [2024-04-27 02:44:28.797333] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:24:55.284 qpair failed and we were unable to recover it. 00:24:55.284 [2024-04-27 02:44:28.798922] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:24:55.284 [2024-04-27 02:44:28.798949] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:24:55.284 [2024-04-27 02:44:28.798963] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:24:56.211 [2024-04-27 02:44:29.802812] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:24:56.211 qpair failed and we were unable to recover it. 00:24:56.211 [2024-04-27 02:44:29.804334] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:24:56.211 [2024-04-27 02:44:29.804358] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:24:56.211 [2024-04-27 02:44:29.804371] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:24:57.579 [2024-04-27 02:44:30.808293] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:24:57.579 qpair failed and we were unable to recover it. 00:24:57.579 [2024-04-27 02:44:30.808400] nvme_ctrlr.c:4340:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:24:57.579 A controller has encountered a failure and is being reset. 00:24:57.579 Resorting to new failover address 192.168.100.9 00:24:57.579 [2024-04-27 02:44:30.810037] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:24:57.579 [2024-04-27 02:44:30.810067] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:24:57.579 [2024-04-27 02:44:30.810081] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:24:58.509 [2024-04-27 02:44:31.813903] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:24:58.509 qpair failed and we were unable to recover it. 00:24:58.509 [2024-04-27 02:44:31.815410] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:24:58.509 [2024-04-27 02:44:31.815428] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:24:58.509 [2024-04-27 02:44:31.815437] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:24:59.451 [2024-04-27 02:44:32.819332] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:24:59.451 qpair failed and we were unable to recover it. 00:24:59.451 [2024-04-27 02:44:32.819431] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:59.451 [2024-04-27 02:44:32.819532] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:24:59.451 [2024-04-27 02:44:32.821395] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:59.451 Controller properly reset. 00:25:00.455 Write completed with error (sct=0, sc=8) 00:25:00.455 starting I/O failed 00:25:00.455 Read completed with error (sct=0, sc=8) 00:25:00.455 starting I/O failed 00:25:00.455 Write completed with error (sct=0, sc=8) 00:25:00.455 starting I/O failed 00:25:00.455 Write completed with error (sct=0, sc=8) 00:25:00.455 starting I/O failed 00:25:00.455 Write completed with error (sct=0, sc=8) 00:25:00.455 starting I/O failed 00:25:00.455 Read completed with error (sct=0, sc=8) 00:25:00.455 starting I/O failed 00:25:00.455 Write completed with error (sct=0, sc=8) 00:25:00.455 starting I/O failed 00:25:00.455 Write completed with error (sct=0, sc=8) 00:25:00.455 starting I/O failed 00:25:00.455 Write completed with error (sct=0, sc=8) 00:25:00.455 starting I/O failed 00:25:00.455 Write completed with error (sct=0, sc=8) 00:25:00.455 starting I/O failed 00:25:00.455 Write completed with error (sct=0, sc=8) 00:25:00.455 starting I/O failed 00:25:00.455 Write completed with error (sct=0, sc=8) 00:25:00.455 starting I/O failed 00:25:00.455 Write completed with error (sct=0, sc=8) 00:25:00.455 starting I/O failed 00:25:00.455 Write completed with error (sct=0, sc=8) 00:25:00.455 starting I/O failed 00:25:00.455 Write completed with error (sct=0, sc=8) 00:25:00.455 starting I/O failed 00:25:00.455 Read completed with error (sct=0, sc=8) 00:25:00.455 starting I/O failed 00:25:00.455 Write completed with error (sct=0, sc=8) 00:25:00.455 starting I/O failed 00:25:00.455 Read completed with error (sct=0, sc=8) 00:25:00.455 starting I/O failed 00:25:00.455 Write completed with error (sct=0, sc=8) 00:25:00.455 starting I/O failed 00:25:00.455 Read completed with error (sct=0, sc=8) 00:25:00.455 starting I/O failed 00:25:00.455 Write completed with error (sct=0, sc=8) 00:25:00.455 starting I/O failed 00:25:00.455 Read completed with error (sct=0, sc=8) 00:25:00.455 starting I/O failed 00:25:00.455 Write completed with error (sct=0, sc=8) 00:25:00.455 starting I/O failed 00:25:00.455 Write completed with error (sct=0, sc=8) 00:25:00.455 starting I/O failed 00:25:00.455 Read completed with error (sct=0, sc=8) 00:25:00.455 starting I/O failed 00:25:00.455 Write completed with error (sct=0, sc=8) 00:25:00.455 starting I/O failed 00:25:00.455 Read completed with error (sct=0, sc=8) 00:25:00.455 starting I/O failed 00:25:00.455 Read completed with error (sct=0, sc=8) 00:25:00.455 starting I/O failed 00:25:00.455 Read completed with error (sct=0, sc=8) 00:25:00.455 starting I/O failed 00:25:00.455 Write completed with error (sct=0, sc=8) 00:25:00.455 starting I/O failed 00:25:00.455 Write completed with error (sct=0, sc=8) 00:25:00.455 starting I/O failed 00:25:00.455 Write completed with error (sct=0, sc=8) 00:25:00.455 starting I/O failed 00:25:00.455 [2024-04-27 02:44:33.866241] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:25:00.455 Initializing NVMe Controllers 00:25:00.455 Attaching to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:25:00.455 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:25:00.455 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:25:00.455 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:25:00.455 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:25:00.455 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:25:00.455 Initialization complete. Launching workers. 00:25:00.455 Starting thread on core 1 00:25:00.455 Starting thread on core 2 00:25:00.455 Starting thread on core 3 00:25:00.455 Starting thread on core 0 00:25:00.455 02:44:33 -- host/target_disconnect.sh@74 -- # sync 00:25:00.455 00:25:00.456 real 0m17.355s 00:25:00.456 user 0m59.632s 00:25:00.456 sys 0m5.947s 00:25:00.456 02:44:33 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:25:00.456 02:44:33 -- common/autotest_common.sh@10 -- # set +x 00:25:00.456 ************************************ 00:25:00.456 END TEST nvmf_target_disconnect_tc3 00:25:00.456 ************************************ 00:25:00.456 02:44:33 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:25:00.456 02:44:33 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:25:00.456 02:44:33 -- nvmf/common.sh@477 -- # nvmfcleanup 00:25:00.456 02:44:33 -- nvmf/common.sh@117 -- # sync 00:25:00.456 02:44:33 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:25:00.456 02:44:33 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:25:00.456 02:44:33 -- nvmf/common.sh@120 -- # set +e 00:25:00.456 02:44:33 -- nvmf/common.sh@121 -- # for i in {1..20} 00:25:00.456 02:44:33 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:25:00.456 rmmod nvme_rdma 00:25:00.456 rmmod nvme_fabrics 00:25:00.456 02:44:34 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:25:00.456 02:44:34 -- nvmf/common.sh@124 -- # set -e 00:25:00.456 02:44:34 -- nvmf/common.sh@125 -- # return 0 00:25:00.456 02:44:34 -- nvmf/common.sh@478 -- # '[' -n 1657646 ']' 00:25:00.456 02:44:34 -- nvmf/common.sh@479 -- # killprocess 1657646 00:25:00.456 02:44:34 -- common/autotest_common.sh@936 -- # '[' -z 1657646 ']' 00:25:00.456 02:44:34 -- common/autotest_common.sh@940 -- # kill -0 1657646 00:25:00.456 02:44:34 -- common/autotest_common.sh@941 -- # uname 00:25:00.456 02:44:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:00.456 02:44:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1657646 00:25:00.456 02:44:34 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:25:00.456 02:44:34 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:25:00.456 02:44:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1657646' 00:25:00.456 killing process with pid 1657646 00:25:00.456 02:44:34 -- common/autotest_common.sh@955 -- # kill 1657646 00:25:00.456 02:44:34 -- common/autotest_common.sh@960 -- # wait 1657646 00:25:00.713 [2024-04-27 02:44:34.157749] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:25:00.970 02:44:34 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:25:00.970 02:44:34 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:25:00.970 00:25:00.970 real 0m38.033s 00:25:00.970 user 2m23.033s 00:25:00.970 sys 0m14.662s 00:25:00.970 02:44:34 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:25:00.970 02:44:34 -- common/autotest_common.sh@10 -- # set +x 00:25:00.970 ************************************ 00:25:00.970 END TEST nvmf_target_disconnect 00:25:00.970 ************************************ 00:25:00.970 02:44:34 -- nvmf/nvmf.sh@123 -- # timing_exit host 00:25:00.970 02:44:34 -- common/autotest_common.sh@716 -- # xtrace_disable 00:25:00.970 02:44:34 -- common/autotest_common.sh@10 -- # set +x 00:25:00.970 02:44:34 -- nvmf/nvmf.sh@125 -- # trap - SIGINT SIGTERM EXIT 00:25:00.970 00:25:00.970 real 16m10.626s 00:25:00.970 user 40m57.652s 00:25:00.970 sys 4m38.774s 00:25:00.970 02:44:34 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:25:00.970 02:44:34 -- common/autotest_common.sh@10 -- # set +x 00:25:00.970 ************************************ 00:25:00.970 END TEST nvmf_rdma 00:25:00.970 ************************************ 00:25:00.970 02:44:34 -- spdk/autotest.sh@283 -- # run_test spdkcli_nvmf_rdma /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=rdma 00:25:00.971 02:44:34 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:00.971 02:44:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:00.971 02:44:34 -- common/autotest_common.sh@10 -- # set +x 00:25:01.229 ************************************ 00:25:01.229 START TEST spdkcli_nvmf_rdma 00:25:01.229 ************************************ 00:25:01.229 02:44:34 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=rdma 00:25:01.229 * Looking for test storage... 00:25:01.229 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli 00:25:01.229 02:44:34 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/common.sh 00:25:01.229 02:44:34 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:25:01.229 02:44:34 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/clear_config.py 00:25:01.229 02:44:34 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:25:01.229 02:44:34 -- nvmf/common.sh@7 -- # uname -s 00:25:01.229 02:44:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:01.229 02:44:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:01.229 02:44:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:01.229 02:44:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:01.229 02:44:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:01.229 02:44:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:01.229 02:44:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:01.229 02:44:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:01.229 02:44:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:01.229 02:44:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:01.229 02:44:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:25:01.229 02:44:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:25:01.229 02:44:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:01.229 02:44:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:01.229 02:44:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:01.229 02:44:34 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:25:01.229 02:44:34 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:25:01.229 02:44:34 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:01.229 02:44:34 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:01.229 02:44:34 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:01.229 02:44:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:01.229 02:44:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:01.229 02:44:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:01.229 02:44:34 -- paths/export.sh@5 -- # export PATH 00:25:01.229 02:44:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:01.229 02:44:34 -- nvmf/common.sh@47 -- # : 0 00:25:01.229 02:44:34 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:25:01.229 02:44:34 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:25:01.229 02:44:34 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:25:01.229 02:44:34 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:01.229 02:44:34 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:01.229 02:44:34 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:25:01.229 02:44:34 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:25:01.229 02:44:34 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:25:01.229 02:44:34 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:25:01.229 02:44:34 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:25:01.229 02:44:34 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:25:01.229 02:44:34 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:25:01.229 02:44:34 -- common/autotest_common.sh@710 -- # xtrace_disable 00:25:01.229 02:44:34 -- common/autotest_common.sh@10 -- # set +x 00:25:01.229 02:44:34 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:25:01.229 02:44:34 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=1659581 00:25:01.229 02:44:34 -- spdkcli/common.sh@34 -- # waitforlisten 1659581 00:25:01.229 02:44:34 -- common/autotest_common.sh@817 -- # '[' -z 1659581 ']' 00:25:01.229 02:44:34 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:01.229 02:44:34 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:25:01.229 02:44:34 -- common/autotest_common.sh@822 -- # local max_retries=100 00:25:01.229 02:44:34 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:01.229 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:01.229 02:44:34 -- common/autotest_common.sh@826 -- # xtrace_disable 00:25:01.229 02:44:34 -- common/autotest_common.sh@10 -- # set +x 00:25:01.229 [2024-04-27 02:44:34.843080] Starting SPDK v24.05-pre git sha1 6651b13f7 / DPDK 23.11.0 initialization... 00:25:01.229 [2024-04-27 02:44:34.843141] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1659581 ] 00:25:01.488 EAL: No free 2048 kB hugepages reported on node 1 00:25:01.488 [2024-04-27 02:44:34.912836] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:25:01.488 [2024-04-27 02:44:34.992545] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:01.488 [2024-04-27 02:44:34.992548] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:02.053 02:44:35 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:25:02.053 02:44:35 -- common/autotest_common.sh@850 -- # return 0 00:25:02.053 02:44:35 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:25:02.053 02:44:35 -- common/autotest_common.sh@716 -- # xtrace_disable 00:25:02.053 02:44:35 -- common/autotest_common.sh@10 -- # set +x 00:25:02.311 02:44:35 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:25:02.311 02:44:35 -- spdkcli/nvmf.sh@22 -- # [[ rdma == \r\d\m\a ]] 00:25:02.311 02:44:35 -- spdkcli/nvmf.sh@23 -- # nvmftestinit 00:25:02.311 02:44:35 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:25:02.311 02:44:35 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:02.311 02:44:35 -- nvmf/common.sh@437 -- # prepare_net_devs 00:25:02.311 02:44:35 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:25:02.311 02:44:35 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:25:02.311 02:44:35 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:02.311 02:44:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:25:02.311 02:44:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:02.311 02:44:35 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:25:02.311 02:44:35 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:25:02.311 02:44:35 -- nvmf/common.sh@285 -- # xtrace_disable 00:25:02.311 02:44:35 -- common/autotest_common.sh@10 -- # set +x 00:25:08.864 02:44:41 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:08.864 02:44:41 -- nvmf/common.sh@291 -- # pci_devs=() 00:25:08.864 02:44:41 -- nvmf/common.sh@291 -- # local -a pci_devs 00:25:08.864 02:44:41 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:25:08.864 02:44:41 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:25:08.864 02:44:41 -- nvmf/common.sh@293 -- # pci_drivers=() 00:25:08.864 02:44:41 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:25:08.864 02:44:41 -- nvmf/common.sh@295 -- # net_devs=() 00:25:08.864 02:44:41 -- nvmf/common.sh@295 -- # local -ga net_devs 00:25:08.864 02:44:41 -- nvmf/common.sh@296 -- # e810=() 00:25:08.864 02:44:41 -- nvmf/common.sh@296 -- # local -ga e810 00:25:08.864 02:44:41 -- nvmf/common.sh@297 -- # x722=() 00:25:08.864 02:44:41 -- nvmf/common.sh@297 -- # local -ga x722 00:25:08.864 02:44:41 -- nvmf/common.sh@298 -- # mlx=() 00:25:08.864 02:44:41 -- nvmf/common.sh@298 -- # local -ga mlx 00:25:08.864 02:44:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:08.864 02:44:41 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:08.864 02:44:41 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:08.864 02:44:41 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:08.864 02:44:41 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:08.864 02:44:41 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:08.864 02:44:41 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:08.864 02:44:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:08.864 02:44:41 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:08.864 02:44:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:08.864 02:44:41 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:08.864 02:44:41 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:25:08.864 02:44:41 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:25:08.864 02:44:41 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:25:08.864 02:44:41 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:25:08.864 02:44:41 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:25:08.864 02:44:41 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:25:08.864 02:44:41 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:25:08.864 02:44:41 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:25:08.864 02:44:41 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:25:08.864 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:25:08.864 02:44:41 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:25:08.864 02:44:41 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:25:08.864 02:44:41 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:25:08.864 02:44:41 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:25:08.864 02:44:41 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:25:08.864 02:44:41 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:25:08.864 02:44:41 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:25:08.864 02:44:41 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:25:08.864 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:25:08.864 02:44:41 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:25:08.864 02:44:41 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:25:08.864 02:44:41 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:25:08.864 02:44:41 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:25:08.864 02:44:41 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:25:08.865 02:44:41 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:25:08.865 02:44:41 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:25:08.865 02:44:41 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:25:08.865 02:44:41 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:25:08.865 02:44:41 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:08.865 02:44:41 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:25:08.865 02:44:41 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:08.865 02:44:41 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:25:08.865 Found net devices under 0000:18:00.0: mlx_0_0 00:25:08.865 02:44:41 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:25:08.865 02:44:41 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:25:08.865 02:44:41 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:08.865 02:44:41 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:25:08.865 02:44:41 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:08.865 02:44:41 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:25:08.865 Found net devices under 0000:18:00.1: mlx_0_1 00:25:08.865 02:44:41 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:25:08.865 02:44:41 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:25:08.865 02:44:41 -- nvmf/common.sh@403 -- # is_hw=yes 00:25:08.865 02:44:41 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:25:08.865 02:44:41 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:25:08.865 02:44:41 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:25:08.865 02:44:42 -- nvmf/common.sh@409 -- # rdma_device_init 00:25:08.865 02:44:42 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:25:08.865 02:44:42 -- nvmf/common.sh@58 -- # uname 00:25:08.865 02:44:42 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:25:08.865 02:44:42 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:25:08.865 02:44:42 -- nvmf/common.sh@63 -- # modprobe ib_core 00:25:08.865 02:44:42 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:25:08.865 02:44:42 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:25:08.865 02:44:42 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:25:08.865 02:44:42 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:25:08.865 02:44:42 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:25:08.865 02:44:42 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:25:08.865 02:44:42 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:25:08.865 02:44:42 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:25:08.865 02:44:42 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:25:08.865 02:44:42 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:25:08.865 02:44:42 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:25:08.865 02:44:42 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:25:08.865 02:44:42 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:25:08.865 02:44:42 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:25:08.865 02:44:42 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:25:08.865 02:44:42 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:25:08.865 02:44:42 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:25:08.865 02:44:42 -- nvmf/common.sh@105 -- # continue 2 00:25:08.865 02:44:42 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:25:08.865 02:44:42 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:25:08.865 02:44:42 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:25:08.865 02:44:42 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:25:08.865 02:44:42 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:25:08.865 02:44:42 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:25:08.865 02:44:42 -- nvmf/common.sh@105 -- # continue 2 00:25:08.865 02:44:42 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:25:08.865 02:44:42 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:25:08.865 02:44:42 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:25:08.865 02:44:42 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:25:08.865 02:44:42 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:25:08.865 02:44:42 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:25:08.865 02:44:42 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:25:08.865 02:44:42 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:25:08.865 02:44:42 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:25:08.865 64: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:25:08.865 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:25:08.865 altname enp24s0f0np0 00:25:08.865 altname ens785f0np0 00:25:08.865 inet 192.168.100.8/24 scope global mlx_0_0 00:25:08.865 valid_lft forever preferred_lft forever 00:25:08.865 02:44:42 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:25:08.865 02:44:42 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:25:08.865 02:44:42 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:25:08.865 02:44:42 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:25:08.865 02:44:42 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:25:08.865 02:44:42 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:25:08.865 02:44:42 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:25:08.865 02:44:42 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:25:08.865 02:44:42 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:25:08.865 65: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:25:08.865 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:25:08.865 altname enp24s0f1np1 00:25:08.865 altname ens785f1np1 00:25:08.865 inet 192.168.100.9/24 scope global mlx_0_1 00:25:08.865 valid_lft forever preferred_lft forever 00:25:08.865 02:44:42 -- nvmf/common.sh@411 -- # return 0 00:25:08.865 02:44:42 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:25:08.865 02:44:42 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:25:08.865 02:44:42 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:25:08.865 02:44:42 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:25:08.865 02:44:42 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:25:08.865 02:44:42 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:25:08.865 02:44:42 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:25:08.865 02:44:42 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:25:08.865 02:44:42 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:25:08.865 02:44:42 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:25:08.865 02:44:42 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:25:08.865 02:44:42 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:25:08.865 02:44:42 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:25:08.865 02:44:42 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:25:08.865 02:44:42 -- nvmf/common.sh@105 -- # continue 2 00:25:08.865 02:44:42 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:25:08.865 02:44:42 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:25:08.865 02:44:42 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:25:08.865 02:44:42 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:25:08.865 02:44:42 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:25:08.865 02:44:42 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:25:08.865 02:44:42 -- nvmf/common.sh@105 -- # continue 2 00:25:08.865 02:44:42 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:25:08.865 02:44:42 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:25:08.865 02:44:42 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:25:08.865 02:44:42 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:25:08.865 02:44:42 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:25:08.865 02:44:42 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:25:08.865 02:44:42 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:25:08.865 02:44:42 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:25:08.865 02:44:42 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:25:08.865 02:44:42 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:25:08.865 02:44:42 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:25:08.865 02:44:42 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:25:08.865 02:44:42 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:25:08.865 192.168.100.9' 00:25:08.865 02:44:42 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:25:08.865 192.168.100.9' 00:25:08.865 02:44:42 -- nvmf/common.sh@446 -- # head -n 1 00:25:08.865 02:44:42 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:25:08.865 02:44:42 -- nvmf/common.sh@447 -- # head -n 1 00:25:08.865 02:44:42 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:25:08.865 192.168.100.9' 00:25:08.865 02:44:42 -- nvmf/common.sh@447 -- # tail -n +2 00:25:08.865 02:44:42 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:25:08.865 02:44:42 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:25:08.865 02:44:42 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:25:08.865 02:44:42 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:25:08.865 02:44:42 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:25:08.865 02:44:42 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:25:08.865 02:44:42 -- spdkcli/nvmf.sh@24 -- # NVMF_TARGET_IP=192.168.100.8 00:25:08.865 02:44:42 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:25:08.865 02:44:42 -- common/autotest_common.sh@710 -- # xtrace_disable 00:25:08.865 02:44:42 -- common/autotest_common.sh@10 -- # set +x 00:25:08.865 02:44:42 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:25:08.865 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:25:08.865 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:25:08.865 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:25:08.865 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:25:08.865 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:25:08.865 '\''nvmf/transport create rdma max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:25:08.865 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:25:08.865 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:25:08.865 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:25:08.865 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4260 IPv4'\'' '\''192.168.100.8:4260'\'' True 00:25:08.865 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:25:08.865 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:25:08.865 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create rdma 192.168.100.8 4260 IPv4'\'' '\''192.168.100.8:4260'\'' True 00:25:08.865 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:25:08.865 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:25:08.866 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create rdma 192.168.100.8 4260 IPv4'\'' '\''192.168.100.8:4260'\'' True 00:25:08.866 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create rdma 192.168.100.8 4261 IPv4'\'' '\''192.168.100.8:4261'\'' True 00:25:08.866 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:25:08.866 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:25:08.866 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:25:08.866 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:25:08.866 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4261 IPv4'\'' '\''192.168.100.8:4261'\'' True 00:25:08.866 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4262 IPv4'\'' '\''192.168.100.8:4262'\'' True 00:25:08.866 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:25:08.866 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:25:08.866 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:25:08.866 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:25:08.866 ' 00:25:09.123 [2024-04-27 02:44:42.581810] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:25:11.649 [2024-04-27 02:44:44.646853] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x206e600/0x20800b0) succeed. 00:25:11.649 [2024-04-27 02:44:44.658515] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x206fab0/0x20c1740) succeed. 00:25:12.583 [2024-04-27 02:44:45.914406] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4260 *** 00:25:15.113 [2024-04-27 02:44:48.121475] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4261 *** 00:25:16.497 [2024-04-27 02:44:49.979580] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4262 *** 00:25:17.867 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:25:17.867 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:25:17.867 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:25:17.867 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:25:17.867 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:25:17.867 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:25:17.867 Executing command: ['nvmf/transport create rdma max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:25:17.867 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:25:17.867 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:25:17.867 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:25:17.867 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4260 IPv4', '192.168.100.8:4260', True] 00:25:17.867 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:25:17.867 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:25:17.867 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create rdma 192.168.100.8 4260 IPv4', '192.168.100.8:4260', True] 00:25:17.867 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:25:17.867 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:25:17.867 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create rdma 192.168.100.8 4260 IPv4', '192.168.100.8:4260', True] 00:25:17.867 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create rdma 192.168.100.8 4261 IPv4', '192.168.100.8:4261', True] 00:25:17.867 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:25:17.867 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:25:17.867 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:25:17.867 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:25:17.867 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4261 IPv4', '192.168.100.8:4261', True] 00:25:17.867 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4262 IPv4', '192.168.100.8:4262', True] 00:25:17.867 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:25:17.867 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:25:17.867 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:25:17.867 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:25:18.125 02:44:51 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:25:18.125 02:44:51 -- common/autotest_common.sh@716 -- # xtrace_disable 00:25:18.125 02:44:51 -- common/autotest_common.sh@10 -- # set +x 00:25:18.125 02:44:51 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:25:18.125 02:44:51 -- common/autotest_common.sh@710 -- # xtrace_disable 00:25:18.125 02:44:51 -- common/autotest_common.sh@10 -- # set +x 00:25:18.125 02:44:51 -- spdkcli/nvmf.sh@69 -- # check_match 00:25:18.125 02:44:51 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:25:18.382 02:44:51 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:25:18.382 02:44:51 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:25:18.382 02:44:51 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:25:18.382 02:44:51 -- common/autotest_common.sh@716 -- # xtrace_disable 00:25:18.382 02:44:51 -- common/autotest_common.sh@10 -- # set +x 00:25:18.641 02:44:52 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:25:18.641 02:44:52 -- common/autotest_common.sh@710 -- # xtrace_disable 00:25:18.641 02:44:52 -- common/autotest_common.sh@10 -- # set +x 00:25:18.641 02:44:52 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:25:18.641 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:25:18.641 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:25:18.641 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:25:18.641 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete rdma 192.168.100.8 4262'\'' '\''192.168.100.8:4262'\'' 00:25:18.641 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''192.168.100.8:4261'\'' 00:25:18.641 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:25:18.641 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:25:18.641 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:25:18.641 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:25:18.641 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:25:18.641 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:25:18.641 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:25:18.641 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:25:18.641 ' 00:25:23.908 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:25:23.908 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:25:23.908 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:25:23.908 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:25:23.908 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete rdma 192.168.100.8 4262', '192.168.100.8:4262', False] 00:25:23.908 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '192.168.100.8:4261', False] 00:25:23.908 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:25:23.908 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:25:23.908 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:25:23.908 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:25:23.908 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:25:23.908 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:25:23.908 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:25:23.908 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:25:23.908 02:44:57 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:25:23.908 02:44:57 -- common/autotest_common.sh@716 -- # xtrace_disable 00:25:23.908 02:44:57 -- common/autotest_common.sh@10 -- # set +x 00:25:23.908 02:44:57 -- spdkcli/nvmf.sh@90 -- # killprocess 1659581 00:25:23.908 02:44:57 -- common/autotest_common.sh@936 -- # '[' -z 1659581 ']' 00:25:23.908 02:44:57 -- common/autotest_common.sh@940 -- # kill -0 1659581 00:25:23.908 02:44:57 -- common/autotest_common.sh@941 -- # uname 00:25:23.908 02:44:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:23.908 02:44:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1659581 00:25:23.908 02:44:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:23.908 02:44:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:23.908 02:44:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1659581' 00:25:23.908 killing process with pid 1659581 00:25:23.908 02:44:57 -- common/autotest_common.sh@955 -- # kill 1659581 00:25:23.908 [2024-04-27 02:44:57.168677] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:25:23.908 02:44:57 -- common/autotest_common.sh@960 -- # wait 1659581 00:25:23.908 [2024-04-27 02:44:57.223481] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:25:23.908 02:44:57 -- spdkcli/nvmf.sh@1 -- # nvmftestfini 00:25:23.908 02:44:57 -- nvmf/common.sh@477 -- # nvmfcleanup 00:25:23.908 02:44:57 -- nvmf/common.sh@117 -- # sync 00:25:23.908 02:44:57 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:25:23.908 02:44:57 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:25:23.908 02:44:57 -- nvmf/common.sh@120 -- # set +e 00:25:23.908 02:44:57 -- nvmf/common.sh@121 -- # for i in {1..20} 00:25:23.908 02:44:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:25:23.908 rmmod nvme_rdma 00:25:23.908 rmmod nvme_fabrics 00:25:23.908 02:44:57 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:25:23.908 02:44:57 -- nvmf/common.sh@124 -- # set -e 00:25:23.908 02:44:57 -- nvmf/common.sh@125 -- # return 0 00:25:23.908 02:44:57 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:25:23.908 02:44:57 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:25:23.908 02:44:57 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:25:23.908 00:25:23.908 real 0m22.870s 00:25:23.908 user 0m48.518s 00:25:23.908 sys 0m5.875s 00:25:23.908 02:44:57 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:25:23.908 02:44:57 -- common/autotest_common.sh@10 -- # set +x 00:25:23.908 ************************************ 00:25:23.908 END TEST spdkcli_nvmf_rdma 00:25:23.908 ************************************ 00:25:24.167 02:44:57 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:25:24.167 02:44:57 -- spdk/autotest.sh@310 -- # '[' 0 -eq 1 ']' 00:25:24.167 02:44:57 -- spdk/autotest.sh@314 -- # '[' 0 -eq 1 ']' 00:25:24.167 02:44:57 -- spdk/autotest.sh@319 -- # '[' 0 -eq 1 ']' 00:25:24.167 02:44:57 -- spdk/autotest.sh@328 -- # '[' 0 -eq 1 ']' 00:25:24.167 02:44:57 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:25:24.167 02:44:57 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:25:24.167 02:44:57 -- spdk/autotest.sh@341 -- # '[' 0 -eq 1 ']' 00:25:24.167 02:44:57 -- spdk/autotest.sh@345 -- # '[' 0 -eq 1 ']' 00:25:24.167 02:44:57 -- spdk/autotest.sh@350 -- # '[' 0 -eq 1 ']' 00:25:24.167 02:44:57 -- spdk/autotest.sh@354 -- # '[' 0 -eq 1 ']' 00:25:24.167 02:44:57 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:25:24.167 02:44:57 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:25:24.167 02:44:57 -- spdk/autotest.sh@369 -- # [[ 0 -eq 1 ]] 00:25:24.167 02:44:57 -- spdk/autotest.sh@373 -- # [[ 0 -eq 1 ]] 00:25:24.167 02:44:57 -- spdk/autotest.sh@378 -- # trap - SIGINT SIGTERM EXIT 00:25:24.167 02:44:57 -- spdk/autotest.sh@380 -- # timing_enter post_cleanup 00:25:24.167 02:44:57 -- common/autotest_common.sh@710 -- # xtrace_disable 00:25:24.167 02:44:57 -- common/autotest_common.sh@10 -- # set +x 00:25:24.167 02:44:57 -- spdk/autotest.sh@381 -- # autotest_cleanup 00:25:24.167 02:44:57 -- common/autotest_common.sh@1378 -- # local autotest_es=0 00:25:24.167 02:44:57 -- common/autotest_common.sh@1379 -- # xtrace_disable 00:25:24.167 02:44:57 -- common/autotest_common.sh@10 -- # set +x 00:25:28.396 INFO: APP EXITING 00:25:28.396 INFO: killing all VMs 00:25:28.396 INFO: killing vhost app 00:25:28.396 INFO: EXIT DONE 00:25:30.301 Waiting for block devices as requested 00:25:30.302 0000:5f:00.0 (8086 0a54): vfio-pci -> nvme 00:25:30.560 0000:00:04.7 (8086 2021): vfio-pci -> ioatdma 00:25:30.560 0000:00:04.6 (8086 2021): vfio-pci -> ioatdma 00:25:30.820 0000:00:04.5 (8086 2021): vfio-pci -> ioatdma 00:25:30.820 0000:00:04.4 (8086 2021): vfio-pci -> ioatdma 00:25:30.820 0000:00:04.3 (8086 2021): vfio-pci -> ioatdma 00:25:30.820 0000:00:04.2 (8086 2021): vfio-pci -> ioatdma 00:25:31.079 0000:00:04.1 (8086 2021): vfio-pci -> ioatdma 00:25:31.079 0000:00:04.0 (8086 2021): vfio-pci -> ioatdma 00:25:31.079 0000:80:04.7 (8086 2021): vfio-pci -> ioatdma 00:25:31.338 0000:80:04.6 (8086 2021): vfio-pci -> ioatdma 00:25:31.338 0000:80:04.5 (8086 2021): vfio-pci -> ioatdma 00:25:31.338 0000:80:04.4 (8086 2021): vfio-pci -> ioatdma 00:25:31.597 0000:80:04.3 (8086 2021): vfio-pci -> ioatdma 00:25:31.597 0000:80:04.2 (8086 2021): vfio-pci -> ioatdma 00:25:31.597 0000:80:04.1 (8086 2021): vfio-pci -> ioatdma 00:25:31.856 0000:80:04.0 (8086 2021): vfio-pci -> ioatdma 00:25:34.393 Cleaning 00:25:34.393 Removing: /var/run/dpdk/spdk0/config 00:25:34.393 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:25:34.393 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:25:34.393 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:25:34.393 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:25:34.393 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:25:34.393 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:25:34.393 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:25:34.653 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:25:34.653 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:25:34.653 Removing: /var/run/dpdk/spdk0/hugepage_info 00:25:34.653 Removing: /var/run/dpdk/spdk1/config 00:25:34.653 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:25:34.653 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:25:34.653 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:25:34.653 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:25:34.653 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:25:34.653 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:25:34.653 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:25:34.653 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:25:34.653 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:25:34.653 Removing: /var/run/dpdk/spdk1/hugepage_info 00:25:34.653 Removing: /var/run/dpdk/spdk1/mp_socket 00:25:34.653 Removing: /var/run/dpdk/spdk2/config 00:25:34.653 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:25:34.653 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:25:34.653 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:25:34.653 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:25:34.653 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:25:34.653 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:25:34.653 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:25:34.653 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:25:34.653 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:25:34.653 Removing: /var/run/dpdk/spdk2/hugepage_info 00:25:34.653 Removing: /var/run/dpdk/spdk3/config 00:25:34.653 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:25:34.653 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:25:34.653 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:25:34.653 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:25:34.653 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:25:34.653 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:25:34.653 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:25:34.653 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:25:34.653 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:25:34.653 Removing: /var/run/dpdk/spdk3/hugepage_info 00:25:34.653 Removing: /var/run/dpdk/spdk4/config 00:25:34.653 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:25:34.653 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:25:34.653 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:25:34.653 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:25:34.653 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:25:34.653 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:25:34.653 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:25:34.653 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:25:34.653 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:25:34.653 Removing: /var/run/dpdk/spdk4/hugepage_info 00:25:34.653 Removing: /dev/shm/bdevperf_trace.pid1514694 00:25:34.653 Removing: /dev/shm/bdevperf_trace.pid1595811 00:25:34.653 Removing: /dev/shm/bdev_svc_trace.1 00:25:34.653 Removing: /dev/shm/nvmf_trace.0 00:25:34.653 Removing: /dev/shm/spdk_tgt_trace.pid1417251 00:25:34.653 Removing: /var/run/dpdk/spdk0 00:25:34.653 Removing: /var/run/dpdk/spdk1 00:25:34.913 Removing: /var/run/dpdk/spdk2 00:25:34.913 Removing: /var/run/dpdk/spdk3 00:25:34.913 Removing: /var/run/dpdk/spdk4 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1414616 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1415836 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1417251 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1417860 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1418625 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1418816 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1419745 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1419799 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1420108 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1424524 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1425929 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1426243 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1426584 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1426852 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1427205 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1427485 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1427697 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1427939 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1428857 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1431784 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1432055 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1432319 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1432463 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1432876 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1433055 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1433632 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1433650 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1434039 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1434066 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1434277 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1434460 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1434935 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1435144 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1435396 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1435687 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1435831 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1436071 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1436298 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1436511 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1436721 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1436931 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1437147 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1437453 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1437730 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1437934 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1438151 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1438358 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1438570 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1438781 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1439085 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1439364 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1439576 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1439790 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1440002 00:25:34.913 Removing: /var/run/dpdk/spdk_pid1440232 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1440531 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1440807 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1440882 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1441327 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1444760 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1481184 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1484753 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1493471 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1497956 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1501151 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1501711 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1514694 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1515046 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1518562 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1523600 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1525767 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1534275 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1554875 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1558110 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1571200 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1594014 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1594899 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1595811 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1599404 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1605607 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1606337 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1607059 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1607794 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1608148 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1611981 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1611983 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1615847 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1616215 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1616746 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1617290 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1617301 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1621345 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1621790 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1625514 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1628195 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1634379 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1634383 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1650054 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1650240 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1655186 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1655593 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1657096 00:25:35.173 Removing: /var/run/dpdk/spdk_pid1659581 00:25:35.173 Clean 00:25:35.431 02:45:08 -- common/autotest_common.sh@1437 -- # return 0 00:25:35.431 02:45:08 -- spdk/autotest.sh@382 -- # timing_exit post_cleanup 00:25:35.431 02:45:08 -- common/autotest_common.sh@716 -- # xtrace_disable 00:25:35.431 02:45:08 -- common/autotest_common.sh@10 -- # set +x 00:25:35.431 02:45:08 -- spdk/autotest.sh@384 -- # timing_exit autotest 00:25:35.431 02:45:08 -- common/autotest_common.sh@716 -- # xtrace_disable 00:25:35.431 02:45:08 -- common/autotest_common.sh@10 -- # set +x 00:25:35.431 02:45:09 -- spdk/autotest.sh@385 -- # chmod a+r /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/timing.txt 00:25:35.431 02:45:09 -- spdk/autotest.sh@387 -- # [[ -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/udev.log ]] 00:25:35.431 02:45:09 -- spdk/autotest.sh@387 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/udev.log 00:25:35.431 02:45:09 -- spdk/autotest.sh@389 -- # hash lcov 00:25:35.431 02:45:09 -- spdk/autotest.sh@389 -- # [[ CC_TYPE=gcc == *\c\l\a\n\g* ]] 00:25:35.431 02:45:09 -- spdk/autotest.sh@391 -- # hostname 00:25:35.432 02:45:09 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -c -d /var/jenkins/workspace/nvmf-phy-autotest/spdk -t spdk-wfp-34 -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_test.info 00:25:35.690 geninfo: WARNING: invalid characters removed from testname! 00:25:57.616 02:45:28 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -a /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info 00:25:57.616 02:45:30 -- spdk/autotest.sh@393 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info 00:25:58.994 02:45:32 -- spdk/autotest.sh@394 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info '/usr/*' -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info 00:26:00.894 02:45:34 -- spdk/autotest.sh@395 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info 00:26:02.271 02:45:35 -- spdk/autotest.sh@396 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info 00:26:04.205 02:45:37 -- spdk/autotest.sh@397 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info 00:26:05.582 02:45:38 -- spdk/autotest.sh@398 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:26:05.582 02:45:39 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:26:05.582 02:45:39 -- scripts/common.sh@508 -- $ [[ -e /bin/wpdk_common.sh ]] 00:26:05.582 02:45:39 -- scripts/common.sh@516 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:05.582 02:45:39 -- scripts/common.sh@517 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:05.582 02:45:39 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:05.582 02:45:39 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:05.582 02:45:39 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:05.582 02:45:39 -- paths/export.sh@5 -- $ export PATH 00:26:05.582 02:45:39 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:05.582 02:45:39 -- common/autobuild_common.sh@434 -- $ out=/var/jenkins/workspace/nvmf-phy-autotest/spdk/../output 00:26:05.582 02:45:39 -- common/autobuild_common.sh@435 -- $ date +%s 00:26:05.582 02:45:39 -- common/autobuild_common.sh@435 -- $ mktemp -dt spdk_1714178739.XXXXXX 00:26:05.582 02:45:39 -- common/autobuild_common.sh@435 -- $ SPDK_WORKSPACE=/tmp/spdk_1714178739.nibVkA 00:26:05.582 02:45:39 -- common/autobuild_common.sh@437 -- $ [[ -n '' ]] 00:26:05.582 02:45:39 -- common/autobuild_common.sh@441 -- $ '[' -n '' ']' 00:26:05.583 02:45:39 -- common/autobuild_common.sh@444 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/' 00:26:05.583 02:45:39 -- common/autobuild_common.sh@448 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/xnvme --exclude /tmp' 00:26:05.583 02:45:39 -- common/autobuild_common.sh@450 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:26:05.583 02:45:39 -- common/autobuild_common.sh@451 -- $ get_config_params 00:26:05.583 02:45:39 -- common/autotest_common.sh@385 -- $ xtrace_disable 00:26:05.583 02:45:39 -- common/autotest_common.sh@10 -- $ set +x 00:26:05.583 02:45:39 -- common/autobuild_common.sh@451 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:26:05.583 02:45:39 -- common/autobuild_common.sh@453 -- $ start_monitor_resources 00:26:05.583 02:45:39 -- pm/common@17 -- $ local monitor 00:26:05.583 02:45:39 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:26:05.583 02:45:39 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=1672663 00:26:05.583 02:45:39 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:26:05.583 02:45:39 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=1672665 00:26:05.583 02:45:39 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:26:05.583 02:45:39 -- pm/common@21 -- $ date +%s 00:26:05.583 02:45:39 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=1672667 00:26:05.583 02:45:39 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:26:05.583 02:45:39 -- pm/common@21 -- $ date +%s 00:26:05.583 02:45:39 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=1672670 00:26:05.583 02:45:39 -- pm/common@21 -- $ date +%s 00:26:05.583 02:45:39 -- pm/common@26 -- $ sleep 1 00:26:05.583 02:45:39 -- pm/common@21 -- $ date +%s 00:26:05.583 02:45:39 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1714178739 00:26:05.583 02:45:39 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1714178739 00:26:05.583 02:45:39 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1714178739 00:26:05.583 02:45:39 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1714178739 00:26:05.842 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1714178739_collect-cpu-load.pm.log 00:26:05.842 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1714178739_collect-vmstat.pm.log 00:26:05.842 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1714178739_collect-cpu-temp.pm.log 00:26:05.842 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1714178739_collect-bmc-pm.bmc.pm.log 00:26:06.780 02:45:40 -- common/autobuild_common.sh@454 -- $ trap stop_monitor_resources EXIT 00:26:06.780 02:45:40 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j72 00:26:06.780 02:45:40 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:26:06.780 02:45:40 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:26:06.780 02:45:40 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:26:06.780 02:45:40 -- spdk/autopackage.sh@19 -- $ timing_finish 00:26:06.780 02:45:40 -- common/autotest_common.sh@722 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:26:06.780 02:45:40 -- common/autotest_common.sh@723 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:26:06.780 02:45:40 -- common/autotest_common.sh@725 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/timing.txt 00:26:06.780 02:45:40 -- spdk/autopackage.sh@20 -- $ exit 0 00:26:06.780 02:45:40 -- spdk/autopackage.sh@1 -- $ stop_monitor_resources 00:26:06.780 02:45:40 -- pm/common@30 -- $ signal_monitor_resources TERM 00:26:06.780 02:45:40 -- pm/common@41 -- $ local monitor pid pids signal=TERM 00:26:06.780 02:45:40 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:26:06.780 02:45:40 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-cpu-load.pid ]] 00:26:06.780 02:45:40 -- pm/common@45 -- $ pid=1672678 00:26:06.780 02:45:40 -- pm/common@52 -- $ sudo kill -TERM 1672678 00:26:06.780 02:45:40 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:26:06.780 02:45:40 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-vmstat.pid ]] 00:26:06.780 02:45:40 -- pm/common@45 -- $ pid=1672684 00:26:06.780 02:45:40 -- pm/common@52 -- $ sudo kill -TERM 1672684 00:26:06.780 02:45:40 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:26:06.780 02:45:40 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-cpu-temp.pid ]] 00:26:06.780 02:45:40 -- pm/common@45 -- $ pid=1672679 00:26:06.780 02:45:40 -- pm/common@52 -- $ sudo kill -TERM 1672679 00:26:06.780 02:45:40 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:26:06.780 02:45:40 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-bmc-pm.pid ]] 00:26:06.780 02:45:40 -- pm/common@45 -- $ pid=1672685 00:26:06.780 02:45:40 -- pm/common@52 -- $ sudo kill -TERM 1672685 00:26:06.780 + [[ -n 1316428 ]] 00:26:06.780 + sudo kill 1316428 00:26:06.792 [Pipeline] } 00:26:06.814 [Pipeline] // stage 00:26:06.819 [Pipeline] } 00:26:06.840 [Pipeline] // timeout 00:26:06.845 [Pipeline] } 00:26:06.864 [Pipeline] // catchError 00:26:06.870 [Pipeline] } 00:26:06.886 [Pipeline] // wrap 00:26:06.892 [Pipeline] } 00:26:06.910 [Pipeline] // catchError 00:26:06.919 [Pipeline] stage 00:26:06.922 [Pipeline] { (Epilogue) 00:26:06.938 [Pipeline] catchError 00:26:06.939 [Pipeline] { 00:26:06.953 [Pipeline] echo 00:26:06.954 Cleanup processes 00:26:06.960 [Pipeline] sh 00:26:07.244 + sudo pgrep -af /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:26:07.244 1672775 /usr/bin/ipmitool sdr dump /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/sdr.cache 00:26:07.244 1673010 sudo pgrep -af /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:26:07.257 [Pipeline] sh 00:26:07.540 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:26:07.540 ++ grep -v 'sudo pgrep' 00:26:07.540 ++ awk '{print $1}' 00:26:07.540 + sudo kill -9 1672775 00:26:07.552 [Pipeline] sh 00:26:07.840 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:26:14.419 [Pipeline] sh 00:26:14.700 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:26:14.700 Artifacts sizes are good 00:26:14.715 [Pipeline] archiveArtifacts 00:26:14.723 Archiving artifacts 00:26:14.867 [Pipeline] sh 00:26:15.153 + sudo chown -R sys_sgci /var/jenkins/workspace/nvmf-phy-autotest 00:26:15.170 [Pipeline] cleanWs 00:26:15.183 [WS-CLEANUP] Deleting project workspace... 00:26:15.183 [WS-CLEANUP] Deferred wipeout is used... 00:26:15.190 [WS-CLEANUP] done 00:26:15.192 [Pipeline] } 00:26:15.212 [Pipeline] // catchError 00:26:15.227 [Pipeline] sh 00:26:15.513 + logger -p user.info -t JENKINS-CI 00:26:15.522 [Pipeline] } 00:26:15.540 [Pipeline] // stage 00:26:15.545 [Pipeline] } 00:26:15.563 [Pipeline] // node 00:26:15.569 [Pipeline] End of Pipeline 00:26:15.604 Finished: SUCCESS